Matrix runs
A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.
Matching runs 36
Submitted by @imthekaiser. Newest first. Page 2 of 2.- Peak decode
- 404.2 tok/s
- Peak prefill
- 2,099 tok/s
- Peak decode
- 389.5 tok/s
- Peak prefill
- 3,699 tok/s
- Qwen3.6-35B-A3BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 833.4 tok/s
- Peak prefill
- 12.3K tok/s
- Qwen3.6-35B-A3BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP86 contexts × 5 concurrency levels
- Peak decode
- 1,030.5 tok/s
- Peak prefill
- 12.8K tok/s
- Peak decode
- 855.6 tok/s
- Peak prefill
- 11.9K tok/s
- Qwen3.6-27BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 471.7 tok/s
- Peak prefill
- 3,752 tok/s
- Qwen3.6-27BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP86 contexts × 5 concurrency levels
- Peak decode
- 626.7 tok/s
- Peak prefill
- 3,858 tok/s
- Peak decode
- 396.1 tok/s
- Peak prefill
- 3,709 tok/s
- Peak decode
- 760.9 tok/s
- Peak prefill
- 6,326 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 243.2 tok/s
- Peak prefill
- 3,229 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 159.2 tok/s
- Peak prefill
- 3,513 tok/s