Matrix runs
A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.
Matching runs 36
Submitted by @imthekaiser. Newest first. Page 1 of 2.- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 242.6 tok/s
- Peak prefill
- 3,961 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 158.3 tok/s
- Peak prefill
- 3,856 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 158.6 tok/s
- Peak prefill
- 5,306 tok/s
- Qwen3.8-Flash-Next-W4A16Intel Arc Pro B65 32GB ×4 · vllm 0.30.0 · INT4_W4A166 contexts × 3 concurrency levels
- Peak decode
- 246.3 tok/s
- Peak prefill
- 5,206 tok/s
- gemma-4-31B-itIntel Arc Pro B65 32GB · vllm 0.31.0+xpu.llmscaler · INT41 context × 5 concurrency levels
- Peak decode
- 207.3 tok/s
- Peak prefill
- —
- Peak decode
- 425.3 tok/s
- Peak prefill
- —
- Peak decode
- 262.4 tok/s
- Peak prefill
- —
- Peak decode
- 284.5 tok/s
- Peak prefill
- 592.0 tok/s
- Peak decode
- 648.0 tok/s
- Peak prefill
- 1,407 tok/s
- gemma-4-31B-itIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP84 contexts × 5 concurrency levels
- Peak decode
- 396.8 tok/s
- Peak prefill
- 1,123 tok/s
- Peak decode
- 856.0 tok/s
- Peak prefill
- 2,219 tok/s
- Peak decode
- 674.3 tok/s
- Peak prefill
- 2,219 tok/s
- Peak decode
- 469.7 tok/s
- Peak prefill
- 4,888 tok/s
- Qwen3.6-35B-A3BIntel Arc Pro B65 32GB · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 469.4 tok/s
- Peak prefill
- 7,160 tok/s
- Qwen3.8-27BIntel Arc Pro B65 32GB · vllm 0.31.0+xpu.llmscaler · INT45 contexts × 5 concurrency levels
- Peak decode
- 204.3 tok/s
- Peak prefill
- 1,379 tok/s
- Qwen3.6-27BIntel Arc Pro B65 32GB · vllm 0.31.0+xpu.llmscaler · INT45 contexts × 5 concurrency levels
- Peak decode
- 209.8 tok/s
- Peak prefill
- 1,371 tok/s
- Qwen3.5-122B-A10B-GPTQ-Int4Intel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · GPTQ-4bit6 contexts × 5 concurrency levels
- Peak decode
- 539.6 tok/s
- Peak prefill
- 6,010 tok/s
- Muse-Glimmer-30BIntel Arc Pro B65 32GB ×4 · vllm 0.26.1.dev0+xpu.llmscaler-1.5 · FP84 contexts × 5 concurrency levels
- Peak decode
- 343.7 tok/s
- Peak prefill
- 2,679 tok/s
- Muse-Glimmer-30BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP84 contexts × 5 concurrency levels
- Peak decode
- 476.4 tok/s
- Peak prefill
- 2,709 tok/s
- Peak decode
- 399.3 tok/s
- Peak prefill
- 3,898 tok/s
- Peak decode
- 595.7 tok/s
- Peak prefill
- 9,041 tok/s
- Peak decode
- 1,670.0 tok/s
- Peak prefill
- 14.3K tok/s
- Qwen3.5-9BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · FP86 contexts × 5 concurrency levels
- Peak decode
- 1,568.3 tok/s
- Peak prefill
- 10.6K tok/s
- Peak decode
- 1,132.8 tok/s
- Peak prefill
- 10.4K tok/s
- Qwen3.8-27BIntel Arc Pro B65 32GB ×4 · vllm 0.31.0+xpu.llmscaler · INT46 contexts × 5 concurrency levels
- Peak decode
- 468.2 tok/s
- Peak prefill
- 3,748 tok/s