CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 5331.7 tok/s is the aggregate decode rate across all 256 streams, about 20.8 tok/s per stream, and the 1934 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 5330.9, 5331.7, 5336.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 4048.3 tok/s is the aggregate decode rate across all 192 streams, about 21.1 tok/s per stream, and the 1313 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 4080.9, 4048.3, 2870.5 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3853.1 tok/s is the aggregate decode rate across all 256 streams, about 15.1 tok/s per stream, and the 2881 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3857.9, 3853.1, 3849.7 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 2437.1 tok/s is the aggregate decode rate across all 128 streams, about 19.0 tok/s per stream, and the 2542 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 2441.9, 2437.1, 2433.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 504.1 tok/s is the aggregate decode rate across all 256 streams, about 2.0 tok/s per stream, and the 12968 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 503.9, 504.1, 504.1 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 239 tok/s is the aggregate decode rate across all 256 streams, about 0.9 tok/s per stream, and the 103016 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 239.3, 239, 238.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-if8-tp2-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3808.9 tok/s is the aggregate decode rate across all 256 streams, about 14.9 tok/s per stream, and the 3247 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3814.2, 3808.9, 3800.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 2341.3 tok/s is the aggregate decode rate across all 192 streams, about 12.2 tok/s per stream, and the 3377 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 2342.3, 2341.3, 2338.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2611 tok/s is the aggregate decode rate across all 256 streams, about 10.2 tok/s per stream, and the 4960 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2611.5, 2611, 2610.6 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1116.8 tok/s is the aggregate decode rate across all 256 streams, about 4.4 tok/s per stream, and the 17649 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1117.1, 1116.7, 1116.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 841.5 tok/s is the aggregate decode rate across all 256 streams, about 3.3 tok/s per stream, and the 24423 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 841.5, 841.5, 841.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-if8-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1455.1 tok/s is the aggregate decode rate across all 256 streams, about 5.7 tok/s per stream, and the 12043 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1455, 1455.1, 1455.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 387 tok/s is the aggregate decode rate across all 256 streams, about 1.5 tok/s per stream, and the 61360 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 386.7, 388.1, 387 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-u-tp4-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1584.3 tok/s is the aggregate decode rate across all 128 streams, about 12.4 tok/s per stream, and the 4284 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1584.3, 1582.8, 1589.1 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3632.6 tok/s is the aggregate decode rate across all 256 streams, about 14.2 tok/s per stream, and the 3372 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3634.2, 3632.6, 3624.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 2152.3 tok/s is the aggregate decode rate across all 192 streams, about 11.2 tok/s per stream, and the 3385 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 1525.3, 2152.7, 2152.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2506.3 tok/s is the aggregate decode rate across all 256 streams, about 9.8 tok/s per stream, and the 5013 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2507, 2506.2, 2506.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1496.9 tok/s is the aggregate decode rate across all 128 streams, about 11.7 tok/s per stream, and the 4067 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1506.9, 1496.9, 1496.6 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3729.4 tok/s is the aggregate decode rate across all 256 streams, about 14.6 tok/s per stream, and the 2732 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3739.2, 3729.4, 3724.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2727 tok/s is the aggregate decode rate across all 256 streams, about 10.7 tok/s per stream, and the 3535 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2730.4, 2727, 2724 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1621.2 tok/s is the aggregate decode rate across all 128 streams, about 12.7 tok/s per stream, and the 2934 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1634.5, 1615.8, 1621.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3670.4 tok/s is the aggregate decode rate across all 256 streams, about 14.3 tok/s per stream, and the 2597 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3675.6, 3667.6, 3670.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2673.7 tok/s is the aggregate decode rate across all 256 streams, about 10.4 tok/s per stream, and the 3295 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2672, 2673.7, 2677.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-if8-tp2-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3386.7 tok/s is the aggregate decode rate across all 256 streams, about 13.2 tok/s per stream, and the 2791 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3383.2, 3387.5, 3386.7 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-u-tp4-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1819.4 tok/s is the aggregate decode rate across all 256 streams, about 7.1 tok/s per stream, and the 3713 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1814.1, 1819.4, 1820.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g26-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 5331.7 tok/s is the aggregate decode rate across all 256 streams, about 20.8 tok/s per stream, and the 1934 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 5330.9, 5331.7, 5336.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 4048.3 tok/s is the aggregate decode rate across all 192 streams, about 21.1 tok/s per stream, and the 1313 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 4080.9, 4048.3, 2870.5 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3853.1 tok/s is the aggregate decode rate across all 256 streams, about 15.1 tok/s per stream, and the 2881 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3857.9, 3853.1, 3849.7 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 2437.1 tok/s is the aggregate decode rate across all 128 streams, about 19.0 tok/s per stream, and the 2542 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (296 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 2441.9, 2437.1, 2433.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config q34-u-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 504.1 tok/s is the aggregate decode rate across all 256 streams, about 2.0 tok/s per stream, and the 12968 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 503.9, 504.1, 504.1 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 239 tok/s is the aggregate decode rate across all 256 streams, about 0.9 tok/s per stream, and the 103016 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 239.3, 239, 238.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-if8-tp2-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3808.9 tok/s is the aggregate decode rate across all 256 streams, about 14.9 tok/s per stream, and the 3247 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3814.2, 3808.9, 3800.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 2341.3 tok/s is the aggregate decode rate across all 192 streams, about 12.2 tok/s per stream, and the 3377 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 2342.3, 2341.3, 2338.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2611 tok/s is the aggregate decode rate across all 256 streams, about 10.2 tok/s per stream, and the 4960 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2611.5, 2611, 2610.6 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1116.8 tok/s is the aggregate decode rate across all 256 streams, about 4.4 tok/s per stream, and the 17649 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1117.1, 1116.7, 1116.8 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 841.5 tok/s is the aggregate decode rate across all 256 streams, about 3.3 tok/s per stream, and the 24423 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 841.5, 841.5, 841.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-if8-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1455.1 tok/s is the aggregate decode rate across all 256 streams, about 5.7 tok/s per stream, and the 12043 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (322 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1455, 1455.1, 1455.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config muse-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 387 tok/s is the aggregate decode rate across all 256 streams, about 1.5 tok/s per stream, and the 61360 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 386.7, 388.1, 387 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g31-u-tp4-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1584.3 tok/s is the aggregate decode rate across all 128 streams, about 12.4 tok/s per stream, and the 4284 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1584.3, 1582.8, 1589.1 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-if8-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3632.6 tok/s is the aggregate decode rate across all 256 streams, about 14.2 tok/s per stream, and the 3372 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3634.2, 3632.6, 3624.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 192 requests sent at once (batch 192, lmx --concurrency 192); 2152.3 tok/s is the aggregate decode rate across all 192 streams, about 11.2 tok/s per stream, and the 3385 ms time to first token is under that load. Setup: KASA B65 rig, 3 x Intel Arc Pro B65, 3 engine replicas (data parallel), 1 card each; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 64 per replica, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 192: 1525.3, 2152.7, 2152.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp1dp3-m0-c192, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2506.3 tok/s is the aggregate decode rate across all 256 streams, about 9.8 tok/s per stream, and the 5013 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2507, 2506.2, 2506.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1496.9 tok/s is the aggregate decode rate across all 128 streams, about 11.7 tok/s per stream, and the 4067 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1506.9, 1496.9, 1496.6 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config orn9-u-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3729.4 tok/s is the aggregate decode rate across all 256 streams, about 14.6 tok/s per stream, and the 2732 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3739.2, 3729.4, 3724.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2727 tok/s is the aggregate decode rate across all 256 streams, about 10.7 tok/s per stream, and the 3535 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2730.4, 2727, 2724 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp2dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 128 requests sent at once (batch 128, lmx --concurrency 128); 1621.2 tok/s is the aggregate decode rate across all 128 streams, about 12.7 tok/s per stream, and the 2934 ms time to first token is under that load. Setup: KASA B65 rig, 1 x Intel Arc Pro B65, one card; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 128, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 128: 1634.5, 1615.8, 1621.2 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-iq4-tp1-m0-c128, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3670.4 tok/s is the aggregate decode rate across all 256 streams, about 14.3 tok/s per stream, and the 2597 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3675.6, 3667.6, 3670.4 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 2673.7 tok/s is the aggregate decode rate across all 256 streams, about 10.4 tok/s per stream, and the 3295 ms time to first token is under that load. Setup: KASA B65 rig, 2 x Intel Arc Pro B65, tensor parallel across 2 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 2672, 2673.7, 2677.3 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-if8-tp2-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 3386.7 tok/s is the aggregate decode rate across all 256 streams, about 13.2 tok/s per stream, and the 2791 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.32.0rc1.dev100+g77154ca61 (vllm/vllm-openai-xpu:nightly-77154ca6116ae34cbfe314beef1016bde9b63989); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 3383.2, 3387.5, 3386.7 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config ornb-u-tp4-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
CONCURRENCY TEST, NOT A SINGLE-USER RESULT. 256 requests sent at once (batch 256, lmx --concurrency 256); 1819.4 tok/s is the aggregate decode rate across all 256 streams, about 7.1 tok/s per stream, and the 3713 ms time to first token is under that load. Setup: KASA B65 rig, 4 x Intel Arc Pro B65, tensor parallel across 4 cards; vLLM 0.31.0+xpu.llmscaler (intel/llm-scaler-vllm:0.31.0-b1-experimental); max_num_seqs 256, max_model_len 4096; speculative decoding off. Each request: LocalMaxxing's canonical reasoning-v1 prompt (304 tokens) with a unique nonce, 256 output tokens, temperature 0. One discarded warm-up batch, then 3 measured batches of 256: 1814.1, 1819.4, 1820.9 tok/s; this is the median. Not eligible for the Verified badge, which requires batch 1. Config g26-if8-tp4dp1-m0-c256, kasa-testing campaign 2026-10-15-b65-localmaxxing-models.
