入门指南排行榜Decode calculator模型OrganizationsReportsMatrix runs硬件基准评测市场租用ProAPI文档
语言
Actual Computer — Every computer, one endpoint

Matrix runs

A matrix run measures prompt reading (prefill) and generation (decode) speed in one go, across several context lengths and numbers of simultaneous requests. Run one with lmx speed-test matrix run.

Clear

Matching runs 693

Submitted by @keennay. Newest first. Page 15 of 28.
  • MiniMax-M2.5H200 SXM 141GB ×4 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    3,962.4 tok/s
    Peak prefill
    32.9K tok/s
  • MiniMax-M2.7H200 SXM 141GB ×4 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    1,264.3 tok/s
    Peak prefill
    35.1K tok/s
  • MiniMax-M3-MXFP8H200 SXM 141GB ×8 · vllm 0.29.0 · MXFP88 contexts × 8 concurrency levels
    Peak decode
    629.0 tok/s
    Peak prefill
    18.8K tok/s
  • MiniMax-M3H200 SXM 141GB ×8 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    181.2 tok/s
    Peak prefill
    26.9K tok/s
  • Step-3.5-FlashH200 SXM 141GB ×4 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    4,673.1 tok/s
    Peak prefill
    35K tok/s
  • Step-3.7-FlashH200 SXM 141GB ×4 · vllm 0.29.0 · BF166 contexts × 8 concurrency levels
    Peak decode
    4,829.4 tok/s
    Peak prefill
    35.5K tok/s
  • Kimi-K2.7-CodeH200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    366.5 tok/s
    Peak prefill
    18.7K tok/s
  • Kimi-K2.6H200 SXM 141GB ×8 · vllm 0.29.0 · INT46 contexts × 8 concurrency levels
    Peak decode
    398.9 tok/s
    Peak prefill
    18.7K tok/s
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP48 contexts × 8 concurrency levels
    Peak decode
    4,782.9 tok/s
    Peak prefill
    17.6K tok/s
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · vllm · NVFP48 contexts × 8 concurrency levels
    Peak decode
    1,798.9 tok/s
    Peak prefill
    14.3K tok/s
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,513.7 tok/s
    Peak prefill
    9,689 tok/s
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · vllm 0.29.0 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,561.6 tok/s
    Peak prefill
    10.2K tok/s
  • GLM-5.3-MXFP4H200 SXM 141GB ×8 · vllm 0.29.0 · MXFP47 contexts × 8 concurrency levels
    Peak decode
    1,459.2 tok/s
    Peak prefill
    8,942 tok/s
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,466.0 tok/s
    Peak prefill
    9,696 tok/s
  • GLM-5.3-NVFP4H200 SXM 141GB ×8 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP47 contexts × 8 concurrency levels
    Peak decode
    1,471.1 tok/s
    Peak prefill
    9,724 tok/s
  • GLM-5.3-Flash-NVFP4H200 SXM 141GB ×4 · sglang 0.5.6.post3.dev10338+g787299797 · NVFP48 contexts × 8 concurrency levels
    Peak decode
    2,480.0 tok/s
    Peak prefill
    16.5K tok/s
  • GLM-5.3H200 SXM 141GB ×8 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    1,056.5 tok/s
    Peak prefill
    11.9K tok/s
  • GLM-5.3H200 SXM 141GB ×8 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    1,203.0 tok/s
    Peak prefill
    11.9K tok/s
  • GLM-5.3H200 SXM 141GB ×8 · vllm 0.29.0 · FP86 contexts × 8 concurrency levels
    Peak decode
    914.6 tok/s
    Peak prefill
    12.1K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.1.dev5+ge77daef89 · BF166 contexts × 8 concurrency levels
    Peak decode
    7,950.5 tok/s
    Peak prefill
    35.5K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.dev1+g50a061f79 · BF166 contexts × 8 concurrency levels
    Peak decode
    5,358.8 tok/s
    Peak prefill
    30.3K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.1.dev5+ge77daef89 · BF166 contexts × 8 concurrency levels
    Peak decode
    7,931.5 tok/s
    Peak prefill
    34.8K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.1.dev5+ge77daef89 · BF166 contexts × 8 concurrency levels
    Peak decode
    6,547.2 tok/s
    Peak prefill
    36.6K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.dev1+g50a061f79 · BF166 contexts × 8 concurrency levels
    Peak decode
    4,373.4 tok/s
    Peak prefill
    31K tok/s
  • Qwen3.8-Flash-NextH200 SXM 141GB ×4 · vllm 0.1.1.dev5+ge77daef89 · BF166 contexts × 8 concurrency levels
    Peak decode
    6,511.0 tok/s
    Peak prefill
    36.7K tok/s