Get startedLeaderboardDecode calculatorModelsOrganizationsReportsMatrix runsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Actual Computer — Every computer, one endpoint

Observed performance

Run snapshot

All runs matching the filters below.
Fastest run
Median speed
Memory ceiling
Slowest run
Measured runs
NVIDIA-Nemotron-Nano-12B-v2-AWQ-4bit — 115.1 tok/s on CMP 170HX · 64 GB | LocalMaxxing