Get startedLeaderboardDecode calculatorModelsOrganizationsReportsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Actual Computer — Every computer, one endpoint

Observed performance

Run snapshot

All runs matching the filters below.
Fastest run
Median speed
Memory ceiling
Slowest run
Measured runs
Qwen2.5-Coder-7B-Instruct — 93.0 tok/s on RTX 2080 · 8 GB | LocalMaxxing