Get startedLeaderboardDecode calculatorModelsReportsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Total runs
Highest
Best memory ceiling
Median
Lowest
Llama-3.1-8B-Instruct — 134.0 tok/s on RTX 3080 · 12 GB | Localmaxxing