Get startedLeaderboardDecode calculatorModelsReportsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Total runs
Highest
Best memory ceiling
Median
Lowest
Llama-3.1-8B-Instruct — 76.0 tok/s on RTX 3060 · 12 GB | Localmaxxing