Get startedLeaderboardDecode calculatorModelsOrganizationsReportsMatrix runsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Actual Computer — Every computer, one endpoint

Observed performance

Run snapshot

All runs matching the filters below.
Fastest run
Median speed
Memory ceiling
Slowest run
Measured runs
Meta-Llama-3-8B-Instruct — 46.7 tok/s on Intel Arc Pro B60 · 48 GB ×2 | LocalMaxxing