Get startedLeaderboardDecode calculatorModelsOrganizationsReportsMatrix runsHardwareBenchmarksMarketplaceRentalsProAPI Docs
Language
Actual Computer — Every computer, one endpoint

Observed performance

Run snapshot

All runs matching the filters below.
Fastest run
Median speed
Memory ceiling
Slowest run
Measured runs
Fara1.5-27B-AWQ-W4A16 — 47.2 tok/s on RTX 3090 · 24 GB | LocalMaxxing