Models Leaderboard Hardware Evals Train Rentals API Docs

Language

RTX 2080

All approved runs for this hardware, sortable to find fastest model results.

#	Hardware	Engine · Quant	Ctx	tok/s out	prefill	tok/s total	TTFT ms	VRAM GB