Get started Leaderboard Decode calculator Models Hardware Benchmarks Marketplace Rentals Pro API Docs

Language

RTX 3090 + RTX 4090 + RTX 5090 + RTX 5090 (4x)

All approved runs for this hardware, sortable to find fastest model results.

Speed Test Results

#	Model	Hardware	Engine	Depth	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB