Get started Leaderboard Decode calculator Models Hardware Benchmarks Marketplace Rentals Pro API Docs

Language

2x RTX 3090 + RTX 3090 Ti

All approved runs for this hardware, sortable to find fastest model results.

Speed Test Results

#	Model	Hardware	Engine	Depth	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB