gemma-4-12B-it-qat-q4_0-gguf — 71.2 tok/s on RTX 3080 · 10 GB | Localmaxxing

Get started Leaderboard Decode calculator Models Reports Hardware Benchmarks Marketplace Rentals Pro API Docs

Language

Total runs

Highest

Best memory ceiling

Median

Lowest

Total runs

Highest

Best memory ceiling

Median

Lowest

Speed Test Results

Submit benchmark

#	Hardware	Engine	Depth	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

gemma-4-12B-it-qat-q4_0-gguf — 71.2 tok/s on RTX 3080 · 10 GB | Localmaxxing