Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M (12B) — 265.5 tok/s top speed | LocalMaxxing

Erste Schritte Leaderboard Decode calculator Modelle Organizations Reports Hardware Benchmarks Marktplatz Vermietungen Pro API-Doku

Sprache

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Speedtest einreichen

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Hardware	Engine	Tiefe	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Mellum2-12B-A2.5B-Thinking-GGUF-Q4_K_M (12B) — 265.5 tok/s top speed | LocalMaxxing