Carnice-9b-W8A16-AWQ (9B) — 114.3 tok/s top speed | Localmaxxing

Get started Leaderboard Models Hardware Evals Marketplace Rentals Pro API Docs

Language

Total runs

Highest

Median

Lowest

Total runs

Highest

Median

Lowest

Benchmark Results

Submit benchmark

#	Hardware	Engine	Depth	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Carnice-9b-W8A16-AWQ (9B) — 114.3 tok/s top speed | Localmaxxing