LocalAI-functioncall-qwen2.5-7b-v0.5-Q4_K_M-GGUF (7B) — 156.5 tok/s top speed | LocalMaxxing

Per iniziare Classifica Decode calculator Modelli Organizations Reports Matrix runs Hardware Valutazioni comparative Marketplace Noleggi Pro Documentazione API

Lingua

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Invia test di velocità

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Hardware	Motore	Profondità	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

LocalAI-functioncall-qwen2.5-7b-v0.5-Q4_K_M-GGUF (7B) — 156.5 tok/s top speed | LocalMaxxing