Qwen3.5-4B-GGUF — 171.6 tok/s on RTX 3090 · 24 GB ×2 | LocalMaxxing

शुरुआत करें लीडरबोर्ड Decode calculator मॉडल Organizations Reports Matrix runs हार्डवेयर बेंचमार्क मार्केटप्लेस रेंटल Pro API दस्तावेज़

भाषा

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

स्पीड टेस्ट सबमिट करें

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	हार्डवेयर	इंजन	गहराई	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Qwen3.5-4B-GGUF — 171.6 tok/s on RTX 3090 · 24 GB ×2 | LocalMaxxing