NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16 (9B) — local LLM speed tests | LocalMaxxing

Bắt đầu Bảng xếp hạng Decode calculator Mô hình Organizations Reports Matrix runs Phần cứng Đánh giá chuẩn Chợ Cho thuê Pro Tài liệu API

Ngôn ngữ

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Gửi kiểm tra tốc độ

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Phần cứng	Engine	Độ sâu	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16 (9B) — local LLM speed tests | LocalMaxxing