Meta-Llama-3.1-70B-Instruct-AWQ-INT4 (70B) — 259.2 tok/s top speed | LocalMaxxing

Primeiros passos Ranking Decode calculator Modelos Organizations Reports Hardware Avaliações comparativas Marketplace Aluguéis Pro Docs da API

Idioma

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

Community leaderboard

Speed test results

Compare real runs across hardware, engines, contexts, and quantizations.

Enviar teste de velocidade

Observed performance

Run snapshot

All runs matching the filters below.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs

#	Hardware	Engine	Profundidade	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Meta-Llama-3.1-70B-Instruct-AWQ-INT4 (70B) — 259.2 tok/s top speed | LocalMaxxing