Llama-2-7b (7B) — 110.1 tok/s top speed | Localmaxxing

Overview Models Leaderboard Hardware Marketplace Evals Train Rentals Pro API Docs

Language

Lucebox Hub campaign banner

Total runs

Highest

Median

Lowest

Total runs

Highest

Median

Lowest

Benchmark Results

Submit benchmark

#	Hardware	Engine	Depth	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Llama-2-7b (7B) — 110.1 tok/s top speed | Localmaxxing