Llama-2-7b (7B) — 110.1 tok/s top speed | Localmaxxing

Erste Schritte Leaderboard Modelle Hardware Benchmarks Marktplatz Vermietungen Pro API-Doku

Sprache

Total runs

Highest

Median

Lowest

Total runs

Highest

Median

Lowest

Speed Test Results

Submit benchmark

#	Hardware	Engine	Tiefe	tok/s out	Prefill	tok/s total	TTFT ms	VRAM GB

Llama-2-7b (7B) — 110.1 tok/s top speed | Localmaxxing