LocalMaxxing
Models
Leaderboard
Evals
Train
Rentals
API
Submit
Models
Leaderboard
Evals
Train
Rentals
API Docs
Language
English
简体中文
繁體中文
日本語
한국어
Total runs
Highest
Median
Lowest
Models
meta-llama
Llama-2-7b
Total runs
Highest
Median
Lowest
Benchmarks
Evals
Benchmark Results
Submit benchmark
Any size
< 3B
3B
7B
13B
30B
70B
110B+
Advanced filters
#
Hardware
Engine · Quant
Ctx
tok/s out
prefill
tok/s total
TTFT ms
VRAM GB
Llama-2-7b (7B) — 110.1 tok/s top speed