ModelsLeaderboardEvalsTrainRentalsAPI Docs

GSM8K

Official

Grade School Math 8K — 8,500 grade-school math word problems requiring multi-step arithmetic reasoning. Standard benchmark for math reasoning capability.

Source
Category: mathRunner: lm-eval-harnessVersion: v1.0Submitted by: Community

Eval Details

Scoring
Exact Match
Aggregation
Mean
Direction
Higher is better
Tasks
1 task

Default Run Config

Seed: 42FewShot: 5
TaskDatasetWeightShotsMax Tokens
GSM8K
gsm8k
gsm8k / main / test15-shot

Leaderboard— best run per model

No approved results yet. Submit a run via the API.