ModelsLeaderboardEvalsTrainRentalsAPI Docs

MATH

Official

Competition math problems spanning algebra, counting, geometry, intermediate algebra, number theory, prealgebra, and precalculus.

Source
Category: mathRunner: lm-eval-harnessVersion: v1.0Submitted by: Community

Eval Details

Scoring
Exact Match
Aggregation
Mean
Direction
Higher is better
Tasks
1 task

Default Run Config

Seed: 42FewShot: 4
TaskDatasetWeightShotsMax Tokens
MATH
hendrycks_math
Not specified14-shot—

Leaderboard— best run per model

No approved results yet. Submit a run via the API.