ModelsLeaderboardEvalsTrainRentalsAPI Docs

MMLU 5-shot

Massive Multitask Language Understanding via EleutherAI lm-evaluation-harness task mmlu, 5-shot, exact-match/accuracy style scoring.

Source
Category: knowledgeRunner: lm-eval-harnessVersion: v1.0Submitted by: banana_baeee

Eval Details

Scoring
Exact Match
Aggregation
Mean
Direction
Higher is better
Tasks
1 task
TaskDatasetWeightShotsMax Tokens
MMLU
mmlu
Not specified1Default

Leaderboard— best run per model

No approved results yet. Submit a run via the API.