ModelsLeaderboardEvalsTrainRentalsAPI Docs

DROP

Official

Discrete Reasoning Over Paragraphs. Reading-comprehension benchmark requiring numerical and symbolic reasoning over passages.

Source
Category: reasoningRunner: lm-eval-harnessVersion: v1.0Submitted by: Community

Eval Details

Scoring
F1
Aggregation
Mean
Direction
Higher is better
Tasks
1 task

Default Run Config

Seed: 42FewShot: 3
TaskDatasetWeightShotsMax Tokens
DROP
drop
Not specified13-shot—

Leaderboard— best run per model

No approved results yet. Submit a run via the API.