ModelsLeaderboardEvalsTrainRentalsAPI Docs

WinoGrande

Official

Large-scale Winograd schema challenge for commonsense reasoning. Fill-in-the-blank pronoun resolution requiring world knowledge.

Source
Category: reasoningRunner: lm-eval-harnessVersion: v1.0Submitted by: Community

Eval Details

Scoring
Exact Match
Aggregation
Mean
Direction
Higher is better
Tasks
1 task

Default Run Config

Seed: 42FewShot: 5
TaskDatasetWeightShotsMax Tokens
WinoGrande
winogrande
winogrande / winogrande_xl / validation15-shot—

Leaderboard— best run per model

No approved results yet. Submit a run via the API.