GPQA Diamond

Official

Graduate-level Google-proof Q&A benchmark focused on biology, physics, and chemistry. The Diamond split is the highest-quality expert-validated subset.

Source

Category: reasoningRunner: lm-eval-harnessVersion: v1.0Submitted by: Community

Eval Details

Scoring

Exact Match

Aggregation

Mean

Direction

Higher is better

Tasks

1 task

Default Run Config

Seed: 42FewShot: 0

Task	Dataset	Weight	Shots	Max Tokens
GPQA Diamond gpqa_diamond	Not specified	1	0-shot	—

Leaderboard— best run per model

No approved results yet. Submit a run via the API.