HumanEval 0-shot
OpenAI HumanEval via EleutherAI lm-evaluation-harness task humaneval, 0-shot, pass@k code-generation scoring.
Category: codingRunner: lm-eval-harnessVersion: v1.0Submitted by: banana_baeee
Eval Details
Scoring
Pass At K
Aggregation
Mean
Direction
Higher is better
Tasks
1 task
Leaderboard— best run per model
No approved results yet. Submit a run via the API.