Model results
HumanEval
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Evaluation groups
Open a group to see its exact protocol and scores. Different configurations remain separate.
Model rankings
Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.
- HumanEvalhumaneval-evalplus-v0.1.10
HumanEval (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy deco…
EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy decoding; pass@1; prompted=True; result date not supplied
Other reported results
These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.
- GPT-4o (2024-08-06)humaneval-evalplus-v0.1.10
HumanEval · HumanEval (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy deco…
EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o (Aug 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o-mini (2024-07-18)humaneval-evalplus-v0.1.10
HumanEval · HumanEval (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy deco…
EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o Mini (July 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence