Model results
EvalPlus
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Evaluation groups
Open a group to see its exact protocol and scores. Different configurations remain separate.
Model rankings
Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.
- EvalPlusmbpp+-v0.2.0-399
EvalPlus (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 42…
EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied
- EvalPlusmbpp-evalplus-v0.2.0-399
EvalPlus (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks fro…
EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied
- EvalPlushumaneval+-v0.1.10
EvalPlus (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=T…
EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=True; result date not supplied
Other reported results
These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.
- Ternary Bonsai 2 27Bunversioned
HumanEval+ · PrismML model card (vendor-reported)
Single-model result · Positions withheld
Measurement date 2026-09-17
Scope · Vendor-reported; thinking mode; EvalScope + vLLM on NVIDIA H100; temperature 1.0, top_p 0.95, top_k …
Vendor-reported; thinking mode; EvalScope + vLLM on NVIDIA H100; temperature 1.0, top_p 0.95, top_k 20; result date not stated by the publisher, dated to the model-card publication; same-run FP16 Qwen3.8-27B reference: 93.29
- Ternary Bonsai 2 27Bunversioned
MBPP+ · PrismML model card (vendor-reported)
Single-model result · Positions withheld
Measurement date 2026-09-17
Scope · Vendor-reported; thinking mode; EvalScope + vLLM on NVIDIA H100; temperature 1.0, top_p 0.95, top_k …
Vendor-reported; thinking mode; EvalScope + vLLM on NVIDIA H100; temperature 1.0, top_p 0.95, top_k 20; result date not stated by the publisher, dated to the model-card publication; same-run FP16 Qwen3.8-27B reference: 83.86
- GPT-4o (2024-08-06)mbpp+-v0.2.0-399
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 42…
EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o (Aug 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o-mini (2024-07-18)mbpp+-v0.2.0-399
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 42…
EvalPlus harness; mbpp+; MBPP+ v0.2.0 extended tests; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o Mini (July 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o (2024-08-06)mbpp-evalplus-v0.2.0-399
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks fro…
EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o (Aug 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o-mini (2024-07-18)mbpp-evalplus-v0.2.0-399
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks fro…
EvalPlus harness; mbpp; MBPP original tests in the MBPP+ v0.2.0 dataset; 399 hand-verified tasks from MBPP-sanitized 427; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o Mini (July 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o (2024-08-06)humaneval+-v0.1.10
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=T…
EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o (Aug 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence
- GPT-4o-mini (2024-07-18)humaneval+-v0.1.10
EvalPlus · EvalPlus (reviewed publisher results)
Single-model result · Positions withheld
Measurement date not reported
Scope · EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=T…
EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=True; result date not supplied; source identity GPT 4o Mini (July 2024); source supplies only a model month; exact dated backend unverified; historical model mapping retained pending execution evidence