Model results

BigCodeBench

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Official source

Evaluation groups

Open a group to see its exact protocol and scores. Different configurations remain separate.

Model rankings

Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.

BigCodeBenchhard
BigCodeBench (reviewed publisher results)
10 models with scores
Measurement date not reported
Scope · hard; complete; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026…
hard; complete; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026-09-10
BigCodeBenchhard
BigCodeBench (reviewed publisher results)
17 models with scores
Measurement date not reported
Scope · hard; complete; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-…
hard; complete; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-09-10
BigCodeBenchhard
BigCodeBench (reviewed publisher results)
10 models with scores
Measurement date not reported
Scope · hard; instruct; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026…
hard; instruct; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026-09-10
BigCodeBenchhard
BigCodeBench (reviewed publisher results)
17 models with scores
Measurement date not reported
Scope · hard; instruct; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-…
hard; instruct; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-09-10
BigCodeBenchfull
BigCodeBench (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · full; complete; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026…
full; complete; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026-09-10
BigCodeBenchfull
BigCodeBench (reviewed publisher results)
15 models with scores
Measurement date not reported
Scope · full; complete; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-…
full; complete; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-09-10
BigCodeBenchfull
BigCodeBench (reviewed publisher results)
5 models with scores
Measurement date not reported
Scope · full; instruct; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026…
full; instruct; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026-09-10
BigCodeBenchfull
BigCodeBench (reviewed publisher results)
15 models with scores
Measurement date not reported
Scope · full; instruct; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-…
full; instruct; pass@1; prompted=True; prefill=True; result date not supplied; source captured 2026-09-10