Model results

BigCodeBench

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Official source

← All evaluation groups

BigCodeBench

Source: BigCodeBench (reviewed publisher results)
Version: full
Measurement date: Not reported
Metric: % · Higher is better
Evaluation scope: full; complete; pass@1; prompted=True; prefill=False; result date not supplied; source captured 2026-09-10

Exact score ties share a position. Positions do not establish statistical significance. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

#1DeepSeek V3
deepseek/deepseek-chat-v3
62.2%
View modelEvidence independent
#2Llama 4 Maverick
meta/llama-4-maverick-17b-128e-instruct
61.4%
View modelEvidence independent
#3GPT-4o (2024-11-20)
openai/gpt-4o-2024-11-20
58.9%
View modelEvidence independent
#4Claude 3 Haiku
anthropic/claude-3-haiku
50.1%
View modelEvidence independent
#5Llama 4 Scout
meta/llama-4-scout-17b-16e-instruct
43.1%
View modelEvidence independent