Model results
HumanEval
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
HumanEval
- Source
- HumanEval (reviewed publisher results)
- Version
- humaneval-evalplus-v0.1.10
- Measurement date
- Not reported
- Metric
- % · Higher is better
- Evaluation scope
- EvalPlus harness; humaneval; HumanEval original tests in the HumanEval+ v0.1.10 dataset; greedy decoding; pass@1; prompted=True; result date not supplied
Exact score ties share a position. Positions do not establish statistical significance. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
#1Qwen2.5 Coder 32B Instruct
qwen/qwen-2.5-coder-32b-instruct
92.1%
View modelEvidence independent#2DeepSeek V3
deepseek/deepseek-chat-v3
91.5%
View modelEvidence independent#3Claude 3 Haiku
anthropic/claude-3-haiku
76.8%
View modelEvidence independent#4Mixtral 8x22B Instruct
mistralai/mixtral-8x22b-instruct
76.2%
View modelEvidence independent#5Llama 3.1 8B Instruct
meta/llama-3.1-8b-instruct
69.5%
View modelEvidence independent