Vibeleaderboard
← Benchmark guide

Model results

EvalPlus

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

← All evaluation groups

EvalPlus

Source
EvalPlus (reviewed publisher results)
Version
humaneval+-v0.1.10
Measurement date
Not reported
Metric
% · Higher is better
Evaluation scope
EvalPlus harness; humaneval+; HumanEval+ v0.1.10 extended tests; greedy decoding; pass@1; prompted=True; result date not supplied

Exact score ties share a position. Positions do not establish statistical significance. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

  1. #1Qwen2.5 Coder 32B Instruct

    qwen/qwen-2.5-coder-32b-instruct

    87.2%

  2. #2DeepSeek V3

    deepseek/deepseek-chat-v3

    86.6%

  3. #3Mixtral 8x22B Instruct

    mistralai/mixtral-8x22b-instruct

    72%

  4. #4Claude 3 Haiku

    anthropic/claude-3-haiku

    68.9%

  5. #5Llama 3.1 8B Instruct

    meta/llama-3.1-8b-instruct

    62.8%

EvalPlus model results | VibeLeaderboard