Model results

Aider Polyglot Benchmark

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Official source

← All evaluation groups

Aider Polyglot Benchmark

Source: Aider via Epoch AI
Version: polyglot-225
Measurement date: Not reported
Metric: % · Higher is better
Evaluation scope: Edit format whole · result date not supplied

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

Qwen2.5 Coder 32B Instruct
qwen/qwen-2.5-coder-32b-instruct
16.4%
View modelEvidence aggregated
Llama 4 Maverick
meta/llama-4-maverick-17b-128e-instruct
15.6%
View modelEvidence aggregated
Command A
cohere/command-a-03-2025
12%
View modelEvidence aggregated
GPT-4.1 Nano
openai/gpt-4.1-nano-2025-04-14
8.9%
View modelEvidence aggregated
Gemma 3 27B
google/gemma-3-27b-it
4.9%
View modelEvidence aggregated
GPT-4o-mini (2024-07-18)
openai/gpt-4o-mini-2024-07-18
3.6%
View modelEvidence aggregated