Model results

SWE-bench Pro V1

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Official source

SWE-bench_Pro · SWE Bench Pro

Source: Hugging Face eval result
Version: v1
Measurement date: 2026-10-07
Metric: % · Higher is better
Evaluation scope: Registered model evaluation · dataset ScaleAI/SWE-bench_Pro · task SWE_Bench_Pro · Beam 1.0 model card

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

Beam 1.0 501B A23B
reflection/beam-1.0-501b-a23b-20261016
66.1%
View modelEvidence model-card-reported