Vibeleaderboard
← Benchmark guide

Model results

SWE-rebench

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

← All evaluation groups

SWE-rebench

Source
SWE-rebench (reviewed publisher results)
Version
2026-05-15_2026-07-01
Measurement date
Not reported
Metric
% · Higher is better
Evaluation scope
pass-at-5; 111 problems from 65 repositories; task window 2026-05-15 to 2026-07-01; model track; configuration MiMo V2.5 Pro; tools interaction mode; minimal ReAct framework; pass@5 across five full-benchmark runs; published resolved mean 46.5% with SEM 0.54 percentage points; SEM is standard error of the mean, not a confidence interval or standard deviation; publisher context policy 128K tokens unless the model supports less; developer-recommended default generation settings; declared-model match to Atlas xiaomi/mimo-v2.5-pro-20260422; exact execution backend and API request model identifier unverified; publisher model release date 2026-03-22 is not a measurement date or proof of the Atlas dated execution; publisher does not flag potential contamination for this window; this does not prove decontamination; result date not supplied; source captured 2026-09-10

Fewer than two comparable models. No ranking is assigned. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

  1. MiMo-V2.5-Pro

    xiaomi/mimo-v2.5-pro-20260422

    65.8%

SWE-rebench model results | VibeLeaderboard