Vibeleaderboard
← Benchmark guide

Model results

SWE-bench Live

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

← All evaluation groups

SWE-bench Live

Source
SWE-bench Live (reviewed publisher results)
Version
java-0605
Measurement date
2026-08-12
Metric
% · Higher is better
Evaluation scope
java split; 45/109 resolved; system Slingshot-v3.1.0 + GPT-5.5 (Medium); submission evidence https://github.com/SWE-bench-Live/submission/tree/main/submissions/multilang/java/slingshot-agent/20260812-sapient-slingshot-gpt-5.5; publisher verified=False

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

  1. GPT-5.5

    openai/gpt-5.5-20260423

    41.284404%

SWE-bench Live model results | VibeLeaderboard