SWE-bench
swebench.com- Category
- Developer Tools
- Type
- TOOL
- GitHub
- 5.5k stars
- Added
- Jul 31, 2026
About
Evaluates whether language-model agents can resolve real GitHub issues in production codebases, with official leaderboards including SWE-bench Verified.
Why it made the leaderboard
Benchmark results are decision inputs for choosing models and agent harnesses; follow the methodology and current leaderboard, not a single headline score.
Tags
benchmarkcoding agentssoftware engineeringevaluation
Tech Stack
Python
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.