- Category
- Developer Tools
- Rank
- No. 1322Tools index
Previous survey · No. 1288 ·
- Listed in
- Find AI benchmarks
- Type
- TOOL
- Use case
- Model & Agent Evaluation
- GitHub
- 94 stars
- Latest release
- v0.1.9
- Date
About
Software optimization challenges where agents modify a program's code to make it substantially faster while staying correct. Compare the speedup threshold and evaluation harness alongside the pass rate.
Why it made the leaderboard
Compare the task, benchmark version, harness, and grading method before using model scores to choose a model.
Tags
benchmarkevaluation
Tech Stack
Python
Media
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.