METR Time Horizons
metr.org- Category
- Developer Tools
- Type
- TOOL
- Date
About
Estimates the length of software tasks a model completes correctly more often than not. Horizons are model estimates from a fixed task suite, so compare the suite version and confidence intervals.
Why it made the leaderboard
Compare the task, benchmark version, harness, and grading method before using model scores to choose a model.
Tags
benchmarkevaluation
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.