Clarifies the difference between constrained competition scores and unconstrained frontier-model scores on ARC-AGI, which matters when comparing cost and performance claims.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
