[AINews] Claude Opus 5: Fable-level performance at Opus price (half Fable)
Source
Latent Space
Author
Latent Space
Date
Key takeaways · AI-distilled
Epoch scored Opus 5 at 159 on its Capabilities Index against Fable 5's 161, but tied the two at 161 on the software-engineering split. The gap is in general capability, not coding.
Opus 5 landed only about one ECI point above Opus 4.8 while practitioners described it as broadly better, which is the case for the argument that current public benchmarks are saturating and need to get harder.
One evaluator found Opus 5 scoring higher on FrontierCode at medium effort than at high effort, breaking the assumption that more test-time computeSpending more computation when the model answers — thinking longer, trying multiple attempts — to buy accuracy without training a bigger model.Full definition → monotonically helps. If that holds, your effort setting is a deployment decision, not a dial to max out.
Aggregate indices compress coding versus non-coding agent skillA reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.Full definition →, effort scaling, best-of-n gains, tool reliability and cost into one number. Opus 5 shows the cost: the single score hid a model that is stronger at software engineering than the headline implies.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
test-time compute — Spending more computation when the model answers — thinking longer, trying multiple attempts — to buy accuracy without training a bigger model.
agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
Why it matters
Opus 5's positioning against Fable directly affects default model choice, and this unpacks the benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → ambiguity.
Key quotes
“Community response noted the model appears only +1 ECI point vs Opus 4.8 , which some readers considered too small relative to qualitative gains”
“The main criticism is not that Opus 5 is weak, but that benchmarking around it is unstable, underspecified, or misaligned with user impressions”
“For expert readers, the more substantive signal is that even benchmark skeptics are mostly arguing about how much better Opus 5 is , not whether it belongs at the frontier.”
“If more effort hurts on certain distributions, then deployment policy matters almost as much as base model quality.”
“The launch lands amid a broader shift from static chat benchmarks toward agentic evaluations : browser use, tool invocation, parallel task execution, and software engineering loop completion.”
