Muse Spark 1.2 ranks #5 on GDPval-AA v2, our benchmark of agentic real-world kno
Source
ArtificialAnlys
Author
ArtificialAnlys
Published
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Why it matters
Direct Elo comparison against the models practitioners already run is the fastest way to judge whether a new coding AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → is worth trialing.
Transcript
Muse Spark 1.2 ranks #5 on GDPval-AA v2, our benchmark of agentic real-world knowledge work, at 1631 Elo - behind e.g. Claude Opus 5 (max, 1852), GPT-5.6 Sol (max, 1730), and Kimi K3 (1685), and ahead of e.g. Claude Opus 4.8 (max, 1588). Muse Spark 1.1 scored 1371 at its launch https://t.co/nbaNwsYvKU
postQwen3.8 Max costs $1.14 per Intelligence Index task, more than double Qwen3.7 Ma
postQwen3.8 Max scores 1739 Elo on GDPval-AA, ahead of Kimi K3 (1685), effectively t
postAlibaba's Qwen3.8 Max scores 56 on the Artificial Analysis Intelligence Index at
postAA-Omniscience regresses 10 points from Qwen3.7 Max (+14 to +4), reversing its p
