AA-Omniscience regresses 10 points from Qwen3.7 Max (+14 to +4), reversing its p
Source
ArtificialAnlys
Author
ArtificialAnlys
Published
Terms in this piece · Glossary
hallucination — When a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Why it matters
Anyone considering Qwen3.8 Max in an AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → loop needs to know its hallucinationWhen a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.Full definition → rate nearly doubled while accuracy stayed flat. A model that stopped abstaining is materially riskier in unattended pipelines than its headline index score suggests.
Transcript
AA-Omniscience regresses 10 points from Qwen3.7 Max (+14 to +4), reversing its predecessor's abstention gains. Accuracy is effectively flat at ~31% while the hallucination rate rises from 23% to 40%, meaning Qwen3.8 Max attempts more questions it cannot answer rather than https://t.co/UClHxJwHKd
postQwen3.8 Max costs $1.14 per Intelligence Index task, more than double Qwen3.7 Ma
postQwen3.8 Max scores 1739 Elo on GDPval-AA, ahead of Kimi K3 (1685), effectively t
postAlibaba's Qwen3.8 Max scores 56 on the Artificial Analysis Intelligence Index at
postOnly two labs occupy the Time per Task Pareto frontier: all frontier models unde