Muse Spark 1.2 continues Meta's AA-Omniscience pattern: the score rose from 18 t
Source
ArtificialAnlys
Author
ArtificialAnlys
Published
Terms in this piece · Glossary
hallucination — When a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Why it matters
Knowing that a model's honesty score improved by answering less often rather than knowing more changes how you'd deploy it in retrieval or AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → loops where abstention costs you a step.
Transcript
Muse Spark 1.2 continues Meta's AA-Omniscience pattern: the score rose from 18 to 22, driven by abstention for the second consecutive release. The hallucination rate fell 10 points (38% to 28%) as the attempt rate dropped to 67%, while accuracy slipped from 41% to 38%. Heavy https://t.co/IXjZRsKpyT
postQwen3.8 Max costs $1.14 per Intelligence Index task, more than double Qwen3.7 Ma
postQwen3.8 Max scores 1739 Elo on GDPval-AA, ahead of Kimi K3 (1685), effectively t
postAlibaba's Qwen3.8 Max scores 56 on the Artificial Analysis Intelligence Index at
postAA-Omniscience regresses 10 points from Qwen3.7 Max (+14 to +4), reversing its p
