Artificial Analysis

Artificial Analysis puts Fable 5.1 at 66 on its Intelligence Index, the highest it has measured, with 59.1% on HLE and 91.4% on Terminal-Bench v2.1. Output token use of about 1.7x Fable 5 pushes cost per task to $3.76 even after the cache read cut saves roughly $1.40.

Artificial Analysis scores GLM-5.3-Flash at 57 on its Intelligence Index, three points behind GLM-5.3 at ~7.5x lower cost per task, priced at $0.15/$0.50 per 1M tokens with an 80% cached-input discount. It burns 149M output tokens per index run and hallucinates at 28% on AA-Omniscience.

Artificial Analysis scores Meta's Muse Spark 1.2 at 54 on its Intelligence Index, a large agentic-work improvement that ties Meta with SpaceXAI for third place.

Artificial Analysis scores Alibaba's 2.4T-parameter Qwen3.8 Max at 56 on its Intelligence Index at $1.14 per task, still a point behind open-weights leader Kimi K3 at 25% lower cost.

Artificial Analysis scores Gemini 3.7 Flash at 56 on its Intelligence Index, four points above 3.6 Flash, with an average time per task 40% faster than GPT-5.6 Terra, placing it on the intelligence-versus-speed Pareto frontier.

A new benchmark from Artificial Analysis measures how much of an open-weights model's original accuracy is retained by each serverless API provider hosting it, revealing tradeoffs between speed, cost, and fidelity. Initial coverage includes GLM-5.2, gpt-oss-120b, and DeepSeek V4 Pro, with Kimi K3 coverage planned.

Artificial Analysis scores DeepSeek V4 Pro 0813 at 53 on its Intelligence Index, eight points above April's version but with a 3.6x price rise, leaving it barely ahead of the cheaper V4 Flash and still behind Kimi K3 among open-weights models.

Artificial Analysis ships Intelligence Index v4.1.1, upgrading its grader models and adopting the latest τ³-Banking version.

Muse Glimmer scores 35 on the Artificial Analysis Intelligence Index, 21 points above Llama 4 Maverick and Meta's first open-weights release in 16 months, sitting alongside Kimi K2.5 and just behind Qwen3.6 27B.

DeepSeek V4.1 Flash, a 552B causal Encoder-Decoder model with only 8B/16B active parameters, beats the 1.6T-parameter V4 Pro on Artificial Analysis's Intelligence Index while costing about 4x less per token.

A new index scores seven search API providers on agent task quality, cost and speed, holding model and harness fixed and averaging three benchmarks covering broad research, multi-hop browsing and factual recall.

Artificial Analysis's Coding Agent Index v1.4 now zeroes any Terminal-Bench v2.1 pass identified as reward hacking — fetching published solutions instead of doing the work. Because the tasks run with open internet and never forbid lookup, rates differ sharply between agents and between models.

Artificial Analysis and Liquid AI publish phone-scale rankings: on an iPhone 17 Pro, Nanbeige4.2-3B and LFM2.5-2.6B tie at 63 across BFCL, IFBench, GPQA Diamond, MATH-500 and AA-Omniscience, while generation time spans 30x and peak memory 19x across the field.

Artificial Analysis scores Nemotron 3.5 Lightning at 24 on its Intelligence Index, matching gpt-oss-120b at about a quarter of the total parameters, with 31.6B total and 3.6B active on a hybrid Mamba-Transformer architecture.

OpenAI's new full-duplex speech-to-speech model GPT-Live-1 tops Artificial Analysis' Speech-to-Speech Index at 81.5, ahead of Grok Voice Think Fast 2.0, by delegating reasoning and tool use to a separately configured backend text model.

fal post-trained MiniMax H3 into H3 Max, which now leads Artificial Analysis' image-to-video-with-audio board and sits third in text-to-video. It produces 5–15 second clips with native audio up to 768p at $0.04 per second, under the base H3 endpoint, with weights promised.

Grok 4.6 makes large gains on AA-Briefcase, a private long-horizon agentic knowledge-work benchmark, landing neck and neck with Claude Fable 5 on overlapping confidence intervals while costing substantially less.

Artificial Analysis launches AA-AnalystAgent, an agentic benchmark on real spreadsheets and documents requiring models to interpret sources, judge which caveats apply and settle on a methodology. Claude Opus 5 leads at 54%, ahead of GPT-5.5 at 50%.

Artificial Analysis puts Cartesia's Sonic 3.6 at number one on both the Provider Voice and Controlled Voice speech arenas, reporting Elo scores and appearance counts alongside per-character pricing and generation speed against ElevenLabs, Speechify and Alibaba entries.

BreezeBlue's Breeze TTS 2 takes the top open-weights slot in Artificial Analysis's Provider Voices arena at 1,215 Elo, 90 ahead of Fish Audio S2 Pro, covering 50 languages with prompt-generated voices — while running 45 chars/sec against Fish's 102 and costing $34 per 1M characters hosted.

Artificial Analysis places four Korean labs above 30 on its Intelligence Index. Motif 3 (314B total, 13B active, open weights) scores 47 and Upstage's Solar Pro 4 scores 42 — the top-scoring models developed outside the US and China — with SK Telecom and LG AI Research following on open weights.

Muse Voice Transcribe from Meta Superintelligence Labs reaches 3.1% WER at 0.16s after end of speech, ahead of Cartesia Ink-2 and ElevenLabs Scribe v2 Realtime, for $0.18 per audio hour. It works on 80ms chunks, covers 70 plus languages and handles hour-plus audio without post-processing.

Artificial Analysis finds only two labs on the intelligence-versus-speed Pareto frontier: every frontier model finishing under two minutes is OpenAI's, and four of the six slower ones are Anthropic's.

Artificial Analysis added measured cache hit rates and per-provider Cost per Task for open-weights models. GLM-5.3 (max) varies about 9x across providers, driven mostly by cached-input pricing, which matters because agent loops resend most of their context each turn.