Artificial Analysis

Artificial Analysis scores Upstage's Solar Pro 4 at 42 on its Intelligence Index, a 27-point jump over Solar Pro 3, alongside Inkling and just behind MiMo-V2.5-Pro, with roughly doubled pricing.

Artificial Analysis clocked Gemma 4 31B at roughly 3,400 tokens/s on a private NVIDIA Groq 3 LPX endpoint, holding that speed from 10k to 100k input tokens across 50 sequential single-concurrency requests. The rack is in full-scale production and enters operation later this year.

Ant Group's Ling 3.0 Flash, 124B total and 5B active parameters under MIT, scores 38 on the Artificial Analysis Intelligence Index, 24 points over its predecessor and on the open-weights Pareto frontier for intelligence versus total parameters.

A new quality-tier image model takes first place on an independent image editing leaderboard and seventh in text to image, at roughly twice the per-image cost of its own mid tier and five times the fast tier.

Artificial Analysis' arena run puts Microsoft's MAI-Image-2.6-Preview first in image editing — ahead of its own 2.5-Pro, Reve 2.1 and GPT Image 2 — and second in text-to-image, leading 5 of 19 category boards including Retail & Ecommerce and Marketing. Available in MAI Playground and Foundry private

Artificial Analysis places Muse Spark 1.2 on the cost-per-task Pareto frontier: six points below Claude Opus 5 at roughly a sixth of the cost, and comparable to Opus 4.8 at a fifth.

MBZUAI's 375B total, 23B active open weights MoE scores 47 on the Intelligence Index, thirty points above its predecessor. It beats MiniMax-M3 on GDPval-AA and tau-Banking but trails on GPQA Diamond and Humanity's Last Exam, and answers only 40% of AA-Omniscience questions.

Artificial Analysis benchmarked Perplexity's Search API at three context sizes inside a fixed harness. Medium scores 80 on its Search Index against 75 for Parallel and Brave, with the lowest inference cost per task ($0.028–$0.034) and ~$0.091 total. Quality plateaus between medium and high while sea

xAI's Grok Voice Transcribe 2.0 replaces its 1.0 speech-to-text model, cutting streaming WER from 3.9% to 2.7% and non-streaming WER to 2.3%, per Artificial Analysis benchmarks, at unchanged API pricing.

Ant Group's Ling 3.0 Tiny scores 25 on the Artificial Analysis Intelligence Index with 7.9B total and 1.3B active parameters, comparable to gpt-oss-120b at 15x fewer total parameters, though it burned 213M output tokens to get there.

Held out medical long context tiers, graded by panel, with Claude Fable 5 in front.

Artificial Analysis puts Agnes 2.5 Pro Beta at 49 on its Intelligence Index, with the Agentic Index leaping 25→44 and τ³-Banking tripling to 36%. Cost of the jump: 50k output tokens per task, and an Omniscience improvement driven by attempting only 45% of questions.

Human run speech model arena that scores preference and whether the tool call landed.

Artificial Analysis rebuilds its Text to Image Arena around 10 real-world use cases and 9 capabilities, from UI mockups to live-action film, with monthly-refreshed human-curated prompts. GPT Image 2 leads everywhere, with Nano Banana 2 the value pick.

Google's two new transcription APIs, measured: 2.6% word error rate non-streaming at roughly 84x realtime for about $5 per 1,000 minutes, and a Live variant at 4.0% WER with first final transcripts 0.40s after speech ends for about $9. Both cover 85+ languages.

Round 2 of Korea's government-backed foundation-model program cut the field to three: Upstage's Solar Open 250B (Intelligence Index 37), SK Telecom's A.X K2 (35), and LG's K-EXAONE 2.0 (31). Each survivor is set to receive roughly 1,000 NVIDIA B200s for six months.

Artificial Analysis has opened Optima, which lets teams run their own tasks as a benchmark and compare models on quality, speed and cost efficiency rather than relying on a general index. A new video walks through building and running one end to end.

Artificial Analysis benchmarked Ant Group's Ling-3.0-flash-VL, a 124B-parameter (5.5B active) open-weights vision-language model, finding it leads comparable models on their Intelligence Index but scores 0% on Terminal-Bench v4.0 and 16% on AutomationBench-AA.

Artificial Analysis on Muse Spark 1.2's cost efficiency: $0.40 per Intelligence Index task, with only Grok 4.5 and GPT-5.6 Sol at medium effort cheaper in its intelligence cluster, the rise from 1.1 driven by token usage rather than pricing.

Artificial Analysis breaks down Muse Spark 1.2's 3-point Index gain: concentrated in agentic evaluations, led by a 260-Elo jump on GDPval-AA v2, with small regressions on SciCode and Humanity's Last Exam.

The same open weights served by different providers do not give you the same product. Self hosting the released weights as a 100 percent reference and scoring each provider endpoint against it with three evaluations puts them between 73 and 100 percent.

Benchmark results place two search providers on the cost-quality frontier for agent tasks, with one scoring 73 at 7.5 cents per task but the slowest completion time, and another reaching 75 for 12 percent more.

Artificial Analysis scores Qwen3.8 Max at 1739 Elo on GDPval-AA, ahead of Kimi K3 and tied with Fable 5 and GPT-5.6 Sol, with the 468-Elo gain partly driven by taking 64 turns per task against its predecessor's 14.

Serving the same model does not mean serving it the same way. Endpoints that underperform the reference generate markedly fewer output tokens per task — the weakest around half — so capped output length and reduced reasoning effort surface directly in token accounting.