Vibeleaderboard
← All Intel
Intel / article

Artificial Analysis Intelligence Index V4 1

Source
artificialanalysis.ai
Author
Artificial Analysis articles
Date
Why it matters

The index now scores agentic work and reports cost, time and tokens per task, so model comparisons reflect what an run actually costs. For example, DeepSeek V4 Pro costs $0.04 per task against $1.78 for Opus 4.8.

Key takeaways · AI-distilled
  • Artificial Analysis removed saturated IFBench from Intelligence Index v4.1 in June 2026 while continuing to publish standalone results. A can remain informative without distinguishing the frontier enough for an aggregate ranking.
  • Intelligence Index v4.1 increased the emphasis on agentic work. Its June 2026 weights assigned 20% to GDPval-AA v2, 16% to Terminal-Bench 2.1 and 14% to tau3-Bench Banking.
  • The June 2026 GDPval-AA v2 revision set human performance to 1000 Elo, rotated frontier-model judges and raised the turn limit from 100 to 250. These changes alter how agentic results should be interpreted.
  • Artificial Analysis defined cost, time and per task by dividing total Intelligence Index usage by its task count. Its June 2026 update also began reporting cached inputs, which affect the cost comparison.
Terms in this piece · Glossary
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
Read the source artificialanalysis.ai
More from Artificial Analysis articles
Recommended reads
Comments

Checking sign-in…

Loading comments…