Vibeleaderboard
← All Intel
Intel / article

Recent Open Weights Model Launches

Source
artificialanalysis.ai
Author
Artificial Analysis articles
Date

Context

Artificial Analysis reports that the three highest-scoring models, whose trained weights anyone can download and run, were all released in the week before this April 30 roundup (artificialanalysis.ai). Moonshot AI's Kimi K2.6 and Xiaomi's MiMo V2.5 Pro tie at 54 on its Intelligence Index, with DeepSeek's V4 Pro at 52. The leading proprietary models are OpenAI's GPT-5.5 at 60, then Google's Gemini 3.1 Pro Preview and Anthropic's Claude Opus 4.7 at 57. That leaves the best open models 3 to 6 points behind. A year earlier the top open model, DeepSeek V3 0324, scored 22, about 13 points below Claude 3.7 Sonnet at 35.

The single index number hides an uneven picture. On HLE (Humanity's Last Exam) the three open models score 34 to 36%, against 44% for GPT-5.5 and 45% for Gemini 3.1 Pro Preview. On CritPt, a research-level physics test, they score 4 to 12% against 27% for GPT-5.5, and on TerminalBench Hard, which tests agentic coding and terminal use, 43 to 46% against 61% for GPT-5.5 and 54% for Gemini. AA-Omniscience, which measures knowledge while penalizing hallucinated answers, shows a large gap too: DeepSeek V4 Pro scores -10, MiMo V2.5 Pro +4 and Kimi K2.6 +6, while GPT-5.5 scores +20, Opus 4.7 +26 and Gemini 3.1 Pro Preview +33.

Where the open models win is price. All three are models with more than a trillion parameters, a design that uses only part of the model for each (Kimi K2.6 activates 32B of its 1T), and all carry permissive licenses. Nine of the 13 models on Artificial Analysis's intelligence-versus-price Pareto frontier, the set of models that no other model beats on both score and price, are open weights, and it says the top three offer intelligence comparable to leading proprietary models at between half and one-sixth of the price. All of the top 10 open weights models come from China-based labs; the highest-ranked from elsewhere are Gemma 4 31B and NVIDIA Nemotron 3 Super.

Key takeaways · AI-distilled
  • Kimi K2.6 and MiMo V2.5 Pro tie at 54 on the Intelligence Index with DeepSeek V4 Pro at 52, within 3 to 6 points of GPT-5.5 (xhigh) at 60. A year earlier, the top open model scored 22, about 13 points behind the proprietary leader.
  • The gap stays wide on the hardest : the top open models score 34-36% on HLE versus 44-45% for GPT-5.5 and Gemini 3.1 Pro Preview, and 43-46% on TerminalBench Hard versus 61% for GPT-5.5 (xhigh).
  • On AA-Omniscience, DeepSeek V4 Pro scores -10, hallucinating more than MiMo V2.5 Pro (+4) and Kimi K2.6 (+6), while GPT-5.5, Claude Opus 4.7 and Gemini 3.1 Pro Preview score +20, +26 and +33.
  • All top 10 open-weights models come from China-based labs, and 9 of the 13 models on the intelligence-versus-price Pareto frontier are open weights, with comparable intelligence at one-half to one-sixth of the price.
Terms in this piece · Glossary
  • open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
  • mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
  • eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Read the source artificialanalysis.ai
More from Artificial Analysis articles
Recommended reads
Comments

Checking sign-in…

Loading comments…