The Brief
New briefs daily around 7 AM Eastern
Artificial Analysis Index v5 goes 60% private; Opus 5.5 leads at 58
Most of the test sets are now private, and new tasks grade mergeable code and terminal science work, so rankings are harder to game. The open-weights gap widened to 12 points, and cost per task now spans more than 13x across models.
- 01Read
Cognition's FrontierCode 2.0 tops out at 45% on underspecified tasks
Models that top DeepSWE land mid-pack here, where prompts leave gaps and graders ask whether a maintainer would merge the change. A high DeepSWE rank alone says little about handling vague real tickets, and cost per task is reported beside each score.
- 02Read
Ant Ling open-sources Ling-3.1-flash-1019, a 560B MIT-licensed model
Artificial Analysis scores it 44, up from 41, but it spends 145k output tokens and $1.49 per task, about 40% more output than before. Its low per-token price does not carry through to the bill, so cost per task is the figure that decides its value.
- 03Watch
Google DeepMind unveils Genie 4, a real-time world model run by Gemini
Gemini turns plain-language requests into actions, plans events and tracks scene state while the world renders in real time, so an LLM acts as the director of a simulator. Access, pricing and benchmarks are not stated, so the demo is the only evidence so far.
- 04Read
LangChain open-sources Content Studio, its Slack design agent
It ships cost data and a forkable repo for a long-running multi-agent harness that enforces brand rules with code gates and runs subagents asynchronously. It deletes workaround rules as models improve, so the harness gets simpler over time instead of piling up patches.
- 05Read
Channel3 lifts product categorization to 97.2% by reranking 30 picks
Accuracy rose from 81.9% at similar cost, while walking the taxonomy top-down with beam search failed. Classifying into a large taxonomy is a common agent pipeline step, so this gain comes from changing the pipeline shape, not from paying for a bigger model.
A dated brief from the vibe-coding frontier. Today’s Intel.