The Brief

New briefs daily around 7 AM Eastern

Inference internals go public as benchmarks keep deflating the "more effort" reflex

Today's intel converges on a single engineering posture: the expensive default is rarely the right one. Three independent benchmarks argue the point from different angles — medium reasoning effort captures nearly all of Opus 5's bug-fix gains, a three-model open-weight jury grades math proofs about as well as frontier judges at up to 100x less cost, and base LLMs turn out to make better VLM backbones than instruction-tuned ones, predictable in advance from a textual capability score. Underneath that, the serving layer opened up unusually far, with Baseten, Cloudflare, and a deep read of Kimi K3's linear attention all describing the same set of levers — KV cache quantization, disaggregated prefill/decode, cache-aware routing — and the same emerging friction between linear attention and prefix caching. The counterweight is that cheaper and more autonomous does not mean uniformly safe: role steering degrades on 14% of personas regardless of tuning, and multimodal models still fail on raw, unprocessed satellite streams in disaster scenarios.

• 01Method

  Reasoning-effort dials are hitting diminishing returns — Medium captures nearly all of Claude Opus 5's resolve-rate gains, and Opus 5 at XHigh loses on every metric to Grok 4.5, GPT-5.6 Sol, and Fable 5.

  AlphaSignalAI→
• 02Method

  A unanimous three-judge ensemble of open-weight models (GPT-OSS 120B, DeepSeek-V4 Flash, Gemma-4 31B) matches frontier judges on IMO-GradingBench at up to 100x lower cost, making cheap eval pipelines a defensible default.

  Benjamin Grayzel→
• 03Release

  A capability-driven scaling law trained across 150+ VLMs and 34 LLMs predicts multimodal accuracy from a PCA-derived textual capability score — and finds base LLMs outperform instruction-tuned ones as VLM backbones.

  Ziran Li, Qiang Wang, Zhengyu Chen, Shanglin Lei, Borun Chen, Jingang Wang, Xunliang Cai→
• 04Tooling

  Production inference internals got unusually legible in one day: Baseten's walkthrough of cache-aware routing and disaggregated prefill/decode, Cloudflare's KV-cache and weight-compression levers for Kimi and GLM, and a teardown of Kimi K3's KDA linear attention and its awkward interaction with prefix caching in vLLM.

  Latent Space→Cloudflare→Kimbo Chen→
• 05Debate

  Agent memory has no free lunch — AgentMemBench finds external key-value retrieval beats windowing, graph episodic memory, and summarization on long-range recall, but at roughly 17x the memory footprint.

  Ahmed Cherif→
• 06Watch

  Two papers argue against uniform agent configuration: 38 of 275 roles degrade under activation steering at any coefficient, and Obshazard-bench shows MLLMs still fail to reason over raw satellite streams in time-sensitive disaster response.

  Isaac Song, Mohammed Rehan Parwani, Glenn Matlin, Emile Anand, Akhil Theerthala, Arjun Chatterjee, Maria Kostylew, Yonadav G. Shavit, Sebastien Krier, Mark Riedl→Fengxiang Wang, Qiuyang Yu, Yueying Li, Mingshuo Chen, Chengchi Fei, Kaiyi Xu, Lixin Gu, Wangxu Wei, Junchao Gong, Lipeng Ma, Jiong Wang, Fenghua Ling, Wenlong Zhang, Xue Yang, Wenjing Yang, Ben Fei, Long Lan→
• 07Tooling

  The build-vs-adopt question keeps resolving toward open harnesses — Stripe stood up its company-wide agent Kai on Deep Agents in a week, GitHub published measured results for cross-repo agentic doc workflows, and an undocumented path lets Claude Code reach existing Claude Connectors directly.

  LangChain→github→Thariq→Simon Willison→