Evolution of agentic surfaces — Gagan Bhat & Isabella Kai He, Anthropic
- Source
- youtube.com
- Author
- AI Engineer
- Date
Context
An can start reasoning sooner if its reasoning loop does not have to wait for the environment that runs its tools. The description of this Anthropic session explains an architecture that separates those components, allowing reasoning to begin while the tool container starts. Anthropic's described design also uses a durable session log to resume the reasoning process after a failure, while a failed tool environment can be retried separately. This makes startup and recovery properties of the surrounding software, rather than tasks the model must solve through conversation alone.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
- agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
“Sonnet 4.5 developed what Anthropic's Applied AI team came to call context anxiety: approaching its context window limit, it would wrap work up early and stop with room to spare. They built context resets into the harness to compensate. Then Opus 4.5 shipped without the behavior, and the fix turned into pure overhead, adding latency and discarding cache it should have kept.”
AI Engineer
“a harness encodes assumptions about what the model cannot do on its own, and those assumptions go stale as models improve.”
AI Engineer
“The architectural consequence is decoupling the brain, meaning the agent loop, from the hands, meaning the tool execution environment. Both started in one container, so the model could not begin reasoning until setup finished and either half failing took the whole agent down.”
AI Engineer
“Splitting them lets reasoning start while the container builds in parallel, which they measured at 60% faster time to first token at P50 and over 90% at P95.”
AI Engineer
“That log ends up doing triple duty, providing observability, letting the harness read context slices back in after Claude discards them mid run, and feeding a periodic batch process they call dreaming that rewrites the agent's memory so the next day's sessions start smarter.”
AI Engineer
videoYour KV Cache Can Spot Attacks on Your AI Agents - Ari Azarafrooz, Intrinsec AI
videoWill AI Agents Pretend to Be Human to Get Past a Check? - Maty Bohacek, Stanford
videoThe One Thing Every AI Agent Framework Agrees On - Mislav Ivanda, Daytona
videoAI Writes Code Faster Than Uber Can Merge It - Preetam Dwivedi & Manjari Akella, Uber
videoDecoupling the Brain from the Hands: Claude Managed Agents (Part 1 of 4) — AnthropicAI Engineer
videoHow Anthropic ships the #1 LLM in the World — with Katelyn Lesse and Angela JiangLatent Space
articleHow Anthropic ships the #1 LLM in the World safely: Separating the Brain from the HandsLatent.Space
Checking sign-in…
Loading comments…