LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
context compaction — Summarizing an agent's earlier conversation to free room in the context window so a long session can keep going.
Why it matters
A diffusion LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → fast enough to replace supporting model calls (context compactionSummarizing an agent's earlier conversation to free room in the context window so a long session can keep going.Full definition →, tool-search, routing) in AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → pipelines, cutting latency and cost where response speed, not raw capability, is the bottleneck.