“A Staff Engineer Collaborator” | Notion’s First Look at GPT-6 Astra
Source
youtube.com
Author
OpenAI
Date
Why it matters
Rewriting earlier messages in an AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition →'s history changes the prompt prefix and breaks prompt cachingReusing the model's processed form of a repeated prompt prefix so subsequent calls skip re-reading it, cutting cost and latency substantially.Full definition →, while everything still appears to work. Audit your agent for history mutation if costs and latency creep up.
Terms in this piece · Glossary
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
prompt caching — Reusing the model's processed form of a repeated prompt prefix so subsequent calls skip re-reading it, cutting cost and latency substantially.
