Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Source
youtube.com
Author
Latent Space
Date
Why it matters
Introduces spending compute between queries to prepare context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition →, offering a way to cut test-time cost and latency for stateful agents.
Terms in this piece · Glossary
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
videoWorld Models & General Intuition: Khosla's largest bet since LLMs & OpenAI
videoExtreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI
videoInside Abridge: The AI Listening to 100 Million Doctor Visits — Abridge's Janie Lee & Chai Asawa
videoExo: Harnesses should see their own code and logs — Alex Krentsel, UC Berekeley / Google Research
