Tolan: Voice-First AI Companion — Paula Dozsa, Tolan
- Source
- youtube.com
- Author
- AI Engineer
- Date
Context
A voice companion needs to follow a changing conversation without letting old dominate its next answer. The team behind Tolan describes rebuilding the model's context on every turn, because users interrupt, abandon subjects and return to them while doing other things. Its memory system retrieves relevant information and consolidates duplicates and contradictions overnight. The engineering talk explains this approach.
Reusing unchanged context may preserve a computational cache, but the account identifies a competing requirement: the next response must reflect what the person is discussing now. Memory and immediate conversational context serve different purposes, so the system assembles them again as the exchange develops.
- context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
- model routing — Sending each request to a model chosen by the difficulty of the task, rather than using one model for everything.
videoThe Cheaper AI Model That Costs You More - Rayan Krishnan, Vals AI
videoYour Agent Just Paid for Nothing: 6 Attacks on x402 Payments - Ishween Kaur, SoFi
videoWhy Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar
videoHow Revolut Cut AI Coding Costs 90% With Self-Hosted Open Models - David Abitbol, Revolut
Checking sign-in…
Loading comments…


