Your Voice Agent is Just a Walkie Talkie — Neil Zeghidour, Gradium
Source
youtube.com
Author
AI Engineer
Date
Context
Brief acknowledgments can confuse a voice AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → if it treats every sound from the listener as a demand to stop speaking. This talk uses that problem to explain full-duplex conversation: listening and speaking can happen at the same time, including when someone gives encouraging feedback during another person's sentence.
The proposed modeling approach represents the two sides as concurrent audio streams, allowing speech, silence and overlap on either side. That changes the interaction the model can represent. The research question is how to support this natural conversational behavior while retaining the reasoning needed to complete tasks.
Terms in this piece · Glossary
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.