Speech-to-Speech Model Research at Google DeepMind — Valeria Wu Fon & Tom Ouyang, Google DeepMind
Source
youtube.com
Author
AI Engineer
Date
Context
A voice model must balance the quality of its answer with how long the caller waits to hear it. In this Google DeepMindresearch talk, the team describes a tension between conversational speed, task completion and handling inputs such as video or screen sharing. Allowing more reasoning can improve answers while delaying the first audio response.
That makes response timing part of the model's usefulness. A voice assistant needs enough reasoning to complete the task, but it also needs to recognize when to respond and when background sound is not an invitation to speak. The talk frames these as connected design objectives.
Terms in this piece · Glossary
multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.