Vibeleaderboard
← All Intel
Intel / video

Speech-to-Speech Model Research at Google DeepMind — Valeria Wu Fon & Tom Ouyang, Google DeepMind

Source
youtube.com
Author
AI Engineer
Date

Context

A voice model must balance the quality of its answer with how long the caller waits to hear it. In this Google DeepMind research talk, the team describes a tension between conversational speed, task completion and handling inputs such as video or screen sharing. Allowing more reasoning can improve answers while delaying the first audio response.

That makes response timing part of the model's usefulness. A voice assistant needs enough reasoning to complete the task, but it also needs to recognize when to respond and when background sound is not an invitation to speak. The talk frames these as connected design objectives.

Terms in this piece · Glossary
  • multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.
Read the source www.youtube.com
More from AI Engineer
Recommended reads
Comments

Checking sign-in…

Loading comments…