"My name is... my name is...": A Linguistic Map for Voice Agents — Midam Kim, ServiceNow
Source
youtube.com
Author
AI Engineer
Date
Context
Fixing speech recognition alone may leave a voice conversation broken. This linguistic framework separates listening and speaking, then examines sounds, words, interaction and the user's understanding within each. Mishearing a name, pronouncing it incorrectly and interrupting its spelling therefore require different diagnoses.
The layers also interact. A system that recognizes a correction but keeps saying the name incorrectly has not repaired the conversation. The framework directs attentionThe mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.Full definition → to what the caller believes the system understood, since spoken exchanges do not leave the same visible history as text chat.
Terms in this piece · Glossary
attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.