Internal Ops Agents
- Source
- elevenlabs.io
- Author
- ElevenLabs editorial sitemap
- Date
Context
ElevenLabs, the voice-AI company, says the biggest accuracy gains for its internal Slack agents came from narrowing what the model could get wrong, not from rewriting prompts. In a post by Jake Tennant, who works on its ElevenAgents -building product, the company describes internal agents that answer staff questions and act on requests: a sales bot that answers account questions, a sales-team "forward deployed engineer" bot that answers product questions and assembles working customer demos, a triage bot that turns bug reports and feature requests into Linear tickets, and a data-analysis bot for product teams. ElevenLabs says they save more than 1,200 hours a month and answer more than 5,000 questions a month, and that the triage bot opened 150 tickets in the past month. The post does not say how the hours were measured.
The lessons all remove room for guessing. Cutting the data schema its retrieval agents see down to a few critical fields improved accuracy more than any prompt change the team tried, because each extra column was "one more place to guess wrong." For Salesforce fields that accept only a fixed list of values, such as deal stage, the agents fetch the valid values at startup and write them into the tool's type definitions, the description of what inputs a tool accepts, which the agents reach through , the protocol they use to call tools. The model can then pick only a real option instead of inventing a plausible one. After the triage bot opens a ticket, it checks that the fields are set and that the ticket reached the right team, which the company says has curbed occasional hallucinations and wrong team assignments.
ElevenLabs' reason for the effort is trust: internal agents have to be accurate from the start, because a team that sees mistakes, especially in a shared channel, stops using them. The post reports no error rates or before-and-after comparisons, so the three techniques are design choices supported by the company's account rather than measured results.
- ElevenLabs reports its biggest accuracy gains for internal retrieval agents came from cutting schema fields, not tuning the : every extra column gave the model one more place to guess wrong.
- To stop agents inventing Salesforce values, ElevenLabs fetches each picklist's valid options at startup and injects them into the MCP tool's type definitions, so the model can only choose real deal stages or account types.
- Its triage bot searches Slack for , dedupes against existing tickets and checks for enough diagnostic detail before filing a prioritized Linear ticket, then verifies the fields and team assignment afterward to catch wrong-team routing.
- ElevenLabs says the agents save more than 1,200 hours a month and answer over 5,000 questions, and argues internal agents must be accurate from the start, since otherwise teams stop using them and mistakes are more visible in shared channels.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- MCP — The Model Context Protocol — an open standard that lets any AI assistant plug into any tool or data source without custom integration code.
- context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
- system prompt — The standing instructions a model receives before any user input — defining its role, rules, tools, and tone for the whole conversation.
Checking sign-in…
Loading comments…
