VoiceGremlin
voicegremlin.com- Category
- Developer Tools
- Rank
- No. 4306Tools index
Previous survey · No. 4101 ·
- Pricing
- Freemium
- Type
- APP
- Use case
- Software Testing & Quality · Model & Agent Evaluation
- Interfaces
- API
- Date
About
A SaaS API for automated testing of AI voice agents that answer phones. A user supplies a phone number and a test case such as verifying the agent does a given task. VoiceGremlin calls the agent, has a bot converse with it, and uses an LLM judge to return pass or fail for a CI pipeline. The author says it has a free trial with no card required.
At a glance
VoiceGremlin calls an AI phone agent from a real carrier line and evaluates the transcript against a test goal. It is worth trying when an API-only test misses failures in the actual phone path.
Good fit
Teams with an authorized test number and a repeatable behavior they can check over a call.
Consider something else when
Use a scripted check for a rule that needs deterministic results or when call transcripts cannot go to a hosted judge.
Start here
Point it at your own test number and ask it to verify the first-message disclosure. Compare the automated verdict with the transcript before relying on it.
Cost and requirements
The service documents an authenticated REST API, a reachable phone number and a test instruction written in plain language.
Limits to know
A model grades the transcript, so verify important verdicts yourself. Use synthetic caller details and confirm transcript handling before testing sensitive flows.
Sources checked 2026-11-05. Source-based assessment.
Tags
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.