Vibeleaderboard
Index / app

VoiceGremlin

voicegremlin.com
Visit voicegremlin.com
Category
Developer Tools
Rank
No. 4306Tools index

Previous survey · No. 4101 ·

Pricing
Freemium
Type
APP
Use case
Software Testing & Quality · Model & Agent Evaluation
Interfaces
API
Date

About

A SaaS API for automated testing of AI voice agents that answer phones. A user supplies a phone number and a test case such as verifying the agent does a given task. VoiceGremlin calls the agent, has a bot converse with it, and uses an LLM judge to return pass or fail for a CI pipeline. The author says it has a free trial with no card required.

At a glance

VoiceGremlin calls an AI phone agent from a real carrier line and evaluates the transcript against a test goal. It is worth trying when an API-only test misses failures in the actual phone path.

Good fit

Teams with an authorized test number and a repeatable behavior they can check over a call.

Consider something else when

Use a scripted check for a rule that needs deterministic results or when call transcripts cannot go to a hosted judge.

Start here

Point it at your own test number and ask it to verify the first-message disclosure. Compare the automated verdict with the transcript before relying on it.

Cost and requirements

The service documents an authenticated REST API, a reachable phone number and a test instruction written in plain language.

Limits to know

A model grades the transcript, so verify important verdicts yourself. Use synthetic caller details and confirm transcript handling before testing sensitive flows.

Sources checked 2026-11-05. Source-based assessment.

Tags

voice-agentstestingllm-judgetelephonyciqa

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.