Vibeleaderboard
← Back to Vibers
Confident AI
Company

Confident AI

1 Tool

Confident AI is a San Francisco company that builds a cloud platform for evaluating and monitoring LLM applications and AI agents. The platform layers on top of DeepEval, the company's open-source LLM evaluation framework, adding collaboration, dataset management, tracing and real-time monitoring. Y Combinator lists Confident AI as founded in 2024 and part of its Winter 2025 batch, with Jeffrey Ip, creator of DeepEval, as founder and CEO and Kritin Vongthongsri as founder and CTO.

Tools

DeepEval(github.com/confident-ai/deepeval)

Open-source LLM evaluation framework whose 40+ research-backed metrics for agents, RAG, and safety run as unit tests.

Developer ToolsOpen SourceLLM Eval★ 19.3kApache-2.0built by confident-ai