OpenAI Evals
https://github.com/openai/evals- Category
- Developer Tools
- Pricing
- Open Source
- Type
- TOOL
- Builder
- openai
- GitHub
- 19.0k stars
- Added
- May 22, 2026
About
OpenAI's framework for evaluating LLMs and LLM systems, with an open-source registry of benchmarks the community can extend.
Why it made the leaderboard
OpenAI's framework for evaluating LLMs and LLM systems, backed by an open-source registry of community benchmarks — measure model behavior against established evals instead of ad-hoc spot checks.
Tags
llmevaluationbenchmarksopenaitesting
Tech Stack
Python
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.