Self-bench

About

Self-bench is an open-source tool that creates and runs coding-agent evals automatically from a repository's pull requests. Agents author and review Harbor environments generated from the PRs, the user approves each eval, and models and harnesses can be run concurrently in sandboxes. It lets teams measure agents on their own codebase instead of relying on public benchmarks that labs may optimize for, and supports connecting OpenAI and Claude subscriptions to avoid raw token costs.