Tools

Expect

A CLI tool that uses AI agents to automatically generate and run browser tests based on your code changes. It analyzes your git diff, creates test plans, and executes them in real browsers with your existing login sessions.

github.com/millionco/expectOpen Source3mo ago

DevTool Arena

A benchmarking platform that evaluates how quickly AI agents can integrate with developer tools using only their documentation. It provides rankings and detailed reports to help devtool companies improve their AI-agent compatibility.

2027.devFreemium4mo ago

Trailblaze

AI-driven UI testing framework for Android — describe what you want to test in plain language and let the agent drive the app.

https://github.com/block/trailblazeOpen Source2mo ago

qa-use

QA automation tool from the Browser Use team for running agent-driven test flows against web apps.

https://github.com/browser-use/qa-useOpen Source2mo ago

Auto-Harness

A self-improving AI agent system that automatically mines failures from benchmarks, optimizes agent performance, and gates changes against regressions. It demonstrated improving agent scores from 0.56 to 0.78 on Tau3 benchmark tasks through autonomous iteration.

github.com/neosigmaai/auto-harnessOpen Source3mo ago

OpenAI Testing Agent Demo

Demo of a UI testing agent built on OpenAI's Computer Use model and the Responses API. Drives a browser to test apps end-to-end.

https://github.com/openai/openai-testing-agent-demoOpen Source2mo ago

Ami

Desktop AI coding environment.

https://github.com/millionco/ami-releasesOpen Source2mo ago

RAGEval

Benchmark and evaluation toolkit for retrieval-augmented generation pipelines — measure how well your RAG actually answers questions.

https://github.com/OpenBMB/RAGEvalOpen Source2mo ago

Agentlytics

Comprehensive analytics dashboard for AI coding agents — Cursor, Windsurf, Claude Code, Copilot, Zed, Antigravity, OpenCode, and more.

https://github.com/f/agentlyticsOpen Source2mo ago

Adversarial Dev

GAN-inspired three-agent harness that pits a generator against an adversarial evaluator to build applications with quality gates. Built with Claude Agent SDK and Codex SDK.

https://github.com/coleam00/adversarial-devOpen Source2mo ago

Aider Polyglot Benchmark

Coding problems across multiple languages used to benchmark Aider — reuse it to evaluate any AI coding agent.

https://github.com/Aider-AI/polyglot-benchmarkOpen Source2mo ago

Presenton

An open-source AI presentation generator and API — a self-hostable alternative to Gamma and Beautiful.ai.

github.com/presenton/presenton1mo ago

AutoAgent

An AI meta-agent that autonomously builds and optimizes AI agent harnesses overnight. It iteratively modifies system prompts, tools, and configurations, runs benchmarks, and hill-climbs on performance scores without manual intervention.

github.com/kevinrgu/autoagentOpen Source3mo ago

PentAGI

An advanced AI-powered penetration testing tool that operates as a fully autonomous agent. It automates complex security testing tasks to help identify vulnerabilities and security weaknesses in systems.

pentagi.comPaid5mo ago

Playwright

Cross-browser end-to-end testing framework from Microsoft, with a single API for Chromium, Firefox, and WebKit and built-in auto-wait.

https://github.com/microsoft/playwrightOpen Source2mo ago

Scenario

Scenario is an agent testing framework that uses LLM-powered user simulators to run end-to-end simulations of AI agents across diverse scenarios and edge cases. It enables developers to validate tool calling, multi-turn conversations, and agent behavior without requiring pre-built datasets. Works with LangGraph, CrewAI, Pydantic AI, and any other agent framework.

github.com/langwatch/scenarioOpen Source29d ago

Vibetest

MCP server that runs automated QA on your web app using Browser-Use agents. Cursor and Claude can crawl your site and report bugs.

https://github.com/browser-use/vibetest-useOpen Source2mo ago

Braintrust

Braintrust is a platform for evaluating and shipping AI products — run evals, compare prompt/model versions, log production traces, and iterate in a prompt playground.

braintrust.devFreemium29d ago

Browser-Use Agent Studio

Studio for designing and running browser-use AI agents that automate web tasks.

https://github.com/browser-use/agent-studioOpen Source2mo ago

Fastbot Android

Model-based UI testing tool for Android that learns app transitions to surface stability bugs.

https://github.com/bytedance/fastbot_androidOpen Source2mo ago

Guardrail

Safety layer for AI-generated code. Scans and fixes security issues, performance problems, and AI-specific anti-patterns. 22 rules, AST auto-fix, zero config.

https://github.com/manavarya09/guardrailOpen Source2mo ago

TDD Guard

TDD Guard is a Claude Code plugin that automatically enforces Test-Driven Development principles during AI-assisted coding sessions. It blocks implementation attempts without failing tests, prevents over-implementation, and integrates with your linter to enforce the full red-green-refactor cycle. Supports Vitest, Jest, pytest, PHPUnit, Go, Rust, RSpec, and more.

github.com/nizos/tdd-guardOpen Source29d ago

AI Humanize

Web tool that rewrites AI-generated text into more natural human-sounding prose.

https://github.com/alchaincyf/aihumanizeOpen Source2mo ago

Clues.app

Native macOS/iOS app built entirely using AI tools — a showcase of agentic coding shipping real apps.

https://github.com/f/clues.appOpen Source2mo ago

Open Generative AI

Complete AI image and video generation platform with multiple models, self-hostable application.

github.com/anil-matcha/open-generative-ai2mo ago

Bolt

AI app builder in the browser by StackBlitz — prompt to full-stack app with live preview and deploy

bolt.newFreemium4mo ago

auto-browser

Command-line tool for configurable web automation with AI-assisted template creation — drive any site from a YAML config.

github.com/ruvnet/auto-browserOpen Source2mo ago

Skills for Real Engineers

A collection of structured AI agent skills designed to improve software engineering practices and fix common failure modes in AI-powered development. Based on decades of engineering experience and focused on alignment, testing, and architecture.

github.com/mattpocock/skillsOpen Source1mo ago