Vibeleaderboard
← Glossary
Glossary · AI and agent workflows

Red-green check

A check that has been seen to fail, for the intended reason, before it was seen to pass.

The pattern described by Simon Willison for coding agents: write the check, run it and confirm it fails, then change the program until it passes. A check that passed from the start may never have exercised the change. The failure must be for the intended reason; a run that ends in a traceback because a fixture file is missing says something about the setup, not the program. Ask an agent for the failing run before its fix as well as the passing run after it.

See how the idea fits

Make a check fail for the right reason, then pass →
Definition sources