Glossary · Evals and reliability

Agent regression testing

Also: behavioral regression suite

Repeating stable behavior checks after model, prompt, tool, or retrieval changes.

Agent regressions often appear outside the changed component because the system is probabilistic and interconnected. A versioned suite detects whether improvements on new cases silently broke previously acceptable behavior.