← Glossary
Glossary · AI and agent workflows
Baseline comparison
Running the unchanged workflow and the changed workflow on the same representative cases under the same conditions, and comparing results against the criteria.
With one difference between conditions, the comparison can associate that component with a change in results; with several differences it compares whole setups and cannot say which part mattered. The result is stated for those cases, that model and that harness. It does not establish that the change works in general, that it survives a model update, or that it affects other failure classes. Practitioners report unchanged procedures behaving differently after upgrades, so the comparison is repeated when the model changes.