Glossary · Evals and reliability

Agent failure analysis

Also: agent debugging

Tracing a bad outcome to the system component that produced it.

Failure analysis separates model errors from missing context, poor retrieval, ambiguous tools, environment faults, unsafe permissions, and flawed graders. A useful taxonomy turns recurring failures into targeted fixes and new evaluations.