A Large-Scale Empirical Study of Quality Assurance…

Key takeaways · AI-distilled

Safeguards were applied inconsistently even across equivalent execution routes within the same project — a risky action might be guarded on one code path but not on another functionally similar one.
Tests in the 157 studied projects rarely examine boundary conditions, adversarial inputs, or multi-step tool-use failures — QA concentrates on basic functionality and already-flagged high-risk actions instead.
Risks the projects' own documentation identifies are seldom translated into actual end-to-end QA checks — the gap is between knowing about a risk and having a test that catches it.

Terms in this piece · Glossary

LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.

Why it matters

Maps out where current testing practices fall short, a useful checklist for deciding what to actually test before shipping an autonomous agent.

Intel