Agentic Testing: Where Agents Fit in the E2E Testing Stack
Source
Sergii Gorbachov
Author
Sergii Gorbachov
Date
Terms in this piece · Glossary
MCP — The Model Context Protocol — an open standard that lets any AI assistant plug into any tool or data source without custom integration code.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
determinism — Whether the same input reliably produces the same output — something LLM systems mostly lack, which changes how you test and debug them.
Why it matters
Agentic E2E tests validate whether a goal is reachable rather than a fixed click path, which buys exploratory coverage but costs determinismWhether the same input reliably produces the same output — something LLM systems mostly lack, which changes how you test and debug them.Full definition →, money and runtime — this maps where each belongs in a real test suite.
articleAgentsChip Huyen
articleTangent: An Empirical Study of Testing Practices for LLM-Based Agent ApplicationsRangeet Pan, Tyler Stennett, Divya Sankar, Bridget McGinn, Alessandro Orso, Raju Pavuluri, Saurabh Sinha, Maja Vukovic
postHow to really stop your agents from making the same mistakesGarry Tan