AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Rebuilding an AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → around plain file-system tools (list, read, bash) instead of custom typed tools doubled its evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → score, a concrete case for minimizing bespoke tool schemas in favor of primitives models already handle well.
videoAgents Without Code: Skills, YAML, and Filesystems Replaced Python — Philipp Schmid, Google DeepMind
videoWe let an AI agent execute Bash and lived to talk about it — Sarah Sanders, PostHog
videoNo Memory, No Harness: Why the Database Is the Last Line of Defense — Kay Malcolm, Oracle
videoEvery step you take, every call you make: the reliable agent stack — Giselle van Dongen, Restate
