The Loop Is the Product — Roland Gavrilescu, Introspection
Source
AI Engineer
Author
AI Engineer
Date
Key takeaways · AI-distilled
Gavrilescu argues that an AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition →'s success depends on the quality of its signals and verifiers, and that each loop's output should feed the next one, which is why he calls the loop the product.
His second claim: 'system distillationTraining a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.Full definition →' is the moat. evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition →, judges, skills and human judgment from each loop should be kept as portable, versioned 'agent recipes' you own, independent of any model provider. Introspection is releasing an early version, Pi recipes.
He proposes 'valued work per watt' as the score to optimize, and uses a talent-sourcing agent to show spotting patterns in traces, calibrating judges with a human in the loop, and A/B testing taste with real users before promoting a change.
Terms in this piece · Glossary
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
distillation — Training a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.