Agents That Self Improve While You Sleep - Fuad Ali, Arize AI
Source
youtube.com
Author
AI Engineer
Date
Why it matters
Lays out a concrete loop: trace everything, convert failures into regression datasets and evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition →, prove fixes with experiments, and keep humans on eval design and review.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
videoWhat a $900M Bank Error Teaches Us About AI Agents - John Feminella, Two Sigma
videoHow to Test Your Agents on Real Tasks With Harbor - Xander Song, Arize AI
video300 Agents, 60 People: How We Secured Our Own AI Agents - Aiden Sochowski, Runlayer
videoHow a Trading Firm Ships New AI Models the Same Day - Noyan Tokgozoglu, Optiver
