From Signal to PR: Anatomy of a Self-Improving Agent — Jason Lopatecki, Arize
- Source
- youtube.com
- Author
- AI Engineer
- Date

Context
Signal, Arize's debugging , is designed to assemble evidence about application failures before an engineer starts investigating. In Arize's talk, it combines source code with logs and traces, which record the steps an application actually took. That helps connect a reported error to the execution that produced it.
The described workflow runs periodically or in response to events and can open an issue containing its findings. The speaker reports a small fix for a canceled-stream error, while explaining that larger repairs often still need a person to guide the investigation. The supported benefit is a better-informed starting point for debugging, with human involvement continuing through difficult fixes.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
“observability used to be for humans. Used to be a UI you click, a graph you click, something you look at”
Jason Lopatecki
“You can build at agent speed, but today you can't improve your systems really at this agent speed.”
Jason Lopatecki
“your job kind of moves from responder to reviewer”
Jason Lopatecki
“Getting that data into the repo in a file format. These harnesses are magical with files.”
Jason Lopatecki
“by logging and tracing orders and orders of magnitude more than we do today, we can actually create these continuous loops”
Jason Lopatecki
videoCan Your AI Analyst Keep a Secret? - Aaron Linsky, Bridgewater & Nikhil Benesch, turbopuffer
videoWhat Does an AI Engineer Do Now? - Aparna Dhinakaran, Arize AI
videoDo Not Let Models Invent Numbers - Vinoo Ganesh, Kepler
videoWhy Frontier Models Fail as Buy-Side Analysts - Janie Gu, Google DeepMind & Suyeol Yun, LinqAlpha
videoFrom Vibes to Production: Evaluating and Shipping AI Agents That Work 201 — Laurie Voss, Arize AIAI Engineer
videoBuilding Self-Learning Loops for Your Agent — Fuad Ali, Arize AIAI Engineer
videoLet Your Agent Cook: Using Skills to Evaluate and Improve Your App — Ankur Duggal, Arize AIAI Engineer
Checking sign-in…
Loading comments…