← All IntelClip / AI AgentsWhy you can't just point Claude at your data
From From Signal to PR: Anatomy of a Self-Improving Agent — Jason Lopatecki, Arize · ≈16:21
The most concrete engineering lesson in the talk: the value is in skill design — finding the right slice of data, landing it in the repo as a file, and making skills composable enough to cohort and drill down.
What’s in it
- The most concrete engineering lesson in the talk: the value is in skill design — finding the right slice of data, landing it in the repo as a file, and making skills composable enough to cohort and drill down.
Clip transcript
question of like why can't we just connect cloud code to your data and have cloud code do all these things. I think there's like a version of that question that can probably be asked for these autofixes, right? Like why not have cloud code read the traces and push the PR itself. >> I'm curious how you would respond to that question. >> Yeah. Uh so so why wouldn't have cloud code kind of hook to your your data and just just do it? Um the answer is like you should um like like the vision and what we do actually at at Arise is we have uh a lot of skills. I think first off to to make that really work well you have to do a bit of well-designed skills in the data space. The skill like the the important things of designing these skills are are around really around getting data you know finding the right data first. So I want to find a group of traces relative to a session or something. Getting that data into the repo in a file format. These harnesses are magical with files. So you get the file what happened. In some cases we have 10meg files like sitting in the repo. Um so it's designing the skill to be really really well done with the um with this data and and then giving claude enough skills to be composable to find issues. So the answer is absolutely yes. like we have Pyroscope skills that will find memory issues. We have facets in Pyroscope that the skill knows how to use. I can cohort by customer to see if a customer is causing an issue. Um but but you've got to kind of design the skill surface area in a way that Claude can really really work well and and and it's not just like point Claude at the data. >> I see. Thank you.
Comments
Sign in to comment.
Loading comments…