← All IntelClip / EntertainmentVerification means the agent can actually run the thing
From Reflecting on a Year of Claude Code (Boris Cherny) · ≈1:22
“But actually when we talk about verification for agents, it's something slightly different. It's like can the agent run the thing?”
“And it opened a little Claude CLI and tested its own feature. And I was just like, whoa.”
What’s in it
- Why 'verification' for agents means more than unit tests or linting
- The real question: can the agent actually run the thing it built
- Anecdote of Claude testing its own feature via bash CLI
Clip transcript
I sort of feel like this is this thing that just like everyone misunderstands because whenever we talk about verification, people are thinking like unit tests or they're thinking like lint or like type check. These are the things that are obviously really easy to automate. And these are the things that were already automated. But actually when we talk about verification for agents, it's something slightly different. It's like can the agent run the thing? It takes a little bit of mental work to figure out how exactly do you do this, because it's often not straightforward. And I think that's like, that’s one of the challenges. I remember I remember with Opus 4 Claude tested itself. And we just like hooked it up to Opus 4 And I was like, Claude build the feature and then test yourself in like bash. And it opened a little Claude CLI and tested its own feature. And I was just like, whoa.
Comments
Sign in to comment.
Loading comments…