← All IntelClip / EntertainmentDesktop dev skill using computer-use to self-test UX
From Reflecting on a Year of Claude Code (Boris Cherny) · ≈2:24
“What the skill does is Claude actually spins up a local desktop app, and it uses computer use to click around on it.”
“It also tests edge cases, and when there's an issue it fixes it and re-checks.”
What’s in it
- See how a Claude 'skill' spins up and tests a desktop app
- Uses computer-use to click through new UX and edge cases
- Feeding Slack context so the agent knows when staging is down
Clip transcript
How are, like, how are you doing it? So I've been mainly hacking on the desktop app these days. And one of the engineers on the team actually added this desktop development skill that teaches Claude how to run the local desktop app. And I've been having it use it, and it still runs into issues or like bugs with the staging environment sometimes. And so what I have it do is in those cases, I have it read Slack and understand, hey, is staging down right now? Or has someone else already hit this? And then when it debugs the whole issue, I tell it to update the desktop development skill. What the skill does is Claude actually spins up a local desktop app, and it uses computer use to click around on it. And so when I add a new UX, it clicks around to invoke the new UX. It also tests edge cases, and when there's an issue it fixes it and re-checks.
Comments
Sign in to comment.
Loading comments…