← All IntelClip / AI AgentsHow RL for coding agents actually works (60-second explainer)
From Harness Engineering is not Enough: Why Software Factories Fail — Dex Horthy, HumanLayer · ≈11:25
“They're about 15-minute tasks.”
“They have binary one or zero rewards on did you fix the problem you were trying to fix?”
What’s in it
- Explains the RL loop used to train coding agents fast
- Breaks down SweeBench multilingual's binary pass/fail reward system
- Shows how trace generation and reinforcement sharpen tool-calling skills
Clip transcript
going to see if we can do coding agent reinforcement learning in 60 seconds. So, what we're going to do if we want to train a model to get better at tool calling, better at solving software problems, we're going to generate a bunch of We're going to give it a problem and we're going to generate a bunch of traces. Try to solve the problem a bunch of different times. We're going to score them all on correctness and did the test pass and all this stuff. Uh and then we're going to reinforce. We're going to make the bad behavior less likely and we're going to update the weights to make the good behavior more likely. Um this one of the classic ones here is SweetBench multilingual. Uh they're about 15-minute tasks. They're from open-source repos like Redis, JQ, and Django and all this stuff. And they have binary one or zero rewards on did you fix the problem you were trying to fix? And did you do it without breaking anything else?
Comments
Sign in to comment.
Loading comments…