← All IntelClip / EducationGrounding as a signal-manufacturing technique
From RL Without Verifiable Rewards (Will Brown, Prime Intellect) · ≈8:38
“And so grounding roughly means that you have some source material and in machine learning generally you want to have some notion of supervision.”
“And this gap is something we can exploit to create signal that we can then learn from.”
“Judges are also really useful.”
What’s in it
- Explains grounding as a technique for creating ML training signal
- Shows how AB testing with/without context reveals model capability gaps
- Introduces judges as another useful supervision technique
Clip transcript
useful. One is grounding. And so grounding roughly means that you have some source material and in machine learning generally you want to have some notion of supervision. There's something you're learning from. And in messy situations we don't necessarily always have clean supervision, but we can get pretty reliable supervision if we kind of are careful about techniques we use. And so grounding is one where you have some source material and the ability to do an AB test of like with and without is a very useful way of creating this kind of capability gap where a model will do better if it has something in context. And this gap is something we can exploit to create signal that we can then learn from. Judges are also really useful.
Comments
Checking sign-in…
Loading comments…