← All IntelClip / EntertainmentVerifiability enables your own fine-tuning
From Andrej Karpathy on Vibe Coding & Agentic Engineering (AI Ascent 2026) · ≈14:06
“verifiability makes something tractable in the current paradigm because you can throw huge amount of RL at it”
“If you have huge amount of diverse data sets of RL environments, etc., uh you can use your favorite fine-tuning framework and um and uh pull the lever and get something that actually uh works pretty well.”
What’s in it
- Why verifiable tasks unlock large-scale RL for coding models
- How RL environments enable your own effective fine-tuning
- When to pull the fine-tuning lever for reliable gains
Clip transcript
audience? Um So, I think maybe that comes to the previous question of I do think that verifiability because it um Let me think. So, verifiability makes something tractable in the current paradigm because you can throw huge amount of RL at it. Um So, maybe one way to see it is that uh that remains true even if the labs are not focusing on it directly. So, if you are in a a verifiable setting where you could create these RL environments or examples, then that actually sets you up to potentially do your own fine-tuning and you might benefit from that. But, that is fundamentally technology that just works. You can pull a lever. If you have huge amount of diverse data sets of RL environments, etc., uh you can use your favorite fine-tuning framework and um and uh pull the lever and get something that actually uh works pretty well. So, um
Comments
Sign in to comment.
Loading comments…