← All IntelClip / EntertainmentAgents produce bloated code and can't simplify
From Andrej Karpathy on Vibe Coding & Agentic Engineering (AI Ascent 2026) · ≈22:40
“when you actually look at the code, sometimes I get a little bit of a heart attack because it's not like super amazing code necessarily all the time and it's very bloated and there's a lot of copy-paste and there's awkward abstractions that are brittle and like it works but it's just really gross”
“I tried to I keep I kept trying to prompt an LLM to simplify more, simplify more, and it just can't”
“I do think that people are still remain in charge of this, but I do think that there's nothing fundamental again that's preventing it. It's just the labs haven't done it yet almost.”
What’s in it
- Why LLM-generated code looks bloated, brittle, and copy-paste heavy
- How models struggle with simplifying code they weren't trained on
- Argument that humans stay in charge—for now, until labs improve
Clip transcript
good enough or something like that. Um, I do think that when you actually look at the code, sometimes I get a little bit of a heart attack because it's not like super amazing code necessarily all the time and it's very bloated and there's a lot of copy-paste and there's awkward abstractions that are brittle and like it works but it's just really gross. Um, and I do I do hope that this can improve in future models. Um, a good example also is this uh, you know, the micro GPT project uh, which where I was trying to simplify uh LLM training to be as simple as possible. The models hate this. They can't do it. I tried to I keep I kept trying to prompt an LLM to simplify more, simplify more, and it just can't You feel like you're outside of the RL circuits. It feels like it you're obviously, you know, you're pulling teeth. It's not like light speed. So, I think um I do think that people are still remain in charge of this, but I do think that there's nothing fundamental again that's preventing it. It's just the labs haven't done it yet almost.
Comments
Sign in to comment.
Loading comments…