Andrej Karpathy — AGI is still a decade away
- Source
- dwarkesh.com
- Author
- Dwarkesh Patel
- Date
Karpathy's frank breakdown of why reinforcement learning is fundamentally limited and where LLMs have cognitive blind spots gives engineers a realistic mental model for what current models can and can't do — sharper than the usual AGI-hype narrative.
“Reinforcement learning is terrible. It just so happens that everything that we had before it is much worse”
Andrej Karpathy
“The way I like to put it is you’re sucking supervision through a straw.”
Andrej Karpathy
“we’re not building animals. We’re building ghosts or spirits or whatever people want to call it”
Andrej Karpathy
“One easy way to see it is to go to ChatGPT and ask it, “Tell me a joke.” It only has like three jokes.”
Andrej Karpathy
“I feel like the industry is making too big of a jump and is trying to pretend like this is amazing, and it’s not. It’s slop.”
Andrej Karpathy
- 00:00:00AGI is still a decade away
- 00:29:45LLM cognitive deficits
- 00:40:05RL is terrible
- 00:49:38How do humans learn?
- 01:06:25AGI will blend into 2% GDP growth
- 01:17:36ASI
- 01:32:50Evolution of intelligence & culture
- 01:42:55Why self driving took so long
- 01:56:20Future of education
Checking sign-in…
Loading comments…