Vibeleaderboard
← All Intel
Intel / podcast

Andrej Karpathy — AGI is still a decade away

Source
dwarkesh.com
Author
Dwarkesh Patel
Date

Context

An impressive AI assistant still has to become dependable enough to receive an employee's responsibilities. That is the standard Andrej Karpathy uses to explain his decade-of-agents forecast. He identifies persistent learning and competent interaction with software as capabilities that need further work. An must keep using what it has been taught and carry out the surrounding workflow, beyond producing a good answer in one exchange. Karpathy describes the timeline as an intuition drawn from his research and industry experience. His argument directs to the accumulated engineering needed for dependable delegation, rather than treating a successful demonstration as the completion date.

Terms in this piece · Glossary
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
Key quotes

“Reinforcement learning is terrible. It just so happens that everything that we had before it is much worse”

Andrej Karpathy

“The way I like to put it is you’re sucking supervision through a straw.”

Andrej Karpathy

“we’re not building animals. We’re building ghosts or spirits or whatever people want to call it”

Andrej Karpathy

“One easy way to see it is to go to ChatGPT and ask it, “Tell me a joke.” It only has like three jokes.”

Andrej Karpathy

“I feel like the industry is making too big of a jump and is trying to pretend like this is amazing, and it’s not. It’s slop.”

Andrej Karpathy
Chapters
  • 00:00:00AGI is still a decade away
  • 00:29:45LLM cognitive deficits
  • 00:40:05RL is terrible
  • 00:49:38How do humans learn?
  • 01:06:25AGI will blend into 2% GDP growth
  • 01:17:36ASI
  • 01:32:50Evolution of intelligence & culture
  • 01:42:55Why self driving took so long
  • 01:56:20Future of education
Read the source www.dwarkesh.com
More from Dwarkesh Patel
Recommended reads
Comments

Checking sign-in…

Loading comments…