← All IntelClip / EntertainmentSpeculation: neural nets as the host process
From Andrej Karpathy on Vibe Coding & Agentic Engineering (AI Ascent 2026) · ≈8:16
“I kind of feel like in the early days of computing actually, people were a little bit confused as to whether computers would look like calculators or computers would look like neural nets.”
“you could imagine I think that a lot of this will flip and that the neural net becomes kind of like the host process. And the CPUs become kind of like the co-processor.”
What’s in it
- Speculative vision: neural nets become the host, CPUs the co-processor
- Imagines diffusion rendering unique UIs from raw video/audio input
- Why computing chose calculators over neural nets in the '50s-'60s
Clip transcript
networks doing most of the work. Um I do think that the extrapolation looks very weird because you could basically imagine I don't think I Yeah, so you could imagine completely neural computers in a certain sense. Uh you feed a raw videos like imagine a device that takes raw videos or audio into basically what's a neural net and uses diffusion to render a UI that is kind of like, you know, unique for that moment in a certain sense. And um I kind of feel like in the early days of computing actually, people were a little bit confused as to whether computers would look like calculators or computers would look like neural nets. And in '50s and '60s, it was not really obvious which way would go. And of course, we went down the calculator path and ended up building classical computing and then neural nets are currently running virtualized on existing computers. But you could imagine I think that a lot of this will flip and that the neural net becomes kind of like the host process. And the CPUs become kind of like the co-processor. So, we saw the diagram of, you know, intelligence compute is going to neural networks is going to take over and become the dominant spend of flops. So, you could imagine something really weird and foreign when where neural nets are doing most of the heavy lifting, they're using tool use as just like, you know, historical appendage for some kinds of like deterministic tasks. But what's really running the show is these neural nets that are networked in a certain way. Um so, you can imagine something extremely foreign as the extrapolation, but I think we're going to probably get there sort of piece by piece.
Comments
Sign in to comment.
Loading comments…