← All IntelClip / EntertainmentSoftware 3.0: programming by prompting the LLM interpreter
From Andrej Karpathy on Vibe Coding & Agentic Engineering (AI Ascent 2026) · ≈2:51
“So software 3.0 is kind of about uh you know, your programming now turns to prompting and what's in the context window is your lever over the interpreter that is the LLM”
“software 2.0 I'm actually programming by creating data sets and training uh training neural networks”
What’s in it
- Frames three software eras: coding, training nets, then prompting LLMs
- Explains why LLMs act like programmable computers from internet-scale training
- Positions the context window as your lever over the LLM interpreter
Clip transcript
actually believe this? Right. So uh yeah, exactly. So software 1.0 I'm writing code, software 2.0 I'm actually programming by creating data sets and training uh training neural networks. So the programming is kind of like arranging data sets and maybe some objectives and neural network architectures. And then what happened is that basically if you train one of these GPT models or LLMs on a sufficiently large set of tasks implicit basically implicitly because by training on the internet you have to multitask all the things that are in the data set. Uh these actually become kind of like a programmable computer in a certain sense. So software 3.0 is kind of about uh you know, your programming now turns to prompting and what's in the context window is your lever over the interpreter that is the LLM that is kind of like interpreting your context and uh performing computation in the digital digital information space. So I guess um yeah, that's kind of the transition and
Comments
Sign in to comment.
Loading comments…