Build nanoGPT
https://github.com/karpathy/build-nanogpt- Category
- Education
- Pricing
- Open Source
- Type
- ARTICLE
- Builder
- karpathy
- GitHub
- 5.4k stars
- Added
- May 22, 2026
About
Andrej Karpathy's video lecture + code: build nanoGPT from scratch step by step, training a small GPT on Shakespeare and then OpenWebText.
Why it made the leaderboard
Karpathy builds a GPT from an empty file to training on real text, narrating every decision. Still the clearest way to replace "LLMs are magic" with an actual mental model of what is happening under the hood.
Tags
gptkarpathycoursedeep-learningtraining
Tech Stack
Jupyter NotebookPython
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.