inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
Blaizzy's code-first series building LLMs from the ground up — architecture, training, inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition →. A hands-on alternative to Karpathy's course if you learn better by typing the implementation yourself.
Key quotes
“By the end, you will have created and trained a LLaMA 2 model with 100M parameters from scratch using PyTorch to do code completion.”
“The goal is to code LLaMA 3 from scratch in PyTorch to create models with sizes 3B, 6B, 35B and 45B params.”
“Introducing the world's first Llama-3 base model with 6B parameters.”
