Stanford CS25: V5 I Large Language Model Reasoning, Denny Zhou of Google Deepmind
Source
youtube.com
Author
Stanford Online
Date
Why it matters
Explains from the researcher who pioneered chain-of-thoughtHaving a model write out intermediate reasoning steps before its answer, which markedly improves performance on hard problems.Full definition → why intermediate tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → drive LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → reasoning, which grounds prompting and reasoning-model decisions.
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
chain-of-thought — Having a model write out intermediate reasoning steps before its answer, which markedly improves performance on hard problems.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.