Stanford CS25: Transformers United V6 I From Next-Token Prediction to Next-Generation Intelligence
Source
youtube.com
Author
Stanford Online
Date
Why it matters
Explains the data curation and pretrainingThe first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.Full definition → choices behind frontier-class models, useful for anyone training or evaluating them.
Terms in this piece · Glossary
pretraining — The first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.
videoStanford CS329A Self-Improving AI Agents | Part 8 | Agentic Evaluations and Long Horizon Tasks
videoAI & Cybersecurity: Dan Boneh Interviews Nicolas Carlini
videoStanford CS229 I Machine Learning I Building Agents That Do the Work of Human Software Engineers
videoStanford CS329A Self-Improving AI Agents | Part 9 | Future Research Areas
videoStanford CS25: Transformers United V6 I From Language Models to Native Multimodal IntelligenceStanford Online
videoBuilding the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan AnilSequoia Capital
video🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, CaltechLatent Space