The AI Frontier: from Gemini 3 Deep Think distilling to Flash — Jeff Dean
Source
youtube.com
Author
Latent Space
Date
Why it matters
Explains how Google pairs frontier capability with distillationTraining a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.Full definition → into cheaper models and hardware co-design, which shapes the cost and quality of models engineers build on.
Terms in this piece · Glossary
distillation — Training a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.
