context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
distillation — Training a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.
fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
Why it matters
A frontier lab's shortlist of open fine-tuningTaking a trained model and training it a bit more on your own examples so it gets better at one specific job.Full definition → questions with the reasoning attached, including why bootstrapping Constitutional AI from instruction-tuned models confounds what the constitution itself contributes.
