Nick really championed us going Apache 2 for this release and for Cohere Transcribe. Not an obvious decision and one that required many discussions. Like Nick says, I hope the model is more useful and empowering as a result. https://t.co/NlqqEKvTPj
mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
Why it matters
Apache 2.0 on a lab's best model removes the redistribution and commercial-use restrictions that usually govern open weightsA model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.Full definition → releases, making self-hosted deployment and fine-tuningTaking a trained model and training it a bit more on your own examples so it gets better at one specific job.Full definition → legally straightforward.
