Introducing Arcee Supernova Medius A 14b Model That Rivals A 70b 2
Source
Arcee AI editorial sitemap
Author
Arcee AI editorial sitemap
Date
Terms in this piece · Glossary
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
distillation — Training a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.
Why it matters
Cross-tokenizer distillationTraining a small, cheap model to imitate a big one's outputs, keeping much of the capability at a fraction of the cost.Full definition → from a 405B teacher into a 14B student is spelled out here, including why logit distillation needs a shared tokenizer and where hidden-state methods take over.
