transformers v5.22.0 — v5.22.0: Mistral Large 4 (Le Chonk)
Source
github.com
Author
LysandreJik
Date
Why it matters
Transformers v5.22.0 adds Mistral Large 4, a 1T-parameter open mixture-of-expertsA model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.Full definition → with 49B active parameters, 1M context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → and per-request reasoning effort, so it can be loaded and tested in existing pipelines.
Terms in this piece · Glossary
multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.
mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
tool use — A model's ability to call external functions — run code, search the web, edit files — instead of only generating text.
