mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.
quantization — Shrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.
Why it matters
A 124B-param multimodalA model that works with more than text — reading images, audio, or video, and sometimes generating them too.Full definition →mixture-of-expertsA model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.Full definition → (5.5B active) with 1M-token context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → and native UI-interaction reasoning, released quantizationShrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.Full definition → to fp4 for cheaper deployment in agentic vision-plus-action workloads.
