Vibeleaderboard
← All Intel
Intel / article

Announcing the Open Source Release of the ERNIE 4.5 Model Family

Source
unknown
Date

Context

Baidu's ERNIE 4.5 release provides ten model variants and associated development tools under an open release. The announcement states that the models are available under Apache 2.0 and span text and work, giving developers different scales to consider for their applications.

The family includes a 0.3-billion-parameter dense model and larger mixtures of experts, which use selected portions of their learned parameters during computation. That explains why the largest model's 424-billion total parameter count differs from its active count. Choosing a variant involves both its overall size and how much of it participates in processing; the family name alone does not identify those requirements.

Terms in this piece · Glossary
  • multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.
  • mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
Source link unavailable.unknown
Recommended reads
Comments

Checking sign-in…

Loading comments…