Modular LLMs at scale: how FlexOlmo is helping to pool national expertise without pooling sensitive data
Source
allenai.org
Date
Why it matters
When the data that would make a model useful cannot leave its institution, FlexOlmo lets each holder train an expert locally and merge afterward, pooling capability without pooling the corpus.
