There is No Theoretical Curse of Multilinguality For Embedding Space Structure
- Source
- arxiv.org
- Author
- Niyati Bafna, Neha Verma, Vil\'em Zouhar, Philipp Koehn, David Yarowsky
- Date

Context
Adding languages need not require a proportionate expansion of the numerical space used to represent meanings. This paper constructs multilingual representations that preserve similarity relationships within each language and keep translations closer together than different concepts, while retaining distinguishable representations.
Under its assumptions, the extra dimensions needed above a fixed concept space grow logarithmically with the number of languages. The result challenges the idea that representation space must inevitably become prohibitively crowded. It leaves open how reliably training can learn such a structure: the theorem concerns geometry, not total model size, training cost or guaranteed translation quality.
- embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
articleRegister Bias in Complexity-Based Large Language Model RoutingSimran Koul
articleCompliance, Capability, and Conflict: Benchmarking Multimodal LLMs under System MessagesJuan Yeo, Geewook Kim
articleAccelerating LLM Inference via Vector Index Based Output EmbeddingsMartin Loretz, Sepp Hochreiter
Checking sign-in…
Loading comments…