There is No Theoretical Curse of Multilinguality For Embedding Space Structure
Source
arxiv.org
Author
Niyati Bafna, Neha Verma, Vil\'em Zouhar, Philipp Koehn, David Yarowsky
Date
Why it matters
If capacity is not the binding constraint, then the fix for multilingual degradation is data and training rather than a larger embeddingA list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.Full definition → space, which changes where the effort goes.
Terms in this piece · Glossary
embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
articleRegister Bias in Complexity-Based Large Language Model RoutingSimran Koul
articleCompliance, Capability, and Conflict: Benchmarking Multimodal LLMs under System MessagesJuan Yeo, Geewook Kim
articleAccelerating LLM Inference via Vector Index Based Output EmbeddingsMartin Loretz, Sepp Hochreiter