There is No Theoretical Curse of Multilinguality For Embedding Space Structure
Source
Niyati Bafna, Neha Verma, Vil\'em Zouhar, Philipp Koehn, David Yarowsky
Author
Niyati Bafna, Neha Verma, Vil\'em Zouhar, Philipp Koehn, David Yarowsky
Published
Terms in this piece · Glossary
embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
Why it matters
If capacity is not the binding constraint, then the fix for multilingual degradation is data and training rather than a larger embeddingA list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.Full definition → space, which changes where the effort goes.
articleModular Cognitive Architecture Emerges in Large Language ModelsPengrui Han, Jacob Andreas, Evelina Fedorenko, Andrea Gregor de Varda
articleChildren, but not language models, show accelerating returns in word learningMichael C. Frank
articleDiagnostic Foundation for Evaluating LLMs' Research Integrity as Co-ScientistsYash Tripathi, Silu Sharma, Sai Sidhanth Manoharan Jayanthi, Shivank Garg, Lin Li