Include Evaluating Multilingual Language Understanding With Regional Knowledge 2024 11 29
Source
Cohere editorial sitemap
Author
Cohere editorial sitemap
Date
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Most multilingual benchmarks are translated English, so they never test regional knowledge. INCLUDE sources questions from in-region exams instead, exposing gaps translation-based evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → hide.
articleBam Just Like That Simple And Efficient Parameter Upcycling For Mixture Of Experts 2024 08 15
articleMultilingual Arbitrage Optimizing Data Pools To Accelerate Multilingual Progress 2024 08 28
articleOne Tokenizer To Rule Them All Emergent Language Plasticity Via Multilingual Tokenizers 2025 05 30
articlePushing Mixture Of Experts To The Limit Extremely Parameter Efficient Moe For Instruction Tuning 2023 09 11
articleMeasuring the Cross-Lingual Comprehension Gap: How the language of the evidence shapes what language models understandRafael da Silva, Jeff Eicher
articleTiny Aya Bridging Scale And Multilingual Depth 2026 02 17Cohere editorial sitemap
articleElo Uncovered Robustness And Best Practices In Language Model Evaluation 2023 11 29Cohere editorial sitemap