XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering
Source
Iman Barati, Arash Ghafouri, Behrouz Minaei-Bidgoli
Author
Iman Barati, Arash Ghafouri, Behrouz Minaei-Bidgoli
Date
Why it matters
Quantifies a failure that fully translated benchmarks hide: when retrieved passages sit in a different language or script from the question, answer F1 drops by 10 to 24 points in multi-hop retrieval.
