Introducing Research Eval A Benchmark For Search Augmented Llms
Source
Reka AI editorial sitemap
Author
Reka AI editorial sitemap
Date
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
Why it matters
SimpleQA is saturated for search-augmented models; this benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → replaces it with 374 realistic multi-hop questions scored against explicit requirement checklists, and current frontier systems only reach 26.7–59.1%.
articleIntroducing Research Eval A Benchmark For Search Augmented LlmsReka AI editorial sitemap
articleDeepsecBenchMalte Ubl
articleSearchAuditor: Auditing and Attributing Failures in Long-Horizon Search AgentsZhixiang Liang, Yifei Liu, Yidan Huang, Haozhe Zhao, Beichen Huang, Jiaqi Wang, Nan Duan, Qiong Cao