Vals AI launches independent Web Search Index benchmark
- Source
- x.com
- Date

We realized that web search wasn’t being measured correctly and we weren’t alone. Other companies have created their own benchmarks to tackle this problem, but kept running into the same issue: data contamination, realism, and answer leakage. When benchmarks measure the wrong thing, customers can't tell which search tool is best. We believe the teams building these tools deserve to have a third-party benchmark that measures the work their users actually need done. We’re excited to share that @ExaAILabs, @KeenableAI, @p0, and @tavilyai are joining us as partners on the Vals Web Search Index: one benchmark, the same settings for everyone, run independently. Check out our latest blog to learn more: 🧵

Search tool vendors have been judged by their own benchmarks. A single third-party index with identical settings lets builders compare web search providers fairly.
Checking sign-in…
Loading comments…



