Vibeleaderboard
← All Intel
Intel / post

Vals AI launches independent Web Search Index benchmark

Source
x.com
Date
Vals AI@ValsAI

We realized that web search wasn’t being measured correctly and we weren’t alone. Other companies have created their own benchmarks to tackle this problem, but kept running into the same issue: data contamination, realism, and answer leakage. When benchmarks measure the wrong thing, customers can't tell which search tool is best. We believe the teams building these tools deserve to have a third-party benchmark that measures the work their users actually need done. We’re excited to share that @ExaAILabs, @KeenableAI, @p0, and @tavilyai are joining us as partners on the Vals Web Search Index: one benchmark, the same settings for everyone, run independently. Check out our latest blog to learn more: 🧵

Why it matters

Search tool vendors have been judged by their own benchmarks. A single third-party index with identical settings lets builders compare web search providers fairly.

Terms in this piece · Glossary
  • benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
More from Vals AI
Recommended reads
Comments

Checking sign-in…

Loading comments…