➤ Leaderboard: ➤ Methodology: ➤ Stirrup, our open-source agent harness: Search A

Choosing a search API for an agent has been guesswork. This holds model and harness fixed so quality, blended cost and added latency are comparable — including how much a weaker provider costs you in extra model tokens.

• agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
• AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
• token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.

• postHiDream-O1-Video-1.0 debuts at #6 on Artificial Analysis video arena
• postHeyGen Voice tops the controlled-voice TTS arena
• post30 edits in a row: which image editing models drift
• postTrusted-access model tops Cyber Index by a wide margin

• postAnnouncing the Artificial Analysis Search Index, benchmarking how search API…Artificial Analysis
• postOpenRouter benchmarks web search tools for grounding agentsOpenRouter
• postOpenAI web search lands mid-pack on the Artificial Analysis Search IndexArtificialAnlys

Checking sign-in…

Loading comments…