Vibeleaderboard
← All Intel
Intel / article

Let Me Droid That For You: What 780K Agent Searches Reveal

Source
factory.ai
Date

Context

Factory's analysis of its own 's web activity suggests that documentation lookup is a large part of what Droid searches for. The company examined 780,000 calls to Droid's web-search and page-fetch tools and used Droid to classify a sample of 10,000 queries. It reports that learning and documentation material made up 40% of queries, with API references another 14%. Search analysis.

The logs record only call parameters, search queries and URLs, with session and user identifiers removed. That supports describing what information the agent sought, but cannot establish whether a retrieved page resolved the user's problem. Only a sample was classified, and the percentages come from Factory's own classification, so they describe Droid's two tools in this product rather than demand across the wider web. Dataset and methodology.

Terms in this piece · Glossary
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
Recommended reads
Comments

Checking sign-in…

Loading comments…