Vibeleaderboard
← All Intel
Intel / article

Efficient Software Factory

Source
uber.com
Author
Uber Engineering 1
Date

Context

Uber Engineering reports that some costs came from repeatedly checking whether a database query had finished. Each check consumed another model interaction and added intermediate output to the conversation. Its alternative puts submission, polling and result handling inside a script, returning a concise result to the model. In a five-query comparison run in one session, the first three small-result queries used 55% to 71% fewer through this route. The engineering report attributes those savings to removed overhead such as schema initialization, repeated polling and step-by-step reasoning rather than to the size of the answer, so the lesson is about moving predictable coordination work into code.

Terms in this piece · Glossary
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Read the source www.uber.com
More from Uber Engineering 1
Recommended reads
Comments

Checking sign-in…

Loading comments…