Glossary · Production systems

Agent latency and cost engineering

Also: agent economics

Managing time and spend across model calls, tools, retries, and concurrency.

Agent cost is a system property, not just a token price. Context length, reasoning effort, tool latency, caching, parallelism, failed retries, and human review all contribute to the budget users experience.