Your Agent Is Wasting Tokens and You Don't Know It - Erik Hanchett, AWS

Three few-line changes that cut agent running costs without touching prompts or switching models: cache prompts, route trivial calls off the expensive model, and stop tool loops running longer than they need to.

• AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
• inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
• context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.

• videoBrains vs Hands: How to Run AI Agents Safely in Production — Viren Baraiya
• videoWe Mapped 115 Microservices for Our Coding Agents — Kamalakannan Nandagopal, Postman
• videoTurning Agent Memory Into Skills That Work — Will Lyon, Neo4j
• videoWhy We Deleted Our MCP Server and Rebuilt It — Abhi Arya, Reducto

• videoWhy coding-agent harnesses can cost more than the model promptCaleb Writes Code
• videoGive the Agent a Budget, Not a Token — Sachin Malhotra, AnthropicAI Engineer
• videoStop babysitting your agents... — Brandon Waselnuk, UnblockedAI Engineer

Checking sign-in…

Loading comments…