AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
model routing — Sending each request to a model chosen by the difficulty of the task, rather than using one model for everything.
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
Shows dynamic per-task model routingSending each request to a model chosen by the difficulty of the task, rather than using one model for everything.Full definition → can cut inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → cost 20-25% while holding onto nearly all of a frontier model's task success rate, a concrete data point for cost-aware AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → design.
