Cost Vs Quality Tradeoff Framework For Agent Models

The cheapest suitable model is the one that meets a task's quality and response-time requirements at the lowest measured cost. OpenRouter's selection framework starts by defining those requirements, then compares candidates on the same real application examples and grading rules. It recommends leaving room above the minimum score based on variation observed across repeated runs. This makes a marginal pass less likely to determine the choice. Its worked price-and-quality tables illustrate the method; their quality scores are hypothetical.