Frontier Model Cost and Open-Weights Popularity is Driving Demand for Model Routing
Source
Richard MacManus
Author
Richard MacManus
Published
Terms in this piece · Glossary
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
model routing — Sending each request to a model chosen by the difficulty of the task, rather than using one model for everything.
Why it matters
model routingSending each request to a model chosen by the difficulty of the task, rather than using one model for everything.Full definition → is becoming a deployment layer of its own, and this lays out how a large deployment decides which model, or no model, handles each task.
