Frontier Model Cost and Open-Weights Popularity is Driving Demand for Model Routing
Source
latent.space
Author
Richard MacManus
Date
Why it matters
model routingSending each request to a model chosen by the difficulty of the task, rather than using one model for everything.Full definition → is becoming a deployment layer of its own, and this lays out how a large deployment decides which model, or no model, handles each task.
Terms in this piece · Glossary
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
model routing — Sending each request to a model chosen by the difficulty of the task, rather than using one model for everything.
articleInside-Out AI: Rebuilding Airbnb Behind the Scenes and Across the Guest Experience
articleRunway’s WorldPrompt and the Engineering of Real-Time Worlds
articleCan Skills Learned in Games Transfer to Real-World Work?
articlePRs NOT Welcome: How Top AI Open Source Projects Are Managing Thousands of Contributors
