Preferences Over Benchmarks: Model Routing — Archana Kamath & Tyler Gillam, DigitalOcean
Source
AI Engineer
Author
AI Engineer
Date
Terms in this piece · Glossary
mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Per-request routing held quality near a single premium model (90% vs 95%) while cutting a coding session from 25 cents to 8, and the routing model and proxy are open sourced.
