Vibeleaderboard
← All Intel
Intel / video

Preferences Over Benchmarks: Model Routing — Archana Kamath & Tyler Gillam, DigitalOcean

Source
youtube.com
Author
AI Engineer
Date
Why it matters

Per-request routing held quality near a single premium model (90% vs 95%) while cutting a coding session from 25 cents to 8, and the routing model and proxy are open sourced.

Terms in this piece · Glossary
  • mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
  • eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Read the source www.youtube.com
More from AI Engineer
Recommended reads
Comments

Checking sign-in…

Loading comments…