← All IntelClip / OtherCognition's Fusion router: delegating to implementation models
From The State of Model Routing — NVIDIA, Cognition, OpenRouter · ≈3:44
“I think actually there's this really unintuitive dynamic where smarter models actually get better and better at delegating work.”
“we're reducing the cost of Fable level intelligence by 40%.”
“even though it's cheaper because you're delegating the work to another model you can let that model go at the task with much more depth and intensity than you might otherwise.”
What’s in it
- Explains a model router that cuts Fable-level intelligence costs by 40%
- Reveals why smarter models delegate work better than dumber ones
- Shows how spinning up sub-agents beats a single model exploring code alone
Clip transcript
are getting better. Can you explain how? >> Yeah, absolutely. Um so, I also want to be be clear about something here is like, you know, we're not saying that that we gap above Fable level performance in in the same way that maybe Fable level performance gaps above other models. I think actually there's this really unintuitive dynamic where smarter models actually get better and better at delegating work. And so one of the philosophies we had with building a model router is we don't want to route people to a dumber model and then suddenly you're stuck with a model that doesn't know how to do your task. Next thing you know you're you're switching yourself back to smarter model anyways and now taking that expensive cost. And in general we think a lot of the existing model routing systems out there are probably the same ones people have been using like a year ago. And so we really wanted to put out a new framework that actually lets people still feel like and and still have a frontier model in their system while getting all these like cost benefits. So yeah we we're reducing the cost of Fable level intelligence by 40%. The way we do that is we allow Fable to still do like the planning and the the hard decision making but delegate a lot of the work to an implementation model. And the implementation model can be you know one of these open source models be it a cheaper mini model. Um the unintuitive thing is even though it's cheaper because you're delegating the work to another model you can let that model go at the task with much more depth and intensity than you might otherwise. Like you can spin off like you know three sub agents to go and like explore the code base and maybe that's actually more comprehensive than if you had just let Fable explore the code base itself. So you're actually getting this like nice trade-off where it's both more cost efficient and it's also more comprehensive overall. >> Interesting. I see. So you're saying by
Comments
Sign in to comment.
Loading comments…