← All IntelClip / AI ToolsShopify cut cost 550x by holding the eval and swapping the model
From The Unreasonable Effectiveness of Separating the Task from the Model — Maxime Rivest & Isaac Miller · ≈9:33
A concrete production number showing the economic case for a fixed interface: model substitution becomes a search over implementations instead of a rewrite.
What’s in it
- A concrete production number showing the economic case for a fixed interface: model substitution becomes a search over implementations instead of a rewrite.
Clip transcript
massive gains. And we see two main benefits when you use the Aspire in the enterprise. First, is that your implementation becomes cheaper. When you're flexible to what the implementation is, you can use the bitter lesson to search over different solutions, find something that solves your problem cheaply. And you can use this to scale to data sizes that weren't possible with a more expensive implementation. Shopify, 550 times cheaper. They're able to do that because they went from an expensive model to a cheap model, but they could keep the same eval's, keep iterating on their business logic inside, and try new things. There's three awesome case studies here, and you should check them out after the talk. They give you a lot of details on how you can do this in your own enterprise.
Comments
Checking sign-in…
Loading comments…