Is a Faster Model Actually Faster? Test the Whole Job — Morgan Suo, MiniMax
Source
youtube.com
Author
AI Engineer
Date
Why it matters
A faster model only helps if the finished job gets faster. The talk walks through inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → optimizations and how each can hide accuracy or wait-time costs, then gives a method for judging a model switch.
Terms in this piece · Glossary
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.