inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
If you route inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → through a marketplace, the provider you land on and how honestly it caches determine both your bill and your latency.
