inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
Explains a reusable pattern for sharing scarce GPU clusters between ML training and production inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → using Kubernetes' Virtual Kubelet, letting inference survive even when training claims every GPU.
