inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
sglang v0.5.19 adds day-one serving support for a wide slate of new open models across autoregressive and diffusion architectures, directly expanding which models teams can self-host and serve in production.
