- Category
- Developer Tools
- Rank
- No. 1437Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 34 stars
- Latest release
- v2.0.0-beta.18
- Date
About
warmctl is GPU checkpoint and restore for vLLM. It snapshots a warmed-up engine into an OCI image and restores it on hosts with the same GPUs and driver branch, skipping weight loading, compilation and CUDA graph capture. The README reports GLM-5.3-Flash on 8×H100 starting in 37 seconds versus 650 seconds for a vLLM cold start, which makes scale to zero and spot GPU replacement more practical.
Tags
vllmgpucheckpoint-restoreinferencecold-startoci
Tech Stack
Go
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.