rvLLM Serverless
github.com/instructkr/rvllm-serverless- Category
- AI Tools
- Pricing
- Open Source
- Type
- TOOL
- Builder
- instructkr
- GitHub
- 40 stars
- Added
- May 22, 2026
About
Lightweight, instant-startup vLLM replacement for RunPod serverless environments — cold-start in seconds instead of minutes.
Why it made the leaderboard
Lightweight vLLM replacement built for RunPod serverless — cold-starts in seconds instead of minutes, so scale-to-zero inference endpoints stop punishing the first request.
Tags
vllmserverlessrunpodinferenceinstructkr
Tech Stack
Docker
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.