- Category
- AI Tools
- Rank
- No. 927Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 32.1k stars
- Latest release
- v0.5.17
- Added
- Aug 19, 2026
About
A high-performance serving framework for large language and multimodal models. It targets throughput and latency for self-hosted deployments rather than single-machine desktop use.
Tags
llmservinginferencemultimodalself-hosted
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.