- Category
- AI Tools
- Rank
- No. 1005Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 8.0k stars
- Latest release
- v0.15.0
- Added
- Aug 19, 2026
About
A toolkit covering the path from a trained large language model to a served one: compressing it, deploying it and serving it.
Tags
llmservingdeploymentcompressioninference
Tech Stack
Python
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.