- Category
- AI Tools
- Rank
- No. 3962Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 3 stars
- Latest release
- v1.9.0
- Date
About
Shard is an open-source inference engine for running local language models, with experimental distributed execution that pools the memory of computers on a local network. It supports GGUF and PyTorch models, checks whether a model fits the available hardware, and exposes an OpenAI-compatible API.
Tags
llminferencedistributedgguflocal-aiopenai-api
Tech Stack
PythonDocker
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.