Vibeleaderboard
Index / tool
Visit github.com
Category
AI Tools
Rank
No. 3962Tools index
Pricing
Open Source
Type
TOOL
GitHub
3 stars
Latest release
v1.9.0
Date

About

Shard is an open-source inference engine for running local language models, with experimental distributed execution that pools the memory of computers on a local network. It supports GGUF and PyTorch models, checks whether a model fits the available hardware, and exposes an OpenAI-compatible API.

Tags

llminferencedistributedgguflocal-aiopenai-api

Tech Stack

PythonDocker

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.