- Category
- AI Tools
- Rank
- No. 3361Tools index
- Pricing
- Open Source
- Type
- TOOL
- Latest release
- v0.1.0-alpha
- Date
About
BitRun is a single-binary runner and model manager for 1.58-bit ternary LLMs such as Microsoft BitNet b1.58, running on CPU on macOS, Windows and Linux without compiling. Commands pull models from Hugging Face, run interactive chat, create custom personas from a Modelfile, and serve an OpenAI-compatible API. The README reports about 98.6 tokens per second generation for Falcon3 1B on an Apple M4 Pro, a self-reported figure.
Tags
bitnet1-bit-llmcpu-inferenceclilocal-llmopenai-compatible
Tech Stack
Go
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.