ggml-org

LLM-based code completion engine from the ggml team — local-first autocomplete for editors using small models.

VS Code extension for local LLM-assisted code and text completion, powered by llama.cpp.

Cosy native macOS home for your local LLMs — manage and run llama.cpp models from a Swift app.

Vim plugin for LLM-assisted code and text completion — powered by llama.cpp under the hood, no cloud dependency.

Tensor library for machine learning in pure C with no dependencies — powers llama.cpp, whisper.cpp, and on-device LLM inference.

A C/C++ library for running large language models locally with minimal setup and optimized performance across different hardware architectures. Enables LLM inference on CPUs and GPUs with various quantization options to reduce memory usage.