text-generation-webui

About

An open-source desktop application for running local language models, covering text, vision and tool-calling. It exposes an OpenAI- and Anthropic-compatible API so existing code can point at it unchanged, and runs entirely on your own machine.