llm-gauze

About

An HTTP gateway that sits in front of a local LLM served through an OpenAI-compatible API and works around its failures. It handles transient errors without retries, hung or looping models, empty or sloppy responses, context-window overflows, runaway reasoning and malformed tool calls. It logs every exchange and fixes what it can before the client sees the response.