llmbridge
github.com/kottos-ai/llmbridge- Category
- Developer Tools
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 3 stars
- Date
About
llmbridge is a C++ LLM gateway that sits between an application and model providers, translating OpenAI-compatible requests into the dialects of providers such as Anthropic, Gemini, and Cohere and translating the responses back. It adds only microseconds of overhead, reaching a p99 latency under 1 millisecond at 1,000 requests per second, and can run as a standalone binary or be embedded as a library.
Why it made the leaderboard
A dependency-free C++ gateway that translates OpenAI-format requests to Anthropic, Gemini, and other provider dialects with sub-millisecond overhead, useful where a Python/Node gateway's latency is unacceptable.
Tags
llm-gatewayapi-proxycppopenai-compatiblelow-latency
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.