Sturnus

About

Sturnus is a sidecar that exposes an OpenAI-compatible API and sends each request to whichever configured provider is currently fastest and healthy, across OpenAI, Azure OpenAI, Vertex AI and Anthropic. Slower or failing providers keep a small share of traffic that acts as a probe, so a recovered provider regains traffic without manual thresholds. It ships as a single static binary with no database or control plane, and applications only change their base URL.