A language-model gateway moves provider selection and failure handling into a shared service between an application and its AI providers. In OpenRouter'sgateway explanation, the application uses a common request format while the gateway translates requests and can redirect them when a provider becomes unavailable. This becomes useful when several integrations would otherwise duplicate that work. The boundary is a response already in progress: if part of an answer has reached the user before the connection fails, the application still needs to handle the partial output. Rerouting a request does not automatically repair an interrupted conversation.
Terms in this piece · Glossary
guardrails — The checks around a model that block bad inputs and outputs — filters, validators, and permission rules the model itself can't override.
