OpenRouter's Response Healing repairs malformed JSON before an application receives it. JSON is a structured text format, so a misplaced comma or missing closing bracket can prevent software from reading an otherwise useful answer. In its reported measurements from about a week of production data, success for Google's Gemini 2.0 Flash rose from 99.61% to 99.92% across 1.62 million requests, approximately an 80% reduction in syntax defects. The feature is opt-in and, as announced, covers only non-streamingSending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.Full definition → requests. It targets this parsing problem. Applications still need to check that required fields exist and their contents are correct.
Terms in this piece · Glossary
streaming — Sending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.
