If you use structured outputForcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.Full definition → with the OpenAI or Azure Responses API in non-streamingSending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.Full definition → mode, upgrading fixes parse failures when several assistant messages contain JSON.
Terms in this piece · Glossary
streaming — Sending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.
structured output — Forcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.
