streaming — Sending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
Why it matters
streamingSending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.Full definition →LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → output re-renders half-formed Markdown as raw text and stalls behind multi-hop tool calls; selective buffering plus a multiplexed event stream fixes both without waiting for the full response.
