LoRA — A cheap way to fine-tune a model by training a small add-on layer instead of changing all of the model's weights.
mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
streaming — Sending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.
Why it matters
streamingSending a model's response token by token as it is generated, so the reader sees text immediately instead of waiting for the whole answer.Full definition → generation removes the usual pre-display safety check, so Runway built sub-500ms frame moderation with a small mixture-of-expertsA model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.Full definition → classifier; the same latency-versus-accuracy tradeoff applies to anyone shipping real-time generative output.
