Vibeleaderboard
← All Intel
Intel / post

NVFP4 serving recipes land for Qwen 3.8 27B

Source
x.com
Date
Qwen@Alibaba_Qwen

Fresh recipes just dropped! ⚡ NVFP4 + DFlash2 for Qwen3.8-27B now in the SGLang cookbook. Thanks for the support! @sgl_project https://t.co/YbaH4LT66w

Context

Qwen's announcement points developers serving Qwen3.8-27B to recipes combining NVFP4 and DFlash2 in the SGLang cookbook. These address different parts of serving a : NVFP4 uses lower-precision numerical representations, while DFlash2 supplies a separate draft model whose proposed the main model then verifies.

The cookbook makes that combination concrete with checkpoint choices, hardware-specific settings and an eight-token DFlash2 draft configuration. Developers get a documented starting configuration for their hardware. The announcement itself does not establish one speedup that applies across different machines, workloads and serving settings.

Terms in this piece · Glossary
  • Model — A computational system that uses learned patterns to produce an output from information supplied to it.
  • Token — A piece of text, such as a word, part of a word or a punctuation mark, that a language model represents as numbers and handles as a unit.
  • quantization — Shrinking a model by storing its numbers less precisely — like rounding — so it runs faster and fits on smaller hardware, at a small quality cost.
  • attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
More from Qwen
Recommended reads
Comments

Checking sign-in…

Loading comments…