🚀 Hy4 preview is here.
770B, 49B active, 1M context.
Built for productivity.
Open source frontier.
Consistent affordable price.
Use it. Tell us what breaks.
More on Hy blog：https://t.co/rbl1IWRk3C
HuggingFace：https://t.co/mE9wevH5XR
Github：https://t.co/pyl9zckpoL
We compressed Hy4-preview from 1.5TB to ～200GiB GGUF and it still works well !
Meet MIX-STQ1_0.The trick isn’t just going low, it’s deciding where: calibration data picks each layer’s bit-width, some down to 1.31-bit STQ1_0, some up to 2.06-bit IQ2_XXS. Same budget, lower error.
Accuracy barely moves vs BF16
📊 MCP Atlas 83.7→83.2
📊 SWE-Bench multi 82.9→81.3
📊 MRCR 81.3→81.1
📊 IFBench 73.5→72.5
See the details on HF : AngelSlim/Hy4-preview-GGUF
Weights & low-bit GGUFs 👇
https://t.co/9uM9NT9Wem
#LLM #Quantization #llamacpp #Hy
mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.
calibration — How well a model's confidence matches reality — a calibrated model saying "90% sure" is right about 90% of the time.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
SWE-bench — The standard benchmark for AI coding agents: real GitHub issues from real repositories, scored by whether the agent's patch passes the project's own tests.
Why it matters
An open-weight 770B/49B-active mixture-of-expertsA model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.Full definition → with a 1M context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition →, the MIX-STQ1_0 GGUF fits in roughly 200GiB with SWE-benchThe standard benchmark for AI coding agents: real GitHub issues from real repositories, scored by whether the agent's patch passes the project's own tests.Full definition → multi falling only from 82.9 to 81.3, putting frontier-scale weights on hardware you can actually rent.
