Nvidia has despecced Rubin Ultra's HBM: from HBM4E 12-Hi (384GB) down to HBM4 8-Hi (192GB).
Why strip memory out of your flagship rack-scale system? Because after the latest HBM and DRAM price hikes, memory had quietly become ~40% of total capital cost of ownership.
We ran the TCO math in a recent conference keynote (1/3)🧵
The despec cuts HBM cost by >50% — even with the 2026 HBM price hike already baked in — and takes memory from ~40% to ~28% of total capital cost.
But that spend doesn't vanish. It's redirected into scale-up networking: on the NVL576 NPO SKU, scale-up triples from 4% to 12% of rack spend as optics take over rack-to-rack interconnect. (2/3)
The takeaway: despec is a symptom of the supply crunch, not weakening demand.
When the industry's largest, best-positioned buyer is stripping memory content just to manage cost and availability, pricing power sits firmly with suppliers — and the shortage is broadening, not easing. (3/3)
Memory pricing is now dictating flagship AI hardware specs, so per-accelerator capacity growth can stall even as demand rises. Cost and capacity planning should assume tighter HBM supply and supplier pricing power, not cheaper memory.
