inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
128GB DDR5 kits now run roughly ten times their historical low and hyperscale buyers have reportedly locked up most of 2027's DRAM output. Memory, not compute alone, is becoming the binding constraint on what you can afford to run locally.
article[AINews] "Laguna S 2.1 Released: Cheaper than Deepseek v4 Flash, Better than V4 Pro"Latent Space
podcastDylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computeDwarkesh Patel
articleHuawei Ascend Production Ramp: Die Banks, TSMC Continued Production, HBM is The BottleneckDylan Patel