Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI compute
- Source
- dwarkesh.com
- Author
- Dwarkesh Patel
- Date

Context
Money committed to AI infrastructure can precede usable computing capacity by years. SemiAnalysis CEO Dylan Patel explains in this interview that capital spending includes deposits for future power equipment and construction, alongside hardware entering service sooner. Conversely, some capacity delivered in a particular year reflects spending made earlier. That timing matters when comparing an investment announcement with a lab's ability to train models or serve customers: the announcement alone does not tell you when the machines will be available. His account frames computing supply as a sequence of commitments and deliveries whose schedules must line up.
“You sort of have this dynamic that is quite interesting in that an H100 is worth more today than it was three years ago.”
Dylan Patel
“Again, this is the most complicated machine that humans make, period, at any sort of volume.”
Dylan Patel
“You go down the supply chain, everyone’s doing X - 1. In some cases, they’re doing X ÷ 2, because they’re not AGI-pilled.”
Dylan Patel
“But in reality, he’s screwed the pooch compared to OpenAI, whose approach was, “Let’s just sign these crazy fucking deals.””
Dylan Patel
“It’s fast timelines, the US wins; long timelines, China wins.”
Dwarkesh Patel
- 00:00:00Why an H100 is worth more today than 3 years ago
- 00:24:52Nvidia secured TSMC allocation early; Google is getting squeezed
- 00:34:34ASML will be the #1 constraint for AI compute scaling by 2030
- 00:55:47Can't we just use TSMC's older fabs?
- 01:05:37When will China outscale the West in semis?
- 01:16:01The enormous incoming memory crunch
- 01:42:34Scaling power in the US will not be a problem
- 01:54:44Space GPUs aren't happening this decade
- 02:14:07Why aren't more hedge funds making the AGI trade?
- 02:18:30Will TSMC kick Apple out from N2?
- 02:24:16Robots and Taiwan risk
podcast#459 – DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI MegaclustersLex Fridman
podcastDylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028Dwarkesh Patel
videoGoogle's AI Infrastructure Chief, Amin Vahdat, on the Physics & Economics of Frontier AISequoia Capital
Checking sign-in…
Loading comments…



