Why would anyone pay for that much compute? Inference is unbelievably profitable

If inference margins are anywhere near this wide, compute supply rather than demand sets what models cost and whether you can get capacity — and the gigawatts landing in 2027 determine what you'll be able to run.

• inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.

• postOpen models are eating easy tasks. Do frontier labs outgrow it?
• postSemiAnalysis: a $200 Claude plan can return $12,000 in API-priced tokens
• postWhy a subscription plan has no fixed API-equivalent value
• postAI is flooding ML conferences with papers faster than reviewers can scale

• articleSpaceX 10GW in 2027 – Why It’s Real, Will Drive $300B ARR for SpaceX, and Why Microsoft Will Be the Largest OfftakerJeremie Eliahou Ontiveros
• podcastWhy Smarter AI Models Could Drive Up Compute Prices 10xDwarkesh Patel
• postElon shocked the world again on SpaceX's first earnings call: 6-8GW of incrementSemiAnalysis_

Checking sign-in…

Loading comments…