H100 vs GB200 NVL72 Training Benchmarks – Power, TCO, and Reliability Analysis, Software Improvement Over Time
Source
semianalysis.com
Author
Dylan Patel
Date
Why it matters
Nvidia's generational claims collapse once downtime and lost engineering time enter the math; these are measured MFU and cost-per-tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → figures across cluster scales and software versions you can reason about directly.
Terms in this piece · Glossary
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
