POWER OF CUDA MOAT ALERT🚨: 2 days after CUDA vLLM supported DeepSeekv4.1 Flash, AMD finally publicly released its DeepSeek v4.1 Flash image. Functionally, it works out of the box, but performance-wise, it is currently up to 14.8x worse perf per dollar than H200 and up to 42x worse perf per dollar than B200/B300 currently.
The 🚀 POWER OF THE CUDA MOAT 🚀 is that NVIDIA's collaboration with its massive 6 million-developer community ecosystem means that CUDA is optimized on day 0. As AMD Anush said, "Speed is the Moat," and day 0 model support shows CUDA is the speed.
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
It gives concrete numbers on how far AMD's inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → stack still lags NVIDIA on day-one model support, which matters for anyone choosing hardware for serving new open models cheaply.
