AMD team is grinding hard 🚀🚀 Although, for most SLOs/open models, AMD is behind NVIDIA, we think that AMD's software will do well on agentic workloads in the near future, as AMD engineers are grinding hard using AgentX as the north star benchmark for realistic workloads!
In theoretical modelling, AMD hardware should have way better perf per dollar than NVIDIA, especially considering the level of equitable rebates it is giving to Meta & OpenAI, but AMD's software performance is currently the blocker.
Really, the main blocker is their leadership not providing the correct tools to their engineers, i.e., internal R&D GPU capacity & stable automated QA GPU clusters.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
AMD's inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → disadvantage is currently a software problem, not a hardware one. Perf-per-dollar on AMD parts may improve for agentic workloads without any new chip, which is why AgentX-style realistic benchmarks are worth watching.
articleMost Neoclouds Suck At Security OpenAI vs HuggingFace, Container Escapes,…
postSemiAnalysis on Jalapeno: OpenAI's chip, measured in tokens per megawatt
postGB300 NVL72 claimed at 7x perf-per-dollar over H200 for agentic inference
postGLM-5.3-Flash's 100T daily tokens reportedly served on Chinese chips
