NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt

AgentX measures inference the way agents actually load it — long prefill, KV-cache reuse, bursty concurrency — making it a better proxy for real serving cost than single-turn benchmarks.

• AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
• context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
• subagent — A separate agent spawned by another to do one scoped piece of work in its own context, returning only the result.
• mixture-of-experts — A model built from many specialist sub-networks where only a few activate per token, giving big-model capability at small-model running cost.

• articleLower the Cost of Building and Running Visual AI Agents with NVIDIA VSS Blueprint 3.3
• articleHow SWE-Serve Exposes the Gap Between Local Tests and Live Serving
• articleHow to Evaluate AI Agents From Tool Calls to Task Completion
• articleTurn Your Latest Observations Into Timely Weather Decisions With NVIDIA Earth-2

• articleSolving Agentic AI Fleet Challenges with NVIDIA Vera CPUMichelle Horton
• articleVera Rubin NVL72 Agentic Inference: 67x better Performance per DollarBryan Shan
• articleHow NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera RubinTanya Lenz

Checking sign-in…

Loading comments…