NVIDIA Vera Rubin Driving Performance Per Watt, Lowest Token Cost for Partners Worldwide

NVIDIA Vera Rubin is here, and it’s going gigascale.

Vera Rubin NVL72 production is ramping up with racks running at partners CoreWeave, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure. Spanning 350-plus factory sites in 30 countries, Vera Rubin has the largest, most mature rack-scale supply chain ever assembled to meet customer compute demand.

The Vera Rubin platform is built from chip to grid to deliver the highest performance per watt and the lowest token cost. CoreWeave’s first benchmark on DeepSeek-R1 says it all: 10x more throughput per megawatt than Grace Blackwell NVL72 — landing directly on the metric that matters most for power-constrained AI factories.

Advancing Performance With Extreme Co-Design

What makes this possible is extreme co-design across seven chips and five rack trays — Vera Rubin NVL72, Vera CPU rack, Groq 3 LPX, Spectrum-6 SPX and Vera BlueField-4 STX — all engineered as a single system rather than assembled from separate off-the-shelf products. 

The NVIDIA Vera CPU is at its center. It redefines what an AI factory CPU can be. Designed and built for the agent era, its custom Olympus core delivers 2x single-threaded performance, 3x core-to-core bandwidth and 40% lower memory latency versus competing chiplet designs, making it the most efficient single-threaded CPU for the agentic workloads that matter most.  

Accelerating AI Factories With Purpose-built Networking 

For networking, the platform’s sixth-generation NVLink scale-up delivers more than 2x throughput on complex workloads, 3x lower latency and 10x higher packet rates than off-the-shelf Ethernet. For scale-out, Spectrum-X Ethernet combines 102.4T Spectrum-6 switch systems, 1.6T ConnectX-9 SuperNICs, adaptive routing, advanced congestion control, telemetry, and open operating system support, enabling 1.6x higher RDMA bandwidth than off-the-shelf Ethernet. 

The world’s leading AI infrastructure builders — including CoreWeave, Microsoft, SpaceXAI and Tesla — are among the first to bring in Spectrum-6 switches to accelerate their AI factories. NVIDIA Photonics with co-packaged optics for scale-out — the industry’s first such switch in volume manufacturing — adds 5x lower power and 10x higher MTBI versus pluggable transceivers, with CoreWeave, Lambda and OCI among the first adopters. 

Spectrum-XGS Ethernet extends performance across sites with 1.9x multi-site throughput because gigascale AI isn’t a single building problem. 

And NVLink Fusion opens the NVIDIA infrastructure platform to third-party XPUs, giving partners a faster path to market on the proven NVLink scale-up stack and ecosystem.

Saving Setup Time, Water 

NVIDIA’s three generations of rack-scale co-design produced a Vera Rubin NVL72 system with no cables, fans or hoses in the tray, cutting compute tray assembly time from hours to one minute. 

A 45-degree Celsius liquid cooling inlet temperature design enables chiller-free dry-cooler operation. For new AI factories, this higher temperature dry cooling along with the closed-loop liquid cooling system saves millions of gallons of water per megawatt annually.

---

Tuesday, July 21, 8:00 a.m. PT

NVIDIA Vera Rubin Powers Europe’s Open-Model Era

Vera Rubin is delivering next-generation performance to Europe’s AI infrastructure.

It’s the foundation for a newly expanded Microsoft and Mistral partnership that brings frontier AI to the region, combining open European models with cloud and customer-controlled environments so governments and regulated industries can adopt it on their own terms.

Underpinning the partnership is a new multibillion-dollar agreement focused on expanding AI infrastructure in Europe. Mistral is adding its GPU capacity, drawing on thousands of the latest NVIDIA Vera Rubin GPUs to increase AI compute availability for customers and provide a shared platform for training, inference and large-scale deployment.

NVIDIA Vera Rubin is ramping into full production.The rack-scale AI supercomputer unifies seven new chips co-designed as one system, and it will power the next generation of Mistral Compute and Microsoft’s European AI infrastructure, drawing on tens of thousands of GPUs.

Europe wants the world’s most capable AI, running under its own laws, close to home, and fully within its control. And the bar keeps rising: agentic systems can consume up to 15x more tokens than traditional AI applications, making efficient infrastructure a strategic priority. Meeting that expectation takes more than computing capacity: AI that scales efficiently while satisfying regional requirements for data control, governance, resilience and strategic autonomy.

Vera Rubin provides the computing foundation for Europe’s open-model ecosystem. Its full-stack architecture combines accelerated computing, networking and software so models and agents run efficiently from training through production. 

Open Models Built for Enterprise AI

Together Microsoft, Mistral and NVIDIA are delivering sovereign-ready AI across public cloud, cloud-connected and fully disconnected private cloud environments — pairing the flexibility of open models with the infrastructure required to operate them at scale.

Mistral Medium 3.5 and OCR 4 are now available in Microsoft Foundry, and Mistral models are integrated into Microsoft Copilot Studio. Through Azure Local and Foundry Local, customers can use the same models, tools and operating patterns across cloud and customer-controlled environments

AI on Europe’s terms

Government agencies can apply AI to sensitive workflows. Healthcare and financial services organizations can deploy within regional requirements. Manufacturers can process data on site for faster decisions. Compared with NVIDIA GB200 NVL72, Vera Rubin NVL72 delivers up to 10x more tokens per megawatt and one-tenth the cost per million tokens, providing more intelligence within the same power footprint.

Sovereign AI should not force organizations to choose among innovation, economics and control. With Vera Rubin as the computing foundation — and Microsoft and Mistral delivering sovereign cloud infrastructure and open European models — Europe can pursue all three.

Read the Microsoft and Mistral press release for more details.

---

Tuesday, July 21, 8:00 a.m. PT

NVIDIA Vera Rubin NVL72 on CoreWeave Demonstrates 10x More Tokens Per Megawatt Than Blackwell in Benchmark

Embracing extreme co-design with NVIDIA, Coreweave is delivering an order of magnitude performance leap on Vera Rubin NVL72. 

Close collaboration with partners like CoreWeave is mission-critical to bringing up a new generation of NVIDIA accelerated computing into AI factories. 

After months of co-engineering work, CoreWeave became the first AI cloud to bring up and validate Vera Rubin NVL72 — and it is now sharing the first measured performance numbers from live hardware.

CoreWeave ran a DeepSeek-R1 benchmark on Vera Rubin NVL72 and saw 10x improvement in tokens per second per megawatt compared with Grace Blackwell NVL72. 

Tokens per megawatt is the metric that determines whether AI infrastructure can profitably scale. More tokens per megawatt means more intelligence from the same power budget, or the same workload on significantly less power. AI labs and enterprises such as Jane Street will use the Vera Rubin platform to scale its AI factories on the CoreWeave cloud.   

Beating Bottlenecks With NVIDIA Spectrum-X

DeepSeek R1’s MoE architecture makes all-to-all GPU communication a critical requirement at scale: Each token must be routed across distributed expert sub-networks. Vera Rubin NVL72’s 260 TB/s all-to-all NVLink 6 fabric removes that constraint, enabling the rack to behave as a single unified accelerator. 

CoreWeave is among the first to deploy the NVIDIA Spectrum-X Ethernet SN6600-LD as the switching fabric for Vera Rubin NVL72. 

Built on the 102.4 Tb/s Spectrum-6 switch chip and featuring a liquid-cooled design, CoreWeave deploys dense switching racks, delivering 1.64 Pb/s per rack with 100% more capacity than previous generation air-cooled switches. CoreWeave also provides a fully non-blocking, multi-plane, multi-rail spine and leaf fabric connecting Vera Rubin NVL72 GPUs without oversubscription.

---

Tuesday, July 21, 8:00 a.m. PT

NVIDIA Vera Rubin NVL72 Drives New Google Cloud A5X Instance for Ineffable Intelligence

NVIDIA Vera Rubin NVL72 is powering Google Cloud’s first A5X instance, now up and running for London startup Ineffable Intelligence.

Ineffable Intelligence develops a new generation of intelligent “superlearner” systems that continuously learn through experience to discover new breakthroughs across all fields.

Ineffable Intelligence’s agents learn directly from interaction with their environments, rather than from static datasets. Instead of using large language models, Ineffable is developing “superlearner” systems through reinforcement learning, generating experience across continuously simulated, massively parallel environments and rapidly translating that experience into policy updates and evaluation. These tightly coupled learning loops place exceptional demands on compute, memory bandwidth and interconnect, requiring infrastructure that can operate at enormous scale with extremely low latency.

“The next era of research requires the next era of hardware,” said Lasse Espeholt, co-founder of Ineffable Intelligence. “We feel privileged to work with the teams at NVIDIA and Google Cloud, who were able to grant us early access to Vera Rubin. The support across both teams has been unmatched; we were up and running almost immediately and are already testing infra for our superlearners.”

NVIDIA Vera Rubin NVL72 is designed for this kind of agentic training, delivering predictable latency, high utilization and significantly more intelligence per dollar than previous generation systems, making it a natural platform choice for large-scale reinforcement learning.

Google Cloud A5X instances, announced at Google Cloud Next, are bare-metal instances built on NVIDIA Vera Rubin NVL72 rack-scale systems, delivering up to 10x lower inference cost per token and 10x higher token throughput per megawatt than the prior generation. 

A5X uses NVIDIA ConnectX‑9 SuperNICs combined with next-generation Google Virgo networking, enabling clusters that can scale to tens of thousands of NVIDIA Rubin GPUs within a single site and up to nearly a million GPUs across multisite configurations, giving customers a unified, AI‑optimized stack for training, tuning and serving frontier, open, agentic and physical AI models while optimizing for performance, cost and sustainability.

This infrastructure is designed to help unlock the next generation of reinforcement learning systems for breakthroughs in superlearning and superintelligence.

---

Tuesday, July 21, 8:00 a.m. PT

NVIDIA Vera CPU Doubles Orchestration Speed for DeepInfra AI Cloud

Benchmark results from DeepInfra show that the NVIDIA Vera CPU is more than twice as fast and can support more concurrent AI agents compared with other CPUs.

Cloud platform DeepInfra, an early access participant in the NVIDIA open AI ecosystem, independently designed and ran benchmarks using its production AI agent infrastructure. DeepInfra processes nearly five trillion tokens a week, with about 30% driven by agentic systems. Its cloud platform is built for high-throughput AI inference. 

The benchmarks demonstrate support for up to 1.6x more concurrent AI agents at the same quality of service and up to 2.2x faster orchestration than alternative CPUs, while improving infrastructure utilization and cost efficiency. These results show that the NVIDIA Vera CPU delivers the cost efficiency, low latency and throughput that production agentic AI demands.

As AI agents take on more complex reasoning, planning, tool use and data movement, CPU performance has become increasingly important for orchestrating work around each model call. 

Part of NVIDIA’s extreme co-design approach to AI factories, the Vera CPU is built for agentic workloads. DeepInfra’s benchmark highlights how the NVIDIA Vera CPU helps cloud providers improve infrastructure utilization, increase cost efficiency and support more concurrent AI agents at the same quality of service.

Learn more about the NVIDIA Vera Rubin platform.