Nvidia's Rubin data center runs hotter, cuts water use to near zero

Nvidia's Rubin generation reference design for AI data centers aims to address growing public backlash over water consumption by switching to 100% liquid cooling and running servers hotter. According to Nvidia's head of sustainability, Josh Parker, the design can cut water usage from roughly 2.6 million gallons per megawatt per year for conventional cooling-tower-based systems to 'near zero'—a reduction of up to 100%. The key innovation: servers operate at up to 113°F (45°C), with heat captured directly at the chip and transported through liquid loops at much higher temperatures. This allows outdoor dry coolers to reject heat efficiently for most of the year, regardless of ambient air temperature, reducing reliance on water-intensive evaporative cooling.

While the environmental benefit is clear—especially as communities push back against data center water use—the design doesn't fully address other concerns. Nvidia hasn't disclosed the upfront cost of building such a facility compared to traditional air-cooled data centers. And as Gizmodo notes, the company's blog post omits construction and power generation requirements, which remain significant hurdles. Nonetheless, Nvidia claims every cloud provider and data center operator building for the Rubin platform is making the transition. Amazon has similarly touted higher heat tolerances for its mostly air-cooled data centers, signaling a broader industry shift toward efficiency. The Rubin reference design represents a step forward, but the full cost-benefit picture for operators and local communities is still emerging.