The most counterintuitive innovation in AI infrastructure is not a faster chip — it is hotter water. NVIDIA's new Rubin architecture data centers use coolant at 45°C (113°F), turning conventional cooling wisdom upside down.
For decades, data center operators operated on a simple rule: colder is safer. Server rooms were kept at Arctic temperatures, with massive air conditioning systems running around the clock. But AI chips generate enormous heat — a single NVIDIA GPU rack can draw 100 kW or more — and conventional air cooling has reached its physical limits.
NVIDIA's Vera Rubin platform, now in full production, introduces a closed-loop liquid cooling system that operates at a 45°C inlet temperature. This is significantly warmer than the 20–25°C water used in traditional data center cooling loops. The key insight is that as long as the coolant stays below the silicon's junction temperature — typically 85–105°C — the chips run fine. Running hotter coolant means the data center does not need energy-hungry chillers. Instead, dry coolers (essentially large radiators with fans) are sufficient to dissipate the heat.
Traditional evaporative cooling systems consume millions of gallons of water per year through evaporation. NVIDIA's closed-loop, chiller-free design eliminates almost all of that water loss. According to the company, the new system saves millions of gallons of water per megawatt of IT load annually. At a time when AI data centers face growing scrutiny over their water footprint — some estimates suggest global AI data center water consumption could reach billions of gallons per year by 2027 — this represents a step change in sustainability.
The Rubin architecture uses cold plates mounted directly on the GPU and CPU packages. Water flows through microchannels in these plates, picking up heat and carrying it to a heat exchanger. Because the water leaves the cold plates at roughly 55°C, it can be cooled by ambient air using dry coolers in most climates. Only in extreme heat do the fans need to spin faster. The system also eliminates server fans entirely — the liquid handles all heat removal, reducing data center energy consumption by an estimated 15–20% compared to air-cooled equivalents.
Amazon has already announced similar higher-temperature cooling targets for its next-generation data centers. The shift from "cold is safe" to "warm is efficient" is quietly reshaping how the world's largest AI infrastructure projects are designed. For every megawatt of IT load, thousands of tons of CO₂-equivalent emissions from cooling and millions of gallons of water can be saved — a rare win for both performance and the planet.
Key facts: (1) NVIDIA's Rubin data centers use 45°C (113°F) liquid coolant, hotter than a typical hot tub (40°C). (2) The closed-loop design eliminates traditional chillers and saves millions of gallons of water per megawatt annually. (3) The system also removes server fans entirely, reducing total data center energy use by 15–20% over air-cooled designs.