What are the key takeaways from “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H” on Technology Now?

What is this episode about?

As AI and high-performance computing demand intensify, air cooling is obsolete, making liquid cooling essential for modern data centers. This shift, driven by performance, energy efficiency, and density, is transforming infrastructure design and operations, despite initial complexities and historical perceptions of risk.

What are the key takeaways?

• Liquid cooling offers superior thermal capacity compared to air, enabling sustained high performance for demanding chips like those used in AI and HPC. — This directly impacts the ability to run advanced workloads without thermal throttling, maximizing the return on investment for powerful hardware.
• Significant energy efficiency gains are achievable with liquid cooling, not just at the server level but more broadly across the entire data center by reducing reliance on energy-intensive air handlers. — This translates into lower operational costs and a reduced carbon footprint, addressing both economic and environmental objectives for businesses.
• The increasing thermal design power (TDP) of modern chips and the desire for higher rack density are pushing liquid cooling from a niche HPC solution to a mainstream enterprise necessity. — Enterprises must now consider liquid cooling to fully populate racks and leverage the latest powerful processors without encountering cooling limitations that leave expensive rack space underutilized.
• Despite initial perceptions of complexity and risk, liquid cooling technology has matured significantly, with robust leak detection, prevention, and isolation systems making it safe and reliable for enterprise deployment. — This addresses a major psychological barrier to adoption, indicating that the technology is ready for broader application without compromising safety or data integrity.
• The future of liquid cooling involves advancements like two-phase cooling and a greater focus on heat reuse, transforming data centers into potential energy sources for district heating systems. — These innovations promise to further enhance efficiency and sustainability, potentially turning data center waste heat into a valuable resource, especially in colder climates.

What concepts are explained?

• Direct Liquid Cooling (DLC): DLC involves circulating a liquid, such as a water-glycol mixture, directly through cold plates attached to components like CPUs and GPUs. It matters in this episode because it's presented as the essential upgrade from air cooling, capable of handling the intense heat loads of modern AI and HPC chips, enabling higher performance and density in data centers.
• Heat Reuse / District Heating: Instead of simply expelling heat into the atmosphere, liquid cooling systems make it feasible to capture this heat in a reusable format (e.g., warm water). This concept is critical for improving data center sustainability and efficiency, transforming them from pure energy consumers to potential energy contributors, especially when integrated into district heating networks.
• Two-Phase Cooling: Unlike current single-phase liquid cooling which remains a liquid, two-phase cooling leverages the latent heat of vaporization, extracting significantly more heat per unit of fluid. This is important as chip power densities continue to rise, offering a future-proof solution for thermal management when current single-phase methods reach their limits, though it adds complexity with condensers.
• Chip Density / Thermal Requirements: Modern CPUs and GPUs, especially for AI, have dramatically increased their computational power and, consequently, their thermal design power (TDP). This escalating heat output directly challenges traditional air cooling, as it limits how many powerful chips can be placed in a single rack before thermal issues arise. This concept is central to why liquid cooling is becoming essential, as it allows for much higher density and performance without overheating.
• Greenfield vs. Retrofit Data Centers: This distinction is crucial for liquid cooling adoption. Greenfield projects can integrate liquid cooling, higher power feeds (e.g., 415/480 volt), and heat reuse infrastructure from day one, optimizing costs and efficiency. Retrofitting older, air-cooled facilities (e.g., wired for 208 volt) with liquid cooling is far more complex and expensive, requiring extensive plumbing, power upgrades, and physical modifications. Understanding this helps organizations plan their liquid cooling transition strategy.

Notable quotes

“Air from a thermal capacity standpoint is much less effective than liquid cooling. So they want to run the biggest chips for long periods of time without any thermal issues.”

— Technology Now, “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H”

“Where we will likely go is to a, a two-phase cooling strategy where it enters as a liquid, turns into a gas, extracts much more heat, goes through a condenser, turns back to a liquid.”

— Technology Now, “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H”

“It is much, more energy intensive to try to move air across these servers versus very low-powered pumps that's passively pumping coolant across them.”

— Technology Now, “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H”

“But as we start thinking about different ROI metrics, well, why wouldn't we fully populate these racks, even in an enterprise application? we still have to get over that thermal hurdle.”

— Technology Now, “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H”

“We have done a lot of work in, hardening the technology, leak detection, leak prevention, leak isolation. And so all that work has been done where we do tons of technology hardening.”

— Technology Now, “Water cooling, liquid cooling, direct liquid cooling, data centre, Technology, Tech, Tech Industry, IT, ICT, Enterprise, business, organisations, companies, networking, company, AI, experts, business news, tech news, HPE, science, technology journalism, H”