Tag Archives: Air Cooling

Hybrid Cooling: Air and Liquid Double-Team Heat in Data Centers

Much of the focus on data centers is on their very high power and cooling demands and the impact those demands have on local electrical grids and water supplies. Water is needed for thermally managing the hot-running processors, especially GPUs, at the heart of AI data center computing. Many other essential components also require cooling, but at lower levels, allowing them to be cooled using forced air.

This is why hybrid cooling, using both liquid and air methods, is an effective way to keep hot data center components within their operating temperature ranges. Hybrid cooling enables a more balanced, incremental approach to managing different types of heat loads efficiently. Liquid cooling handles concentrated heat loads, while airflow manages the remaining thermal load.

Figure 1 – Hybrid Air and Liquid Cooling Systems on a Data Center Server [2]

Forced air cools lower power components using heat sinks and air from fans and blowers. But traditional air cooling becomes inefficient as board and component densities climb, and power levels increase, justifying the need for high capacity air cooling that is not necessarily a larger fan of heat sink.  

Liquid cooling is provided by continuously circulating liquid coolant across the hot modules, drawing their heat away. While air cooling is provided by rows of fans, liquid cooling is a complex system of tubing and connectors, coolant distribution units (CDUs), cold plates, and coolants. [3]

Data Center Applications

Let’s look at hybrid cooling inside a typical server in an AI data center, where it can be one of thousands of servers running in tightly and precisely arranged rows of cabinets. Both air and liquid cooling play essential roles in thermally managing the many powered components.

Air Cooling

Server cases are explicitly designed to function as wind tunnels. Server airflow is generated by internal fans that create air pressure. Typically, these are high-static-pressure, counter-rotating fans that produce cooling airflow passing over and around motherboards and hot components. Fan pressure pushes heated air out of the server while drawing cool air in from outside. [4]

At the component level, air-cooling designs rely on conduction to move heat from a chip to a metal heat sink, followed by forced convection driven by high-static-pressure fans to carry the heat away.

Figure 2 – Fans Pull Air In and Across the Board. Warmed Air Exhausts Out the Back, e.g., into a Hot Aisle. [4]

Some commonly air-cooled components include:

  • Memory (DIMMs / DDR5): Cooled via linear front-to-back airflow channels passing across the motherboard.
  • Networking (NICs / SmartNICs / OCP 3.0 cards): Low-to-moderate-power PCIe or OCP networking modules.
  • Storage (NVMe / SSDs): Front-accessible U.2/U.3 or E1.S drives.
  • Power Supply Units (PSUs): Integrated hot-swap power supply modules equipped with their own independent, self-contained fans.
  • CPUs: Some lower-power CPUs can be air-cooled using low-profile fan-sinks or vapor-chamber heat sinks. [5]

In standard 1U and 2U multi-node enterprise server racks, CPUs and other components are almost always cooled passively using aluminum or copper block heat sinks that rely entirely on the high-RPM chassis fans located at the front of the server case.

Despite its broad applicability, air cooling is typically used for less than 20 kilowatts (kW) per rack in conventional designs, although it can reach 35 kW in exceptional cases. Anything beyond that typically requires liquid cooling. [6] Of course, the selection of a cooling system is governed by device junction temperature rather than total wattage.

Liquid Cooling

Liquid cooling systems circulate coolant through a network of tubing, absorbing heat from hot components, most notably high-power GPUs, many of which operate at 1,000 W.

Figure 3 – Liquid Cooling on a Data Center GPU. [7]

In data center servers, liquid cooling primarily targets ultra-high-heat-producing processors, specifically GPUs and CPUs, using direct-to-chip cold plates. In some advanced high-density 1U designs, liquid loops also extend coverage to adjacent high-power components.

Some commonly liquid-cooled components include:

  • GPUs / Accelerators: The core AI training and inference engines that generate the vast majority of server heat.
  • CPUs: Host processors that manage system instructions and data pipeline feeds to accelerators.
  • Network/AI Switches & Co-processors: Specialized fabric chips, such as NVSwitches, mounted on the board to link multiple processors at high speeds. [8]

Figure 4 – A Hybrid-Cooled 1U Rack Mount Server Chassis by Titan Rig includes 490W Cooling Capacity. A Powerfan Hub Bundle Provides Air-Cooling for Lower Power Components. [9]

Power of Two

Hybrid cars combine gas engines and electric motors to improve fuel efficiency. Similarly, hybrid cooling in data center servers combines air and liquid systems for greater thermal-management efficiency. Air cooling manages ambient and lower-density heat loads, typically up to 35 kW per server board. Liquid cooling targets high-intensity heat directly at the component level, such as CPUs and GPUs. Both systems operate simultaneously, reducing the thermal burden placed on either system alone.

Figure 5 – Liquid Cooling from ZutaCore Closely Neighbors an Air Cooling Heat Sink on a Server Board. [3]

Data center cooling isn’t only about installing fans and circulating coolant. Strategic design combined with optimization is crucial for ensuring that data center infrastructure and components operate at their best. This approach not only prevents devices from overheating but also maximizes the efficient use of data center resources, including power and cooling systems.

While this post focuses on component cooling within servers, data centers also have other thermal-management systems. In particular, their HVAC systems deliver chilled airflow to targeted areas within the facility. By optimizing airflow through vents and barriers, data centers can minimize areas of stagnant air. Configuring server racks in alternating hot- and cold-aisle rows maximizes efficiency by ensuring that cooled air is delivered where it is needed most while preventing hot and cold air from mixing.

References

  1. Top Image https://www.gigabyte.com/Enterprise/GPU-Server/G262-ZL0-rev-G00
  2. Tech Stories, https://www.techstories.co/liquid-cooling-leak-destroys-millions-of-dollars-in-gpus/
  3. Chatsworth, https://www.chatsworth.com/en-us/resources/blogs/2026/what-is-hybrid-cooling-a-smarter-approach-to-data-center-thermal-design/
  4. EziBlank, https://eziblank.com/blog/2022/11/29/how-airflow-works-inside-of-a-server/
  5. Cooltron, https://www.cooltron.com/news/thermal-engineer’s-guide-to-choosing-ai-server-cooling-fans-2078026334647910402
  6. Digital Reality, https://www.digitalrealty.com/resources/blog/future-of-data-center-cooling
  7. Jetcool, https://jetcool.com/post/what-is-direct-liquid-cooling-for-ai-data-centers/
  8. Solidigm, https://www.solidigm.com/products/technology/liquid-cooling-basics.html
  9. Titan Rig, https://www.titanrig.com/1u-liquid-cooled-rack-mount-server-chassis-with-490w-cooling-capacity-xpx-pro-cpu-water-block-es-guardian-powerfan-hub-bundle.html

Making the Change

Air cooling was once the dominant method for cooling processors on a PCB, employing heat sinks, fans, and blowers. These solutions are still popular, but faster-running, higher-powered devices, like most GPUs used for AI can’t be sufficiently cooled with air. Liquid cooling is needed. [1,7]

There isn’t a universal application point where engineers must switch from air cooling to liquid cooling. The decision mainly depends on allowable temperature and heat flux. Other considerations include higher costs and power needs, added hardware, space and weight, and required more monitoring. [1,3]

Fig 1 – Air Cooling Heat Sink vs. Liquid Cooling. [9,10]

In practice, once devices reach several hundred watts in a compact package, or when the required thermal resistance approaches 0.1°C/W or lower, liquid cooling often becomes the preferred solution.

Low Thermal Resistance

Engineers usually don’t switch to liquid cooling simply because a chip reaches a particular wattage. They switch when the required junction-to-ambient thermal resistance falls below what can be achieved economically and reliably with available airflow and heat sink models. [2,3,5]

Fig 2 – Typical Chip Temperature Location [11]

Consider an equation and example:

Tj = Tα+ P x RαJA                              [2]

Where:

Tj = junction temperature

Tα = ambient temperature

P = power dissipation

RαJA = thermal resistance from junction to ambient

If keeping the chip within its temperature limits requires an unrealistically low thermal resistance, air cooling may not be practical.

Example:

Ambient = 40°C

Maximum junction temp = 90°C

Chip power = 500 W

The allowable thermal resistance is:

RαJA = 90 – 40 /500 = 0.1°C/W

Achieving 0.1°C/W with air is extremely difficult. Liquid cooling is the practical solution. [2,3]

High Heat Flux

Heat flux (power per unit area) is often more important than total power. [3]

For example:

  • A 100 W device spread onto a large heat sink may be easy to air-cool
  • A 100 W device concentrated in a 1 cm² die can be much harder

Modern high-performance processors, GPUs, laser diodes, RF power amplifiers, and power electronics often reach heat fluxes that make air cooling difficult.

Fig 3 – Heat Flux Measures the Amount of Heat Energy Transferred from a Warmer Side to a Cooler Side. [12]

Typical industry guidance suggests:

  • Air cooling: comfortable below ~10–20 W/cm² [1,6]
  • Advanced air cooling: can sometimes handle 50–100 W/cm² with aggressive airflow [1,6]
  • Liquid cooling: often becomes attractive above ~100 W/cm² [1,6,7]

In basic terms:

  • Air cooling is usually limited by how much heat you can transfer from the heat sink to the air.
  • Liquid cooling is usually limited by how much heat you can get from the chip into the coolant.

Where Air Cooling Works Well

Fig 4 – Heat Sinks from Advanced Thermal Solutions, Inc. [9]

  • Total heat dissipation is relatively modest, up to a few hundred watts
  • There is enough surface area for heat sinks
  • There is sufficient airflow through the enclosure
  • Higher fan noise is acceptable  [1,3]

Air cooling is used in many consumer electronics products and networking devices.

Coolants Remove More Heat

Since water-based coolants have much higher heat capacity and thermal conductivity than air, they can transport large amounts of heat away with relatively small temperature rises. [3,9]

For example:

  • Air’s specific heat capacity is about 1 kJ/kg·K 
  • Water’s is about 4.2 kJ/kg·K   

And water is about 830 times denser than air, so a small coolant flow can carry away an enormous amount of heat compared with an equivalent volume flow of air. [9]

Fig 5 – Tubing and Ports on a Liquid Cooling System [9]

That’s why modern AI accelerators, high-power motor drives, and high-density data-center servers are increasingly moving toward liquid cooling: not because air cooling is impossible, but because the required heat removal density becomes impractical with fans and heat sinks alone. [1,7,8]

The Benefits of Faster Flow Rates

Air cooling performance increases when the rate of airflow increases. Thus, many heat sinks are supported with fans and blowers to enhance heat transfer into the passing air. [3]

Liquid cooling, similarly, is enhanced with higher flow rates. A common expectation is that a coolant that stays longer at the heat source (chip) will absorb more heat. But, at slower flow rates, the coolant heats up as it moves through a cold plate and downstream in the cooling loop. As a result, the returning coolant has less of a temperature difference from the chip, and heat transfer becomes less effective. [3,4]

With a faster flow of liquid coolant, the fluid temperature stays more uniform and keeps a steady, higher temperature difference from the chip. This makes heat extraction more efficient and improves the lowering of chip temperatures. [3,4]

Flow rates can be optimized per application. There are diminishing returns on performance as flow rates increase, as well as added costs. Your liquid cooling system provider should provide performance data and recommendations for proper flow rates. [3,4]

In-Between Air and Liquid Cooling

There are options that fall between air and liquid cooling methods. Engineers should look through these choices before designing in a liquid system. They could provide simpler, lower-cost, but reliably effective cooling       

The expanded options include:

  1. Better PCB thermal design (thermal vias, thicker copper planes)
  2. Larger heat sinks
  3. Forced-air cooling with optimized airflow paths
  4. Heat pipes or vapor chambers to spread heat
  5. Remote heat exchangers connected by heat pipes
  6. Liquid cold plates       [3,4]

Fig 6 – Heat Pipes May Meet Cooling Needs in Place of Air or Liquid Cooling [9]

Not a Tradeoff

Traditional air cooling is inadequate for many of today’s thermal management needs. Other methods, including enhanced air cooling  systems, may offer solutions. But for many applications, including fast-growing AI units and data centers, liquid cooling is essential. In this case, there is no tradeoff because its use is the only option. [1,6,7]

Consider This

Here are some analogies for comparing air to liquid (water) cooling:

Air is a ghost. Because air is so light and empty, a single cubic meter of it can only grab a tiny handful of heat before it gets too hot and gives up.

Water is a sponge. Because water is about 830 times denser and packed tight with mass, that same one cubic meter acts like a massive thermal sponge. It can swallow up a staggering amount of heat before its temperature rises even a single degree.

To cool a hot system, you either have to blow a hurricane of lightweight air past it, or gently glide a tiny, heavy stream of water over it.

References

  1. ASHRAE. Thermal Guidelines for Data Processing Environments, latest edition.
  2. JEDEC Solid State Technology Association. JESD51 Series: Methodology for the Thermal Measurement of Component Packages.
  3. Frank P. Incropera, David P. DeWitt, Theodore L. Bergman, and Adrienne S. Lavine. Fundamentals of Heat and Mass Transfer, Wiley.
  4. David A. Reay, Ryan McGlen, and Peter Kew. Heat Pipes: Theory, Design and Applications.
  5. Texas Instruments. Thermal Design by Insight, Not Hindsight (Application Report).
  6. Open Compute Project Foundation. Advanced Cooling Solutions documentation.
  7. NVIDIA. Data Center Liquid Cooling technical papers and deployment guides.
  8. National Institute of Standards and Technology (NIST). Thermophysical Properties of Fluids Database.
  9. Advanced Thermal Solutions, Inc., https://www.qats.com
  10. Chatsworth Products, https://www.chatsworth.com/en-us/resources/blogs/2026/5-misunderstood-facts-about-direct-to-chip-liquid-cooling/
  11. Advanced Thermal Solutions, Inc, https://www.qats.com/
  12. EngineerExcel, https://engineerexcel.com/flow-of-heat/