Skip to main content
U.S. flag

An official website of the United States government

Here’s how you know

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

HTTPS

Secure .gov websites use HTTPS
A lock (LockA locked padlock) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

ENERGY STAR
Utility Navigation
  • About
  • For Partners
Main navigation
  • Find Products
    • Product Finder
    • Rebate Finder
    • Ask the Experts
    • Product Specification Search
    • Best Value Finder
    • Frequently Asked Questions
  • Save at Home
    • Heat & Cool Efficiently
    • Seal and Insulate
    • Expert Home Improvements
  • New Homes
    • Find a Builder
    • Homeowner Benefits
    • Join as a Partner
    • Program Requirements
    • Residential Resources
    • § 45L Builder Tax Credit
    • ENERGY STAR NextGen
    • About Us
  • Commercial Buildings
    • Benchmark
    • Save Energy
    • Earn Recognition
    • Resources by Audience
    • Resources by Topic
    • Training
    • About Us
  • Industrial Plants
    • Industrial Partnership
    • Industrial Assistance Network
    • Plant Certification
    • Challenge for Industry
    • Industries in Focus
    • Treasure Hunt
    • Get started with ENERGY STAR
    • Program Administrators
    • Service & Product Providers
    • Decarbonizing Industry
Breadcrumb
  1. Home
  2. Energy Efficient Products
  3. Data Center Equipment
  4. 16 More Ways To Cut Energy Waste In The Data Center
  5. Install In-rack or In-row Cooling

AIR CLEANERS

AIR-SOURCE HEAT PUMPS

AUDIO/VIDEO

BOILERS

CEILING FANS

CENTRAL AIR CONDITIONER

CLOTHES DRYERS

CLOTHES WASHERS

COMMERCIAL BOILERS

COMMERCIAL CLOTHES WASHERS

Commercial Food Service Equipment

COMMERCIAL WATER HEATERS

COMPUTERS

DECORATIVE LIGHT STRINGS

DEHUMIDIFIERS

DATA CENTER STORAGE

DATA CENTERS

DIGITAL MEDIA PLAYER

Data Center Equipment

  • Embedded Data Centers
  • 5 Simple Ways to Avoid Energy Waste in Your Data Center
  • 16 More Ways to Cut Energy Waste in the Data Center
    • Consolidate Lightly-utilized Servers
    • Implement Efficient Data Storage Measures
    • Utilize Built-in Server Power Management Features
    • Reduce Energy Losses from Power Distribution Units (PDUs)
    • Reduce Energy Loss from Uninterruptible Power Supply Systems
    • Manage Airflow for Cooling Efficiency
    • Move to a Hot Aisle/Cold Aisle Layout
    • Utilize Containment/Enclosures
    • Consider Water Side Economizers
    • Install In-rack or In-row Cooling
    • Make Humidification Adjustments
    • Use an Air-Side Economizer
    • Use Sensors and Controls - Match Cooling, Airflow, IT Loads
    • Provide Energy-efficiency Awareness Training
    • Select a Sustainable Colocation Facility
  • The Energy Cost of Cryptocurrency
  • Data Centers for Utilities
  • IT Solutions and Power Infrastructure
  • Optimize Airflow and HVAC

DUCTLESS HEATING & COOLING

ELECTRIC COOKING PRODUCTS

ELECTRIC VEHICLE CHARGERS

ENTERPRISE SERVERS

FREEZERS

FURNACES

GEOTHERMAL HEAT PUMPS

HEAT PUMP WATER HEATERS

HIGH EFFICIENCY GAS STORAGE WATER HEATERS

IMAGING EQUIPMENT

LABORATORY GRADE REFRIGERATORS AND FREEZERS

LARGE NETWORK EQUIPMENT

LIGHT COMMERCIAL HEATING & COOLING

LIGHT FIXTURES

MONITORS

POOL PUMPS

REFRIGERATORS

RESIDENTIAL WINDOWS, DOORS & SKYLIGHTS

ROOM AIR CONDITIONERS

Seal and Insulate with ENERGY STAR for Partners

SIGNAGE DISPLAYS

SMART HOME ENERGY MANAGEMENT SYSTEMS

SMART THERMOSTATS

SOLAR WATER HEATERS

STORM WINDOWS

TELEPHONES

TELEVISIONS

UNINTERRUPTIBLE POWER SUPPLIES

VENDING MACHINES

VENTILATION FANS

VOICE OVER INTERNET PROTOCOL (VOIP) PHONES

WATER COOLERS

WHOLE HOME TANKLESS GAS WATER HEATERS

Demand Hot Water Recirculating System

Cool Roofs

Rooftop Solar

Green Power Options

Programs and Strategies for Energy Access

Energy Efficiency Home Upgrade Assistance

Inclusive Utility Investment

Product Specifications & Partner Commitments Search

Products Tools and Resources

Recycle

Save on Heating Costs with ENERGY STAR This Season

Scoping Reports

Smart Home Tips for Saving Energy

DIY Lighting with ENERGY STAR

Eligible Commercial Fixture Types

Learn About Brightness

Learn About LED Lighting

Medical Imaging Equipment For Partners

Recent Program Updates

Save Energy in the Data Center / Server Room: Additional Resources

The Certified Lighting Subcomponent Database (CSD)

Earth Day 2023

Enjoy Spring Savings and Help the Planet

Keep Your Cool AND Save Your Money this Summer

Gifts that Do a World of Good

Most Efficient

Install In-rack or In-row Cooling

The limitations of “room-based” cooling solutions

All of the electrical power delivered to the IT loads in a data center ends up as waste heat that must be removed to prevent sensitive electronic equipment from overheating.  An example from Industrial Light and Magic, a special effects studio, puts this task in perspective.  A single rack in their data center containing 84 “blade” servers had an IT load of 28kW, and generated the same amount of heat as four Weber Spirit barbecues grills!1 

Computer room air conditioning (CRAC) units push chilled air into a data center and around the equipment – a setup known as “room-based cooling.”  In most cases, cooling the vast volumes of air in an entire room is very inefficient.  Raised floors and hot and cold aisle containment reduce the volume of air to be moved, but still result in a lot of excess chilling, since cold air is pushed into empty space rather than directly onto hot equipment.

In some data centers, traditional room-based cooling systems are simply reaching the limits of their capabilities. Certain types of servers (blade servers, for instance) pack a lot of power into a small space.  That means that they also exhaust a lot of heat into a small space.  As a result, some room-based cooling systems – which are designed for “power densities”2 on the order of 1-5 kW per rack – simply cannot keep up with the heat output, and hot spots can develop. 

Close-coupled cooling solutions

To address this problem, air conditioning systems can be brought closer to servers by placing them within rows of server racks or by integrating them with individual racks.  Such systems are generally referred to as “close-coupled” cooling devices. These devices can be used in addition to, or instead of, standard room-based cooling systems.  

Row-based cooling

With a row-oriented cooling architecture, each CRAC unit is dedicated to cooling one row of server racks. The CRAC units may be mounted among the racks (see Figure 1), overhead, or under the floor. Compared with the room-based cooling, airflow paths are shorter and more clearly defined. This reduces the CRAC fan power required, increasing efficiency.

A row-oriented design also allows cooling capacity and redundancy3 to be targeted to the actual needs of specific rows. For example, row-oriented architecture allows one row of racks to run high density applications such as blade servers, while another row satisfies lower power density applications such as communication enclosures.  Similarly, mission critical servers can be installed in one row that features redundant cooling, and less important workloads can reside on servers in a row without redundant cooling.

A row-oriented architecture can be implemented without a raised floor. This increases the floor load bearing capacity, reduces installation costs, eliminates the need for access ramps, and allows data centers to exist in buildings that otherwise do not have the headroom to permit the installation of a raised floor.

Example of In-Row Cooling
Figure 1: Example of in-row cooling, where air conditioning units fit inside rack rows. Diagram credit: PRWeb.

Rack-based cooling

In rack-oriented cooling architectures, the CRAC units are dedicated to one server rack and are directly mounted to (or within) the racks (see Figure 2). Compared with the room-oriented or row-oriented architecture, the rack-oriented airflow paths are even shorter and more precisely defined, so the highest power density (up to 60 kW per rack) can be achieved.  Similar to row cooling, the reduction in the length of the airflow path reduces the CRAC fan power required, increasing efficiency.  And rack-oriented cooling allows cooling capacity and redundancy to be targeted to the actual needs of specific racks of servers.

Exploded View
Figure 2: Exploded view of a rack-based rear-door cooling system. Diagram credit: Mainline Computer Products.

Mixed cooling architectures

Nothing prevents the room, row, and rack cooling architectures from being used together in the same facility. In fact, there are many cases where mixed use is beneficial. Specifically, a data center operating with a broad spectrum of power densities could benefit from a mix of all three types.

Savings and Costs

Generally speaking, in-row and in-rack cooling systems have higher capital costs than room-based cooling systems, but lower operating costs – particularly at higher power densities, where room-based cooling solutions have trouble keeping up with higher, concentrated heat loads.  Unnecessary airflow is avoided, which can save more than 50% fan power consumption compared with room-based cooling.4  

First Costs

Figure 3 shows a simulation of “first costs” (capital costs for cooling units, piping, chillers, installation and containment) associated with room-based, row-based, and rack-based cooling systems.  The simulation assumes 480 kW of total IT load and looks at first costs associated with different rack densities (3 kW to 20 kW).  First costs for all systems decline as rack density increases thanks to a shrinking data center footprint – e.g., fewer racks, raised floors, and piping are needed.  First costs for row-based cooling are slightly higher than for room-based, as more cooling units and more piping are needed.  Rack-based first costs drop dramatically as server density increases (e.g., racks fill up with servers), but they are still higher than row and room-based cooling. 

Capital Costs Chart
Figure 3: Capital costs per watt of IT load as a function of average rack power density. (HAC = hot aisle containment.) Diagram credit: APC by Schneider Electric.

Operating costs

Contrary to conventional thinking, it actually costs less to operate high-density IT environments than low-density environments.  Figure 4 offers an illustration.

Figure 4 shows annual cooling costs (electricity costs) for the same simulation depicted in Figure 3.  Note that row-based cooling systems use less electricity than room-based systems across all server rack densities because the cooling units are located closer to the IT loads and unnecessary air flow is avoided.  Rack-based systems begin to use dramatically less electricity than room-based systems as rack density goes beyond 6 kW per rack because servers can be added to existing racks, with little additional cooling needed.  However, as server rack density increases from 12 to 20 kW, rack and row-base solutions being to require more airflow and water flow and annual costs increase.  Nevertheless, rack and row-based cooling costs remain lower than room-based cooling costs.  

Annual Electricity Costs Chart
Figure 4: Annual electricity costs as a function of average rack power density. (HAC = hot aisle containment.) Diagram credit: APC by Schneider Electric.

Figure 5 illustrates the results of a demonstration project conducted by Lawrence Berkeley National Laboratory (LBNL) in partnership with the Silicon Valley Leadership Group.  Like Figure 4, it shows that rack- and row-mounted, close-coupled cooling devices are more efficient than computer room cooling devices and have lower operating costs.5 

Data Center Cooling Device Relative Performance Chart
Figure 5: Tests by Lawrence Berkeley National Laboratory (LBNL) and the Silicon Valley Leadership Group documented the energy efficiency of rack- and row-mounted, close-coupled cooling devices, compared to computer room cooling devices.

Tips and Considerations

One advantage of rack and row-based cooling is that the failure of a single cooling unit only affects one rack or row, as opposed to the entire data center.

On the other hand, since rack-based cooling capacity cannot be shared with other racks, redundancy can be an issue with rack-based systems, and, to a lesser extent, row-based systems.  N+1 redundancy is commonly used in room- based cooling architectures.  (For example, a room-based cooling system consisting of 3 CRAC units would need one extra CRAC on hand in the event that one unit failed.)  With row-based cooling, a redundant (extra) cooling unit would be needed for each row.  For rack-based cooling, a redundant (extra) cooling unit would be needed for each rack.6

For a more detailed comparison of cooling architectures, including pros and cons, see APC’s white paper, Choosing between Room, Row, and Rack-based Cooling for Data Centers (PDF, 629 KB).  Information about relative costs and savings is also provided.


1  Mitchell, Robert. Data Center Density Hits the Wall.  Computerworld.  June7, 2010.  Available online at: http://www.computerworld.com/s/article/349433/Data_Center_Density_Hits_the_Wall

2 “Power density” refers to the power consumption of an entire server rack

3 “Redundancy” is the duplication of critical components of a system with the intention of increasing the reliability of the system, usually in the form of a backup or fail-safe.

4 Dunlap, Kevin; Rasmussen, Neil. Choosing Between Room, Row, and Rack-based Cooling for Data Centers (PDF, 629 KB), APC Whitepaper. 2012. Available online at: https://www.apc.com/us/en/download/document/SPD_VAVR-6J5VYJ_EN/ (PDF, 629 KB)

5 Bell, Geoffrey. Improving Data Center Efficiency with Rack or Row Cooling Devices.  Federal Energy Management Program. March 2012. Available online at: http://energy.gov/sites/prod/files/2013/10/f3/dc_chilloff2.pdf (PDF, 816 KB)

6 Dunlap, Kevin; Rasmussen, Neil. Choosing Between Room, Row, and Rack-based Cooling for Data Centers (PDF, 629 KB), APC Whitepaper. 2012. Available online at: www.apc.com/us/en/download/document/SPD_VAVR-6J5VYJ_EN/ (PDF, 629 KB)

ENERGY STAR
United States Environmental Protection Agency

Save Energy.

  • Find Products
  • Save at Home
  • New Homes
  • Commercial Buildings
  • Industrial Plants
  • Partner Resources

Learn More.

  • About Us
  • Join
  • Newsroom
  • Privacy
  • Accessibility Statement
  • Help Desk

Stay Informed.

  • Public Notices
  • Consumer Newsletter
  • Program Updates
Back to top