Edge and Data Center Cooling Solutions Precision and High Density Liquid Cooling
Total Page：16
File Type：pdf, Size：1020Kb
Load more
Recommended publications
-
Green Field Data Center Design – Water Cooling for Maximum Efficiency
GREEN FIELD DATA CENTER DESIGN – WATER COOLING FOR MAXIMUM EFFICIENCY Shlomo Novotny, Vice President and Chief Technology Officer, Vette Corp. Overview Data centers are an ever‐growing part of our economy. The IT community is experiencing constantly increasing demands in areas such as Internet media and video, banking and finance, research, and government, just to name a few. Consequently, data centers continue to grow in both size and numbers. In addition, the performance of IT servers continues to follow Moore’s law; this improves the performance per dollar spent on IT equipment, but also increases the heat density inside the data center equipment. Driven by these factors, the cost of running a data center continues to grow, even as the cost of the IT performance continues to decline. Historically, data center management has been focused on growth, performance, uptime, and reliability. IT organizations generally had responsibility for data center management. Facility organizations were responsible for much of the infrastructure surrounding the IT equipment. As a result of the significant growth and the lack of a holistic view of the economics of data centers, data center facilities today can be compared to factories of the 1970s and 1980s: ripe for significant cost, design, and process improvements. With attention from C‐level executives today, data centers are driven to be lean, scalable, cost effective, and green. One of the most inefficient issues with many data centers today revolves around cooling. Typically, data center operators have managed heat density issues by spreading the load and under populating racks. This has come about because of the limitations of air cooling, which creates a very costly, complex, and inefficient infrastructure. -
Liquid in the Rack: Liquid Cooling Your Data Center
AUGUST 21- 23, 2018 • CLEVELAND, OHIO Liquid in the Rack: Liquid Cooling Your Data Center Dale Sartor, PE Norman Bourassa awrence Berkeley Lawrence Berkeley National Laboratory National Laboratory Otto Van Geet, PE National Renewable Energy Laboratory Contact Information Dale Sartor, P.E. Lawrence Berkeley National Laboratory MS 90-3111 University of California Berkeley, CA 94720 [email protected] (510) 486-5988 http://datacenters.lbl.gov/ Agenda • Introduction to Liquid Cooling • Case studies • Interactive Discussion Liquid Cooling Solution Typical liquid cooled equipment room, with external coolant distribution units (CDUs) For most locations these data centers may be operated without chillers in a water-side economizer mode Benefits of Liquid Cooling • Higher compute densities • Higher efficiency • Heat removal • Transport energy • cooling plant • Increased economizer hours • Potential use of waste heat Moving (Back) to Liquid Cooling . As heat densities rise, liquid solutions become more attractive . Volumetric heat capacity comparison (5,380 m3) (1.5 m3) ~ 190,000 cubic foot blimp = Water Air Why Liquid Cooling? . Higher compute densities . Liquids can provide cooling at higher temperatures • Improved cooling efficiency • Increased economizer hours • Potential use of waste heat . Reduced transport energy: In-Row Liquid Cooling Graphics courtesy of Rittal In-Rack Liquid Cooling Racks with integral coils and full containment: Cooling Coil Rear-Door Heat Exchanger . Passive technology: relies on server fans for airflow . Active technology: supplements server fans with external fans in door . Can use chilled or higher temperature water for cooling Photo courtesy of Vette Liquid On-Board Cooling . Clustered Systems design . Conducting heat to a cold plate containing refrigerant Liquid On-Board Cooling . -
Guide to Minimizing Compress-Based Cooling
Guide to Minimizing Compressor-based Cooling in Data Centers Prepared for the U.S. Department of Energy Federal Energy Management Program By: Lawrence Berkeley National Laboratory Author: William Tschudi May 2013 Contacts William Tschudi Lawrence Berkeley National Laboratory One Cyclotron Road, 90R3111 Berkeley, California 94720 510-495-2417 [email protected] For more information on FEMP, please contact: Will Lintner, P.E. Federal Energy Management Program U.S. Department of Energy 1000 Independence Ave. S.W. Washington, D. C. 20585-0121 202.586.3120 [email protected] Cover photo: Center for Disease Control and Prevention's Arlen Specter Headquarters and Operations Center reached LEED Silver rating through sustainable design and operations that decrease energy consumption by 20% and water consumption by 36% beyond standard codes. Photo from Center for Disease Control, NREL/PIX 16419 2 Acknowledgements The author would like to thank Romonet for their assistance in conducting the technical simulations utilized in this guide. 3 Table of Contents 1 Introduction ........................................................................................................................................... 5 2 The opportunity .................................................................................................................................... 6 3 Steps for minimizing or eliminating compressor-based cooling .................................................... 7 3.1 Adopt indoor environmental conditions that promote efficiency -
Liquid Cooling Guidelines for Datacom Equipment Centers
Liquid Cooling Guidelines for Datacom Equipment Centers | Second Edition Centers Equipment Liquid Cooling Guidelines for Datacom The Guide Every Datacom Professional Needs Liquid Cooling Data center rack heat loads are steadily climbing, and the ability for many data centers to deliver either adequate airflow rates or chilled air is now being stretched to the limit to avoid decreased equipment availability, wasted floor space, and inefficient cooling system operation. This situation is creating a Guidelines need for liquid cooling solutions to reduce the volume of airflow needed by the racks and for lower processor temperatures for better computer perfor- mance. This book provides cooling system designers, data center operators, equipment manufacturers, chief information officers (CIOs), and IT specialists for Datacom with best practice guidance for implementing liquid cooling systems in data centers. This second edition includes updated references and further information Equipment Centers on approach temperatures and liquid immersion cooling, plus guidance on water quality problems and wetted material requirements. It also includes definitions for liquid and air cooling as they apply to the IT equipment, along with an overview of chilled-water and condenser water systems and other datacom equipment cooling options. The book also bridges the liquid cooling systems by providing guidelines on interface requirements between the chilled-water system and the technology cooling system and on the Second Edition requirements of liquid-cooled systems that attach to a datacom electronics rack to aid in data center thermal management. This book is the fourth in the ASHRAE Datacom Series, authored by ASHRAE Technical Committee 9.9, Mission Critical Facilities, Data Centers, Technology Spaces and Electronic Equipment. -
The Facility Perspective on Liquid Cooling
Dale Sartor The Facility Perspective on Lawrence Berkeley National Laboratory Liquid Cooling: Experiences and Anna Maria Bailey Proposed Open Specification Lawrence Livermore National Laboratory David Grant SC18 Birds of a Feather Oak Ridge National Laboratory Herbert Huber November 13, 2018 Leibniz Supercomputing Centre, LRZ Dave Martinez Version: 11/08/18 Sandia National Laboratory 1 | Federal Energy Management Program femp.energy.gov Agenda • Overview of warm water liquid cooling • Introductory remarks from panelists (strategies and lessons learned) • Overview of open specifications for liquid cooled rack • Panel and audience discussion 2 Warm Liquid Cooling - Overview Dale Sartor, P.E. Lawrence Berkeley National Laboratory SC18 Birds of a Feather November 13, 2018 Version: 11/05/18 3 | Federal Energy Management Program femp.energy.gov Liquid Cooling Solution Typical liquid cooled equipment room, with external coolant distribution units (CDUs) For most locations these data centers may be operated without chillers in a water-side economizer mode 4 Benefits of Liquid Cooling • Higher compute densities • Higher efficiency Vision: Eliminate compressor based cooling and water consumption 5 Moving (Back) to Liquid Cooling • As heat densities rise, liquid solutions become more attractive • Volumetric heat capacity comparison (5,380 m3) (1.5 m3) ~ 190,000 cubic foot blimp = Water Air 6 Why Liquid Cooling? • Liquids can provide cooling at higher temperatures – Improved cooling efficiency – Increased economizer hours – Potential use of waste -
Failure Analysis of Direct Liquid Cooling System in Data Centers
Proceedings of the ASME 2017 International Technical Conference and Exhibition on Packaging and Integration of Electronic and Photonic Microsystems InterPACK2017 August 29-September 1, 2017, San Francisco, California, USA IPACK2017-74174 FAILURE ANALYSIS OF DIRECT LIQUID COOLING SYSTEM IN DATA CENTERS Sami Alkharabsheh, Bharath Ramakrishnan, Bahgat Sammakia Department of Mechanical Engineering Binghamton University Binghamton, NY, USA ABSTRACT RU rack unit In this paper, the impact of direct liquid cooling (DLC) SNMP simple network management protocol system failure on the IT equipment is studied experimentally. SPT set point temperature The main factors that are anticipated to affect the IT equipment T temperature (°C) response during failure are the CPU utilization, coolant set point U CPU utilization temperature (SPT) and the server type. These factors are varied experimentally and the IT equipment response is studied in terms INTRODUCTION of chip temperature and power, CPU utilization and total server Cooling was reported to consume 30%-40% of the total power. It was found that failure of the cooling system is energy used in legacy data centers [1]. Despite the optimistic hazardous and can lead to data center shutdown in less than a data center energy consumption trends in a recent survey [2], the minute. Additionally, the CPU frequency throttling mechanism average power usage effectiveness (PUE) was reported to be 1.8 was found to be vital to understand the change in chip mostly due to inefficiencies in the cooling system [3]. Several temperature, power, and utilization. Other mechanisms thermal management technologies are used in data centers associated with high temperatures were also observed such as the cooling to address the inefficiency challenges [4]. -
Fujitsu Cool-Central Liquid Cooling Technology
ISC15 Frankfurt July 2015 Fujitsu Cool-Central® Liquid Cooling Technology Fujitsu Cool-Central® Liquid Cooling Technology Efficient cooling of large PRIMERGY CX400 M1 HPC or cluster solutions Fujitsu Cool-Central® Liquid Cooling Technology helps to reduce data center cooling costs by over 50 % and allows for 2.5-5x higher data center server density. 1 © 2015 Fujitsu Why On-Chip Liquid Cooling? Maximum rack Less cooling Lower investment Lower overall density power and needed for energy costs building new data consumption centers Extreme dense Liquid cooling A hot water based Hot water based liquid HPC and cluster allows for up to liquid cooling cooling enables the installations with 50% less cooling infrastructure requires easy usage of waste more than 50 kW power and costs a way lower heat for heating per rack are only through high investment than homes, green houses, possible with efficient coolers traditional air cooled or swimming pools liquid cooling with low operating infrastructure costs 2 © 2015 Fujitsu Water as a Medium for Heat Transfer Removing the waste heat For 1000 W, 10 K temperature difference: 325 m³/ h of air 0,09 m³/h water Small water tubes can transport more heat than a room full of air! Heat transfer Heat transfer from water-to-water is better by a factor of 1,000 than water-to-air Cold plate and pump units are the same size or even smaller than regular heat sinks 3 © 2015 Fujitsu Fujitsu‘s Liquid Cooling Offering Future-proofing the Fujitsu PRIMERGY portfolio KW per rack will further rise and traditional air -
System Technology
System technology System technology ----------------------------------------------------------------------System technology List of contents INDOOR CLIMATE HEAT TRANSFER CLIMATE CONCEPTS COMFORT COOLING COOLING THE ROOM DESIGN WATER BASED CLIMATE SYSTEMS GUIDELINES 1 INDOOR CLIMATE ----------------------------------------------------------------------INDOOR CLIMATE PPD WHY CREATE A GOOD INDOOR CLIMATE % Experienced indoor climate 80 Individuals experience the climate as a joint action of several 60 factors that affect our thermal comfort: 40 • Level of activity, the body’s heat production 30 • Clothing’s thermal resistance • Ambient air temperature 20 • Surrounding surfaces’ temperature • The air’s relative speed 10 • The air’s relative humidity 8 6 According to professor P O Fanger the ideal indoor climate 4 has been attained when people perceive thermal comfort, i.e. –2,0 –1,5 –1,0 –0,5 0 0,5 1,51,0 2,0 PMV when a person is thermally neutral. However, one of the prob- lems you always face when creating a good climate with the Figure 1. Expected percentage of dissatisfied (PPD = Predict- help of a climate system is that people perceive the climate ed Percentage Dissatisfied) as a function of the thermal com- differently. fort perception (PMV = Predicted Mean Vote). No matter how well you succeed about 5% will still be dissat- -2 = cold isfied. The percentage of those dissatisfied will then increase -1 = slightly cold for each degree of deviation from the average person’s most ±0 = neutral ideal temperature. +1 = slightly warm +2 = hot Figure 1 shows the percentage of those dissatisfied when the temperature deviates from the average ideal temperature. Efficiency [%] Performance levels 100 What we consider to be the ideal indoor climate is always in- 90 dividual from person to person and studies show that per- formance levels follow a person’s perception. -
The Installation of Direct Water-Cooling Systems to Reduce Cooling Energy Requirements for High-Performance Computing Centers
The Installation of Direct Water-Cooling Systems to Reduce Cooling Energy Requirements for High-Performance Computing Centers Shankar Earni and Steve Greenberg, Lawrence Berkeley National Laboratory Walker Johnson, kW Engineering ABSTRACT A large cluster of High-Performance Computing (HPC) equipment at the Lawrence Livermore National Laboratory in California was retrofitted with an Asetek cooling system. The Asetek system is a hybrid scheme with water-cooled cold plates on high-heat-producing components in the information technology (IT) equipment, and with the remainder of the heat being removed by conventional air-cooling systems. In order to determine energy savings of the Asetek system, data were gathered and analyzed two ways: using top-down statistical models, and bottom-up engineering models. The cluster, “Cabernet”, rejected its heat into a facilities cooling water loop which in turn rejected the heat into the same chilled water system serving the computer-room air handlers (CRAHs) that provided the air-based cooling for the room. Because the “before” and “after” cases both reject their heat into the chilled water system, the only savings is due to reduction in CRAH fan power. The top-down analysis showed a 4% overall energy savings for the data center (power usage effectiveness (PUE) —the ratio of total data center energy to IT energy— dropped from 1.60 to 1.53, lower is better); the bottom-up analysis showed a 3% overall energy savings (PUE from 1.70 to 1.66) and an 11% savings for the Cabernet system by itself (partial PUE of 1.51). Greater savings, on the order of 15-20%, would be possible if the chilled water system was not used for rejecting the heat from the Asetek system. -
Coordinating Liquid and Free Air Cooling with Workload Allocation for Data Center Power Minimization
COORDINATING LIQUID AND FREE AIR COOLING WITH WORKLOAD ALLOCATION FOR DATA CENTER POWER MINIMIZATION THESIS Presented in Partial Fulfillment of the Requirements for the Degree Master of Science in the Graduate School of the Ohio State University By Li Li Graduate Program in Electrical and Computer Engineering The Ohio State University 2014 Master's Examination Committee: Prof. Xiaorui Wang, Advisor Prof. F¨usun Ozg¨uner¨ c Copyright by Li Li 2014 ABSTRACT Data centers are seeking more efficient cooling techniques to reduce their operat- ing expenses, because cooling can account for 30-40% of the power consumption of a data center. Recently, liquid cooling has emerged as a promising alternative to tradi- tional air cooling, because it can help eliminate undesired air recirculation. Another emerging technology is free air cooling, which saves chiller power by utilizing outside cold air for cooling. Some existing data centers have already started to adopt both liquid and free air cooling techniques for significantly improved cooling efficiency and more data centers are expected to follow. In this thesis, we propose SmartCool, a power optimization scheme that effectively coordinates different cooling techniques and dynamically manages workload alloca- tion for jointly optimized cooling and server power. In sharp contrast to the existing work that addresses different cooling techniques in an isolated manner, SmartCool systematically formulates the integration of different cooling systems as a constrained optimization problem. Furthermore, since geo-distributed data centers have differ- ent ambient temperatures, SmartCool dynamically dispatches the incoming requests among a network of data centers with heterogeneous cooling systems to best leverage the high efficiency of free cooling.