Data Center Forum: Cooling & Power Issues - City Beach, Fremont - October 12, 2006

1. Data Center Forum: Power & Cooling Issues October 12, 2006 Presenters: Dr. Robert Sullivan, "Dr. Bob,” Triton Technology Systems Fritz Menchinger, NER

4. GROWTH IN TRANSISTORS PER DIE © 2003 Intel Corporation

5. 2005 – 2010 PROJECTIONS PRODUCT HEAT DENSITY TREND CHART

6. INTEL PROJECTED ACTUAL POWER CONSUMPTION FOR 42-1 RU SERVERS Actual product power consumption has lagged behind these projections by about 2 years * Product footprint 3,360 W/ft 2* 20.2 kW 480 W/RU Q3, 2004 2,900 W/ft 2* 17.6 kW 420 W/RU Q3, 2003 2,478 W/ft 2* 14.8 kW 354 W/RU Q3, 2002 1,890 W/ft 2* 11.3 kW 270 W/RU Q3, 2001

7. 2004 HIGH-END PRODUCTS 2004 Trend chart mid-point projection was 1,800 W/ft 2 (Maximum configurations & options) * Based on product footprint 750 W/ft 2* 54.0 kW 32”x324” EMC DMX3 1,100 W/ft 2* 21.0 kW 32”x87” IBM DASD 1,300 W/ft 2* 10.0 kW 28”x40” HP Superdome 1,800 W/ft 2* 16.0 kW 36”x36” IBM Z-Series 1,700 W/ft 2* 24.0 kW 36”x56” Sun F15K

8. 2004 BLADE AND 1U SERVERS Trend chart mid-point projection for 2004 is 3,000 W/ft 2 (Maximum configurations & options) * Product footprint W/ft2 based on actual cabinet size 3,000 W/ft 2 * 18.0 kW HP ProLiant Ble 2,000 W/ft 2 * 8.0 kW Electric Oven 2,200 W/ft 2 * 13.3 kW RLX ServerBlade 3000i 2,300 W/ft 2 * 14.0 kW Sun Sunfire 3,000 W/ft 2 * 18.0 kW IBM eServer Blade Center 4,000 W/ft 2 * 24.0 kW Dell PowerEdge 1850MC

16. FUNCTIONALITY DEFINITIONS Multiple active paths, redundant Tier IV: Single active path, redundant Tier III: Single path, redundant components Tier II: Single path, no redundancy Tier I:

21. Cooling concerns > No computer room master plan Failure to measure, monitor, and use installation best practices Mechanical incapacity Bypass airflow Need for supplemental cooling

26. COMPUTER ROOM LAYOUT

28. Cooling concerns No computer room master plan > Failure to measure, monitor, and use installation best practices Mechanical incapacity Bypass airflow Need for supplemental cooling

31. MASTER PLAN MONITORING WORKSHEET

32. Cooling concerns No computer room master plan Failure to measure, monitor, and use installation best practices > Mechanical incapacity Bypass airflow Need for supplemental cooling

36. Cooling concerns No computer room master plan Failure to measure, monitor, and use installation best practices Mechanical incapacity > Bypass airflow Need for supplemental cooling

40. TYPICAL BYPASS AIRFLOW CONDITION Reduces kW capacity per rack that can be effectively and predictably cooled.

41. TYPICAL BYPASS AIRFLOW CONDITION (CONTINUED) This unnecessarily large raised-floor opening should be closed. The edges of the cutout must be dressed according to NFPA code.

42. TYPICAL BYPASS AIRFLOW CONDITION (CONTINUED) Unnecessarily large cable cutout under a server rack

43. TYPICAL BYPASS AIRFLOW CONDITION (CONTINUED) Both a bypass airflow problem and a safety hazard.

48. BEST PRACTICE PERIMETER PENETRATIONS ARE SEALED Good example of fire stopping through a sidewall.

49. BEST PRACTICE PERIMETER PENETRATIONS ARE SEALED (CONTINUED) Excellent fire stopping practices are evident throughout this site.

52. FLOOR OPENINGS FIRE PILLOW EXAMPLES This is one way to prevent air loss. Additional refinement is needed.

54. FLOOR OPENINGS FOAM SEALING EXAMPLES Plugging cable opening is a good practice, a better choice of materials would be more appropriate.

56. FLOOR OPENINGS PROBLEMS WITH FOAM SEALING (CONTINUED) Foam sealing has not been reinstalled after re-cabling. Resulting opening allows significant air leakage.

61. INTERNAL BYPASS AIRFLOW - HOW IS IT FIXED? Install internal blanking plates within cabinets to prevent open RU openings from recirculating hot air exhaust

62. INTERNAL BYPASS AIRFLOW BLANKING PLATE INSTALLATION EXAMPLE Proper use of blanking or filler plates exhibited.

63. Cooling concerns No computer room master plan Failure to measure, monitor, and use installation best practices Mechanical incapacity Bypass airflow > Need for supplemental cooling

68. HISTORY OF INNOVATION 2006-Infrastructure Consulting, Design, Build, High Density Power and Cooling 1985 MF Tape Racks 1989 Autotrieve 1 st automated tape racks, first S.A.M 2006 IT Security Audit, Compliance Services 1992 NER’s first custom server cabinets 1998 Began Distributing Cybex 2000 Began Distributing NetBotz 2001 Began Distributing ServerTech 2004 Ultimate Core/ Largest Avocent Strategic Dist. Partner 2002 Introduced R3 1991 first high-density tape racks 2005 Launch of Services Business

69. INNOVATION ROADMAP Solutions and Services for 2006 and beyond 2005 Begin Factory Integration 2005 On-Site integration 2006 Data Center Health Check CFD Modeling and Adaptivcool cooling solutions Build-out, Build-New Assessment Enhanced Centralized Management Solutions and Training Services Project Management and Implementation 2006 Asset& Inventory Service Data Center Construction Enhanced Facility Monitoring

75. CIO’S PARADOX TODAY (SAME MESSAGE FOR 3 YEARS) The CIO’s Paradox in action: What the CIO hears from other business leaders. “ You’re a service. Why can’t you respond to our division better? What are your people doing?” & “ IT is strategic. How do you, the CIO, set investment priorities? “ I have no trust in IT’s ability to deliver measurable value” & “ We need new, better solutions. “ Reduce your budget!” & Keep our systems running 24x7!”

76. DATA CENTER FAULT TOLERANCE Are these photos from your data center?

78. CAN YOU GET 5 TONS OF AIR THROUGH ONE PERFORATED TILE?? HOW ABOUT 9?

86. HEAT BUILDUP IN SERVER ROOM

88. RECOMMENDED PERFORATED TILE POSITIONING WITH EXISTING LAYOUT Move this row!

89. RECOMMENDED HOT-AISLE COLD-AISLE LAYOUT Note the placement of the CRAC’s to the hot aisle. Note that we shut off one of the CRAC’s!

90. THERMAL PATTERNS OF RECOMMENDED HOT-AISLE/COLD-AISLE LAYOUT Before After v4

98. WORST CASE SCENARIO – 15-TON CRAC FAILURE Failure in Current Layout Failure in Hot/Cold Layout

107. VARYING POWER REQUIREMENTS BY ROW WAS A PERCEIVED ISSUE FOR THE CUSTOMER 15kW 12kW 9kW 5kW

116. CFD MODELING Before After

118. COOLING MARGIN RESULTS The cooling margin of the room was improved by 7ºF at the top of the racks.

119. SUMMARY OF RESULTS More dramatically,virtually all server intake temperatures dropped, some by as much as14ºF.

122. FINAL WORD Meeting the current and near term power needs with High Voltage/Amperage power and targeting the available cooling to where it is needed most, and controlling airflow precisely are the sensible approaches that will pay dividends in equipment uptime, energy costs and real estate.