How To Measure and Report PUE and DCiE

Power Usage Effectiveness (PUE) & Data Center Infrastructure Efficiency (DCiE) Progress
Dan Azevedo, Symantec Jon Haas, Intel Jud Cooley, Sun Microsystems, Inc. Mark Monroe, Sun Microsystems, Inc. Pam Lembke, IBM
SM
Agenda
PUE / DCiE Background & Next Steps DCiE Detailed Analysis PUE / DCiE Usage & Public Reporting Guidelines PUE / DCiE Calculation Tool Free Cooling Map Power Configuration Calculator
SM
Copyright 2009, The Green Grid
The Green Grid Technical Forum
PUE / DCiE Background & Next Steps
SM
SM
DCiE Detailed Analysis Dan Azevedo, Symantec
Executive Summary
The DCiE Detailed Analysis is to support and strengthen the Data Center infrastructure Efficiency (DCiE) metric. The intent is to enable data center managers collectively to derive and use DCiE as a global standard metric.
SM
DCiE Detailed Analysis

This White Paper represents the first in a series that will provide a more detailed analysis of the PUE / DCiE Metric and represents the Basic level in the below table with the assumption of a dedicated data center facility:
Level 1 (Basic) IT Equipment Power Measurement From Total Facility Power Measurement From
UPS Level 2 (Intermediate) PDU
SM
Level 3 (Advanced)
Server,.
Data Center input power
Data Center input less shared HVAC
Data Center input less shared HVAC plus building lighting, security Continuous (xx min)
Minimum Measurement Interval
Monthly/Weekly
Daily
SM
SM

Table of Contents Introduction Background and Assumptions DCiE Overview DCiE Subcomponents Obtaining Required Data Estimating Power Consumption Measuring Power Consumption Power Metering Requirements Factors Affecting DCiE Dynamic Data Center Type of Data Center Climate and Location Data Center Design and Operation Measurement Period Sometimes DCiE Seems To Go The Wrong Way Driving DCiE Efficiency DCiE and Future Technology Advancements Multiuse Facilities Summary Conclusion
SM
Summary
This paper provides: Prescriptive information on how to calculate the efficiency metrics Multiple levels of implementation which enables a very simple basic approach to as much depth and complexity as desire Equipment categorization: infrastructure vs. IT equipment Power metering requirements Guidance on interpreting the metrics High-level guidance on multi-use facilities
SM
10
SM
Usage And Public Reporting Guidelines for The Green Grids Infrastructure Metrics Jon Haas, Intel
11
Reasons for Guidelines

PUE/DCiE have become commonly used metrics for data center efficiency Factors such as environmental conditions, a data centers physical characteristics, and timing and frequency of measurements can play a significant role in final results
In addition, some individuals and organizations have used these metrics to promote design ideas that, while valuable, can provide misleading results
SM
Standard guidelines for the use and reporting of these metrics will:
Enable a common language and nomenclature to compare results provide a process to support accurate, consistent results Provide additional transparency and accountabilitly in the process of measurement for public claims
In addition, these guidelines will support The Green Grid in:

develop an auditing/certification process for the industry around these metrics develop a recognition program for those organizations showing strong results and/or improvements in data center energy efficiency
12
Publicly reporting your Data

The Green Grid will provide a means for organizations to publicly report their measurements
record their PUE/DCiE measurement data to The Green Grid provide background information about the data center, reporting the results and the manner in which, and conditions under which, that data was collected provide a means to report any issues or difficulties in following TGGs proscribe processes and guidelines
SM
The Green Grid will also provide a portal through which organizations can view summary details on publicly reported PUE and DCiE results
This portal will provide summary data on all registered reported results
All reported results meeting TGG guidelines will be given a registration number that can be referenced A subset of provided data will be publicly visible (see appendix 2 of WP or consent form)
TGG will offer members the opportunity to provide a link to additional information about their result or data center via additional optional reporting Organizations reporting results have the option to participate in TGG awards or recognition programs by complying with additional requirements
13
Classes of Measurement Results

Class Description
Benefit to Reporting Organization
SM
Unrecognized
A publicly reported result with no claims of following TGGs guidelines. TGG will not comment on unrecognized results. A publicly reported result by the reporting organization claiming they followed TGGs measurement recommendations and nomenclature guidelines. TGG will not comment on Reported results. A publicly reported result, with key report contextual data provided to TGG by the reporting organization to TGGs data center performance database. A publicly reported result, with key additional data required for third-party validation or certification of results, provided to TGG by the reporting organization.
Reported
Reporting organization can use standard materials from The Green Grid to explain process and results to audience. Official registration of reported result. Receipt of a registration number from TGG. Link to public report data from TGGs website. All benefits applicable to registered results, plus, consideration of reported results in future TGG award or recognition programs.
Registered
Certified
14
Usage and Reporting Guidelines

To receive a PUE or DCiE registration number from The Green Grid:

SM
Follow The Green Grids measurement guidelines in the most recent revision of DCiE Detailed Analysis Report the process through which the data was collected (L1, L2, L3) using the nomenclature in the most recent revision of Usage and Public Reporting Guidelines for The Green Grids Infrastructure Metrics Report your measurement data and input the required information into the Green Grids Metrics Data Collection Database (www.thegreengrid.org) Agree to The Green Grids metrics public reporting consent form If requesting to be considered for a TGG award, provide the extended data set information into the Green Grids Data Collection Database for certified measurements
Additionally Report to The Green Grid any issues or difficulties in following TGGs proscribed processes and guidelines
(optional, co-promotion) send the PUE or DCiE registration number, along with a link to any original source material or publication, to TGG at admin@thegreengrid.org
Copyright 2009, The Green Grid The Green Grid Technical Forum
15
PUE/DCiE Nomenclature Structure
The accuracy level of the measurement The timeframe of the measurement

E.g. yearly, monthly, weekly, daily
SM
All PUE and DCiE measurements should be reported with subscripts that identify:
See The Green Grids Metrics: Data Center Infrastructure Efficiency Detailed Analysis
The granularity of the measurement

Frequency with which the data was collected E.g., monthly, weekly, daily, continuous
Official PUE/DCiE reports will provide these information with subscripts appended to the Metric
i.e. PUEx,y or DCiEx,y, where x describes the Level of the measurement (L1, L2, L3)
L1, L2, and L3 are defined in the TGG White Paper: The Green Grid Metrics: Data Center Infrastructure Efficiency (DCiE) Detailed Analysis
y describes the Timeframe and Granularity of the measurement

y = timeframe identifier + frequency identifier
16
Measurement Accuracy Reporting (from DCiE Detailed Analysis WP)
SM
Level 1 (Basic) IT Equipment Power Measurement From Total Facility Power Measurement From
UPS
Level 2 (Intermediate) PDU
Level 3 (Advanced) Server,.
Data Center input power
Data Center input less shared HVAC
Data Center input less shared HVAC plus building lighting, security Continuous (xx min)
Minimum Measurement Interval
Monthly/Weekly
Daily
17
Measurement Timescale and Granularity Reporting

The y subscript on PUE or DCiE denotes the Timeframe and Granularity of the measurement
y = timeframe identifier + frequency identifier [M, W, D, C]
SM
Frequency identifier:
M for measurements taken monthly W for measurements taken weekly D for measurements taken daily C for measurements taken continuously (with frequency one hour or less)
Except for those measurements collected with continuous data, all data points that are averaged in the final measurement must be taken at the same time of day Single measurements are reported with no frequency identifier
18
Example Reported Results

0.45 DCiEL1,-Single DCiE measurement (0.45) taken using a Level 1 meter placement
SM
0.51 DCiEL1,YM
Yearly average DCiE (0.51), using data points gathered monthly with a Level 1 meter placement
1.6 PUEL1,MW
Monthly average PUE (1.6) using data points gathered weekly with a Level 1 meter placement
0.43DCiEL1,WD
Weekly average DCiE (0.43), using data points gathered daily with a Level 1 meter placement
1.8 PUEL2,WC
Weekly average PUE using data points gathered continuously with a Level 2 meter placement.
2.1 PUEL3,YC
19
Yearly average PUE (2.1) using continuous measurements with a Level 3 meter placement.
Specific Reporting Issues

PUEs of < 1.0 and DCiEs of > 1.0 are *not* allowed Elements that go into the calculation
Power consumed by IT equipment Power lost in distribution Power consumed by cooling equipment These elements are always 0
SM
Accounting for re-use of waste heat

Waste heat re-use *does not* get included in either PUE or DCiE TGG will look into creating an additional metric to cover this
Accounting for power generated on site

PUE / DCiE is meant to cover areas of energy use in the data center Generation of power on-site is not incorporated into either the power distribution losses or cooling equipment requirements As such, it should not be considered in the PUE/DCiE calculation
20
Conclusion
We are driving the right behaviour!
The Green Grid Metrics for data center efficiency are gaining widespread adoption, use and visibility Organizations are publicly reporting their measurements and claiming highly efficient operations
SM
The Green Grid is implementing public reporting guidelines that includes standard processes and nomenclature to make the measured results more transparent and consistent Stay away from PUEs of < 1.0 and DCiEs of > 1.0, they are not viable
21
SM
PUE Calculation Tool Jud Cooley, Sun Microsystems, Inc.
22
Rationale and Objectives

Sponsor: Container Assessment Task Force to allow case study comparisons Easily and accurately compute PUE
In a consistent manner Allowing for apples-apples comparisons Container boundaries Building or room boundaries
SM
Web based
One sheet printed report Data archival/retrieval
23
PUE with Physical boundaries

Management reporting to visualize overhead
Power: Transfer Switch, UPS, Transformer, Generator, Lighting, etc. Cooling: Tower, Condenser, Chiller, Pumps, etc. Other: Fire Supression, Control, Security, etc. IT Equipment: Servers, etc. Facility equipment: air movers, power distribution, UPS, etc. IT Equipment: Servers, etc.
SM
Facility Boundary
24
Container or Room Boundary
Web screen shot example

(Spreadsheet Prototype, artificial data)
Seq 1 2 3 4 5 13 19 30 31 32 40 Class Facility Facility Facility Facility Facility Facility Facility IT IT IT IT Equipment Equipment Equipment Equipment Type Power Power Power Power Power HVAC HVAC Compute Devices Network Devices Network Devices Other Detail Transfer Switch UPS DC Batteries / Rectifiers (non UPS Telco Nodes) Generator Transformer (step down) Chillers Return Fans
SM
Facility (kW)
Container (kW)
5.0
5.0 25.0 2.0 50.0
... ...
Servers Switches Routers Other Total Facility + IT Power Total IT Power
2.0 32.0 2.0 91.0 54.0 1.69 0.59 59.0 52.0 1.13 0.88
2.0 59.0 52.0
Total Facility Power (kW) Total IT Power PUE DciE Total Power (kW) at Container Boundary Total IT Power in Container Partial PUE (Container Boundary) Partial DciE (Container Boundary)
25
Output
SM
Single page PDF output

Fileable report identifying configuration, date, data Useable for direct apples-apples comparisons
Data saved in csv or a Data Base format

TBD based on development discussion Consistent with other Green Grid tools Importable into spreadsheet Re-loadable
26
Controversy over air movers

Fan-less servers with rack fans rely on those fans Rack-based air movers might be considered either IT or facility depending on your point of view Proposed position is that the air mover power is part of the IT equipment Needs to be discussed in Committees
SM
PUE Calculator Tool will allow a separate line to enter air mover power that is not included inside the physical boundary of the server, yet is required for the IT operation (to expose the ambiguity). That power will be allocated to IT, but will be left visible in the tool and the output.
27
Status and Timing

Consultants hired In development now Alpha version to be tested by Green Grid Task Force members in Q1 2009 Beta and release target is for Q2 2009
SM
28
SM
Free Cooling Map/Web Tool Mark Monroe, Sun Microsystems, Inc.
29
Concept and Features

Estimate the number of hours of free cooling that may be possible based on weather data at any location in the U.S.
Consider European and APAC data in the design so that data can be added in the future without major changes to the application or database.
SM
Climate data will be analyzed to determine the number of hours per year that either fresh air or evaporative cooling might be used in a data center.
30
Concept and Features (contd)

Two colorful maps must be produced; one showing the U.S. color-coded to show the number of hours
of fresh air cooling possible, the second map will show the U.S. color-coded to show the number of hours of evaporative cooling possible.
SM
31
SM
32

A web tool must be produced which allows a user to enter their own location, via zip code, and the data center set points for temperature and humidity that they which to examine for hours of free cooling
SM
33
SM
34
RFP Responses
weatherbank.com selected to implement Response within budget estimates Approved by Board 21 Jan 09 Prototype ready now
Seek approval from TC and Board in Feb Release in March
SM
35
Roadmap/Futures
Individual maps available for $150 direct from weatherbank.com Feedback page allows users to consult directly Review in 3 months, determine enhancements Possibilities:

36
SM
European and APAC data/locations/calculations Simple model for water used by evaporative cooling Input location by latitude/longitude Redisplay map with user-input parameters Connect with DSIRE and other incentive databases More complex models, more accurate results
SM
Power Distribution Configurations Online Efficiency Estimator Tool Pam Lembke, IBM
37
Tool Purpose
The tool: Is for use as a companion to
Qualitative Analysis of Power Distribution Configurations for Data Centers, TGG WP #4 and Quantitative Efficiency Analysis of Power Distribution Configurations for Data Centers, TGG WP #16
SM
Reduces the need for paper rewrites, as the tool can be easily updated regularly Allows readers and users to test their own components and proposed system architectures
Features
Users are able to:
Compare two topologies at a time Input data points (load vs efficiency) of their own components for the calculations Create their own topologies based on their components or predefined TGG components Save components and topologies Print input and results in PDF
SM
Tool will automatically calculate full efficiency curves for

components end-to-end efficiency curves for the two topologies
Tool Mock Up
SM
Availability
The tool is scheduled to be available around Q2 2009 It will be accessible to members only via The Green Grid website
SM
SM
The 2nd
Thank you for attending Annual Green Grid Technical Forum
For more information, please visit www.thegreengrid.org
42

How To Measure and Report PUE and DCiE

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

How To Measure and Report PUE and DCiE

Uploaded by

Copyright:

Available Formats

Power Usage Effectiveness (PUE) & Data Center Infrastructure Efficiency (DCiE) Progress

Copyright 2009, The Green Grid

The Green Grid Technical Forum

PUE / DCiE Background & Next Steps

Copyright 2009, The Green Grid

The Green Grid Technical Forum

DCiE Detailed Analysis Dan Azevedo, Symantec

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Copyright 2009, The Green Grid

The Green Grid Technical Forum

DCiE Detailed Analysis

Data Center input power

Data Center input less shared HVAC

Minimum Measurement Interval

Copyright 2009, The Green Grid

The Green Grid Technical Forum

DCiE Detailed Analysis

Copyright 2009, The Green Grid

The Green Grid Technical Forum

DCiE Detailed Analysis

Copyright 2009, The Green Grid

The Green Grid Technical Forum

DCiE Detailed Analysis

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Reasons for Guidelines

In addition, these guidelines will support The Green Grid in:

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Publicly reporting your Data

Copyright 2009, The Green Grid

Classes of Measurement Results

Usage and Reporting Guidelines

PUE/DCiE Nomenclature Structure

The accuracy level of the measurement The timeframe of the measurement

The granularity of the measurement

y describes the Timeframe and Granularity of the measurement

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Measurement Accuracy Reporting (from DCiE Detailed Analysis WP)

Level 2 (Intermediate) PDU

Level 3 (Advanced) Server,.

Data Center input power

Data Center input less shared HVAC

Minimum Measurement Interval

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Measurement Timescale and Granularity Reporting

Example Reported Results

Specific Reporting Issues

Accounting for re-use of waste heat

Accounting for power generated on site

PUE Calculation Tool Jud Cooley, Sun Microsystems, Inc.

Copyright 2009, The Green Grid

The Green Grid Technical Forum

Rationale and Objectives

Copyright 2009, The Green Grid