SIO IndustryTrends TGAVDC Book InstructorCompaSIO IndustryTrends TGAVDC Book InstructorCompanion Sep13 2010nion Sep13 2010

The Green and Virtual Data Center (CRC)
By Greg Schulz - www.storageio.com

p py g This instructors companion contains copyrighted material from the book The Green and Virtual Data Center (CRC) by Greg Schulz as well StorageIO material. Use of this material for educational classroom instructor purposes is permitted and shall include inclusion of all copyrights and attributions. Uses for commercial purposes is not permitted without express written consent of StorageIO. StorageIO All rights are reserved by copyright owners of this content and its subsequent use. For more information, contact: Greg Schulz The Server and StorageIO Group (StorageIO) PO Box 2026 Stillwater, MN 55082 +1 651.275-1563 +1 651.430.0502 (Fax) Email: info@storageio.com
The Green and Virtual Data Center (CRC) Instructor Companion Guide
Copyright 2010 Server and StorageIO Group All rights reserved. www.storageio.com
ISBN: 978-1-4200-8666-9

About The Author
Greg Schulz is an independent IT industry advisor, author, blogger and consultant. Greg has over 30 years of experience in across a variety of server, storage, networking, hardware, software and services platforms, architectures and paradigms. Greg gained his diverse industry insight experience from being in the trenches in IT data centers. He has held numerous positions including programmer, server and storage systems administrator, performance and capacity analyst, disaster recovery consultant, as well as a server and storage planner at companies including an electrical power generating & transmission utility, financial services and transportation firms. Shifting gears, Greg worked for several storage and networking companies in a variety of customer facing roles ranging from systems engineering and sales to marketing and Sr. technologists. After spending time as a customer and vendor, Greg became a Sr. Analyst at an IT analyst firm covering virtualization, SAN, NAS and associated storage management tools techniques, tools, techniques best practices and technologies. technologies In 2006, Greg leveraged those experiences of having been on the customer, vendor and analyst sides of the IT table to form the independent IT advisory consultancy firm Server and StorageIO Group (StorageIO). Mr. Schulz has been involved with various storage related organizations including the Computer Measurement Group, Storage Networking Industry Association, and RAID Advisory Board among others. others Greg is extensively published on a global basis and regularly appears in print, print on on-line line as well as in person presenting and key note speaking at conferences, seminars and private events around the world on data infrastructure and related management topics. In addition to his thousands of reports, blogs, twitter tweets, columns, articles, tips, pod casts, videos and webcasts, Greg is also author of the books The Green and Virtual Data Center (CRC) and "Resilient Storage Networks Designing Flexible Scalable Data Infrastructures (Elsevier) in addition to being a co-author and contributor for many other book projects including The Resilient Enterprise Enterprise (Symantec/Veritas). (Symantec/Veritas) Greg is regularly quoted and interviewed as one of the most sought after independent IT The advisors providing perspectives, commentary and opinion on industry activity. Greg has a B.A. in computer science and M.Sc. in software engineering from the University of St. Thomas. Learn more at www.storageioblog.com or twitter @storageio.
The Green and Virtual Data Center

Auerbach Publications, Taylor & Francis Group
Auerbach Publications Taylor & Francis Group 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, FL 33487-2742 2009 by Taylor & Francis Group, LLC Auerbach is an imprint of Taylor & Francis Group, an Informa business No claim to original U.S. Government works Printed in the United States of America on acid-free paper 10 9 8 7 6 5 4 3 2 1 International Standard Book Number-13:978-1-4200-8666-9 (Hardcover) This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made to publish reliable data and information, but the author and publisher cannot assume responsibility for the validity of all materials or the consequences of their use. The authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been obtained. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future reprint. Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any information storage or retrieval system, without written permission from the publishers. For permission to photocopy or use material electronically from this work, please access www.copyright.com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that provides licenses and registration for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate system of payment has been arranged. Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are only for identification and explanation without intent to infringe. Library of Congress Cataloging-in-Publication Data Application submitted. Visit the Taylor & Francis Web site at http://www.taylorandfrancis.com http://www taylorandfrancis com and the Auerbach Web site at http://wwww.auerbach-publications.com
The Green and Virtual Data Center (CRC) ISBN: 978-1-4200-8666-9 October 18 18, 2010
Instructors Companion Book Material V1.2 (Sections I, II, III and IV)
Industry Trends and Perspectives:

Greg Schulz, Founder & Sr. Analyst -The Server and StorageIO Group Email: Greg@storageio.com Greg@storageio com Blog: storageioblog storageioblog.com com or twitter @storageio Author The Green and Virtual Data Center (CRC) And Resilient Storage Networks (Elsevier)
Copyright 2010 StorageIO Group All rights reserved. www.storageio.com
Some Background Material g

Who is Greg Schulz as well as Server and StorageIO?
Independent IT Advisor, Author, Blogger and Consultant Worked as a vendor W k d in i IT as a customer, t d and d then th industry i d t analyst l t Provide industry trends and perspectives on IT infrastructure topics Books, articles, tips, reports, videos, podcasts appear globally
ISBN: 978 978-1-555583113 1 555583113
storageioblog.com Storageio.com
Copyright 2010 Server and StorageIO Group All rights reserved.
Newsletter
www.storageio.com
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
The Green and Virtual Data Center

Enabling Efficient, Effective and Productive IT Computing
IT data centers around the world are faced with various power, cooling, floor space and li fl d associated i d environmental, ecological and economic related issues while supporting and sustaining growth without disruption to application service level response time or availability. IT infrastructure resources configured and deployed in a highly virtualized manner can combine with other techniques and technologies to achieve simplified and cost effective delivery of IT services to meet application service levels in an environmentally and economical manner.
ISBN: 978-1-4200-8666-9
If this resonates or you need to learn more, then this book and/or presentation is must learn material for real-world perspectives and insight to address server, server storage, storage networking and facilities topics in a next generation virtual data center that relies on an underlying physical infrastructure.
Part I
Green IT and the Green Gap Real or Virtual? Chapter 1 IT Data Center Economic and Ecological Sustainment Separating Green Wash and IT Green Issues is the Green Gap Chapter 2 Energy Efficient and Ecologically Friendly Data Centers Pay your speeding tickets and parking fines or spend your savings elsewhere
Chapter p 1: IT Data Center Business Economic and Ecological Sustainment

Separating Green Wash and IT Green Issues is the Green Gap What you will learn in this chapter
The many faces of green IT data centers What is the Green gap and Green washing How to close the Green gap and address IT issues IT data centers dependencies on electrical power Myths M th and d realities liti pertaining t i i to t Green G IT and d related l t d topics t i What is Power, Cooling, Floor space/footprint and EH&S (PCFE) How to develop a PCFE strategy to address common IT issues Various techniques, technologies and approaches to IT issues Differences between avoiding energy use and being energy efficient
What y you are about to see/hear is real

However There Are Different Shades of Being Green There is a growing Green Green Gap Gap and disconnect
Green Messaging vs. IT Issues and Challenges Carbon Credits vs. Energy Efficiency Rebates or certificates Power Avoidance vs. Improved Energy Efficiency Energy vs. Environmental Health and Safety (EHS) PCFE and g green issues only y impact p large g organizations g
Today you can leverage different techniques

Real results are achievable and affordable to address: Power, Cooling, Floor space, Environmental (PCFE) issues See www.storageio.com for the rest of the story
What Are Different Shades of Green?

Addressing Different Requirements and Issues Avoidance of power consumption - lower kW use
Powering down devices when not in use, usage limits
Consolidation for energy efficiency to avoid waste

Larger capacity servers and storage, tiered resources Look at Capacity per kW or Watt, leverage virtualization
Performance enhancement for energy effectiveness

Increase performance doing more with what you have Focus on GHz or MHz or IOPS or Bandwidth per kW or Watt
HVAC HVAC & cooling li optimizations ti i ti Optimize O ti i what h t you h have

Improve air flow, optimize cabinets and placement
Some IT Data Center Issues and Trends

Addressing Different Requirements and Issues Growing data security and IT threat risks
Acts of man and acts of nature, human error Aging g g infrastructure Hardware, , software, , networks Compliance, BC, DR and related requirements
Focus on optimization p and efficiency y

Consolidate data centers, servers, storage, networks Shift from capacity focus to service effectiveness Balance ROBO consolidation with data center crowding Virtualized for utilization, cluster for HA & performance
See Data Center I/O Performance Issues and Impacts at www.storageio.com/reports

Some IT Data Center Issues and Trends

Addressing Different Requirements and Issues Proliferation of:
Windows and NAS file servers Servers, , storage g and networks More data generated, copied and retained longer Ever expanding data footprint with proliferation of data
Continued or growing confusion around:
Power, cooling and different shades of Green Different forms of storage virtualization Compliance seen only for certain companies Connectivity y and data access Interface wars V2.007
Fast Facts
Inconvenient Truths or Convenient Myths?
U.S. U S Data Centers used 61 Billion kWh of electricity in 2006 U.S. Data centers used 1.5% of electricity in the U.S. in 2006 IT power consumption about $4.5B USD in 2006 IT Data Centers power usage is 10 10-40x 40x denser than an office On average 50% of IT electricity is for cooling Energy costs will vary by: Region usage Region, usage, surcharges surcharges, home vs vs. business business, type of fuel
(Western vs. eastern coal, petroleum, oil, natural gas, LP, hydro, nuclear, thermo, wind)
U.S. U S CO2 emission is 1 1.341lbs 341lbs per kWh of electrical power A 24 cubic foot refrigerator produces 1.22 tons of CO2 per year A gallon of gasoline on average generate about 20lbs of CO2
Note: Actual CO2 emissions will vary depending on mileage, type of use, fuel octane level and other variables.
Fast Facts
Inconvenient Truths or Convenient Myths?
Continued growth and reliance on IT services Global ecological awareness issues and topics Data centers require access to reliable power Supply (fuel cost, production & transmission G&T) Demand (more dense data centers) Density D it d driving i i d demand d and d availability il bilit i issues More data being generated, accessed and stored Multiple copies of data being retained longer Multiple Continued increase for servers, storage and networks Software in-efficiency impacts efficiencies of solutions
Green Gap: vs. Economic p Ecological g

Areas of Convergence The Many Faces of Green
Emissions Electrical Power Primary, Standby Backup
Green
Cooling g and Floor Space
Environmental Health and Safety
Source: Figure 1.1 The Green and Virtual Data Center (CRC)
Green Gap: vs. Economic p Ecological g

Ecological Sales Pitch vs. Economic Sustainment and EHS
Ecological
The Green Gap
Economic
Messaging Focus on green-house gases Carbon credit offsets Ecological sustainment Power avoidance Emissions Save money Global Electrical Power Green Primary Standby Backup Primary, Limits on electrical G&T g energy gy costs and availability y Rising Aging and expensive infrastructure Emission tax schemes regulations Supply
Issues Concern with available power Energy rebates and certificates Economic sustainment Energy efficiency Cost to be green Local Cooling and Floor Space
Environmental Health and Safety
Growing data footprint g More servers and storage Increase density, reduce cost Removal of hazardous substance (RoHS) Demand
Balancing Act See report Analysis of EPA report to Congress at www.storageio.com/reports

www.storageio.com
Economic and Business Drivers

Relative Available IT Resources
Power, Cooling, Floor space, Environmental (PCFE) Constraints

IT Capacity C it Constrained C t i d Business Growth Inhibited Economic Penalties Lost Opportunities pp Compute Capacity Storage Capacity I/O Performance (IOPS & Bandwidth) Time
Cooling/Distribution Servers Storage

Networking Other
PCFE Capacity Threshold Ceiling Available IT Resources/Demand

www.storageio.com
Economic and Ecological Sustainment g

Energy Efficiency Sustains Performance and Capacity Growth
Relative Available IT Resources Sustain Demand/Growth S t i IT D d/G th Business Growth Enabled Economic Improvements Ecological g Benefits Compute Capacity Storage Capacity I/O Performance (IOPS & Bandwidth) e Time
Cooling/Distribution Servers Storage
Networking Other
PCFE Capacity Threshold Ceiling Available IT Resources/Demand

Green IT Related Myths and Realties y

These Are Constantly Changing and Evolving Myth: Data centers consume a lot of power
Reality: They do, however not in the big picture Reality: However datacenters have dense power needs Reality: R lit D Datacenters t t need d reliable li bl and d stable t bl power
Myth: Powering off devices is the silver bullet

Reality: Conservation plays a role as do other measures Reality: However not at expense of performance
Myth: CO2 emissions is prime focus of energy efficiency

Reality: R lit It can b be, h however th there i is a supply l and dd demand di issue Reality: Datacenters have dense power needs Reality: Datacenters need reliable and stable power
Green IT Related Myths and Realties y

These Are Constantly Changing and Evolving Myth: Green is the focus of reducing power and cooling
Reality: It can be, also for other reasons (supply / demand)
Myth: y HW costs more to power p than to buy y

Reality: Maybe for some components, not for systems yet Single low cost HDD with escalating power cost over time Reality: New data centers can change perception For example, $10M of hardware needs a $21M new datacenter
Areas of Focus and Opportunity pp y

What You Can Do Today and Plan For the Future
E-Waste Mask EW t M k EHS or Move RoHS Issues HVAC Alternative Energy Boost Energy Efficiency Best Practices and d Policie es / Metrics Financia al Incenti ives and Rebates s
Consolidation Reduce Data Footprint
Energy Tiered Avoidance Servers Storage
Developing your issues p g a Strategy: gy What are y

Boost Energy Efficiency Useful Work per Energy Use
tivity ity Use/Act Use e/Activity Use/Activity U y Use/Activi
Energy Avoidance Power Down, Down Over consolidate Decrease Amount of Useful Work Decrease Energy Used Some So e Energy e gy Efficiency c e cy Faster Components, Same Power Increase Amount of Useful Work Same Amount Energy Used S Some Energy Efficiency ff Lower Power-Draw Components Same Useful Work Done Decrease Energy Used More Energy Efficiency Faster Components/Less Power Increase Amount Useful Work Decrease Energy Used
Useful Work Power Used Time Poor Efficiency Gap
Improved p ( (Better) ) Efficiency and Economic Gap
Very Good Efficiency Gap

www.storageio.com
Developing your issues p g a Strategy: gy What are y

Boost Energy Efficiency Useful Work per Energy Use
Energy Scenario Description and Usage Scenario gy avoidance Avoid or decrease the amount of work or activity y to be done to eliminate energy gy Energy usage. On the surface it is appealing to simply turn everything off and avoid energy usage which for some items including lights or video monitors or personal computers is a good practice. However, not all IT resources lend themselves to being turned off as they need to remain powered on to perform work when and where needed. Do the same work Reduce energy usage performing the same amount of work or storing the with less energy same amount of data per unit of energy used with no productivity improvement. This can be a stepping stone to doing more with less. Do more work with Fit into an existing available energy footprint while doing more useful work or existing energy storing more data to improve on efficiency. While energy usage does not decline energy efficiency is achieved by boosting the amount of work or decline, activity performed for a given amount of energy used. Do more work with Reduce energy consumption boosting productivity and energy efficiency doing less energy more work, storing more information in a given footprint using less energy and related cooling. An analogy would be improved miles per gallon for a distance traveled to boost energy efficiency for active work.
www.storageio.com
Chapter p 1 Summary y and Notes

Key points and take away items
There that today Th are reall things thi th t can be b done d t d and d can be b effective ff ti towards t d achieving a balance of performance, availability, capacity and energy effectiveness to meet particular application and service needs. Sustaining for economic and ecological purposes can be achieved by balancing performance, availability, capacity and energy (PACE) to applicable application li ti service i level l l and d physical h i l fl floor space constraints t i t along l with ith intelligent power management. E Energy economics i should h ld be b considered id d as much h a strategic t t i resource part t of f IT data centers as are servers, storage, networks, software and persona.

The the to Th IT industry i d t is i shifting hifti from f th first fi t wave of f awareness and d green hype h t the second wave of delivering and adopting more efficient and effective solutions. However, as parts of the industry shift towards closing the green gap, stragglers and late comers will continue to message and play to the first wave th themes resulting lti iin some di disconnect t for f the th foreseeable f bl f future. t Meanwhile, a third wave addressing future and emerging technologies will continue ti t to evolve l adding ddi to t the th confusion f i of f what h t can b be d done t today d as opposed to what be able to be done in the future.

Without data halt. Rising With t electrical l t i l power, IT d t centers t come to t h lt Ri i fuel f l prices, i strained generating and transmission facilities for electrical power and a growing awareness of environmental issues are forcing business to look at PCFE issues. IT data centers to support and sustain business growth, including storing and processing i more d data, t need d to t leverage l energy efficiency ffi i as a means of f addressing PCFE issues. B By adopting d ti effective ff ti solutions, l ti economic i value l can b be achieved hi d with ith positive iti ecological results while sustaining business growth.

Meanwhile, M hil a third thi d wave addressing dd i future f t and d emerging i technologies t h l i will ill continue to evolve adding to the confusion of what can be done today as opposed to what be able to be done in the future. Without electrical power, IT data centers come to halt. Rising fuel prices, strained generating and transmission facilities for electrical power and a growing i awareness of f environmental i t l iissues are f forcing i b business i t to llook k at t PCFE issues. IT data centers to support and sustain business growth, including storing and processing more data, need to leverage energy efficiency as a means of addressing PCFE issues. By adopting effective solutions, economic value can be achieved with positive ecological results while sustaining business growth.

Depending being D di on the th PCFE related l t d challenges h ll b i faced, f d there th are severall general approaches that can be adopted individually or in combination as part of a green initiative strategy in how a business is operated and for the goods or services delivered to customers.

General include: G l action ti items it i l d
o Learn about and comply with various environmental health and safety (EHS) regulations p in recycling y gp programs g including g safe disposal p of e-waste of old technology gy o Participate o Reduce GHGs, CO2, NO2, water vapors and other emissions o In lieu of energy efficient improvements, buy carbon emissions offset credits for compliance o Comply with existing and emerging emissions tax schemes legislation and clean air acts o Increase awareness of energy usage and IT productivity to shift to an energy efficient model o Improve I energy usage and d efficiency ffi i while hil lleveraging i renewable bl or green energy sources o Mask or move PCFE buying carbon emissions offsets, outsourcing or relocating IT facilities o Indentify differences between energy avoidance and energy efficiency to boost productivity o Identify archive in-active data, delete data no longer needed for compliance or other uses

Where to learn more Additional learning resources
www.storageio.com and www.storageioblog.com Various videos, webcasts, podcasts, articles, presentations, tips and comments pertaining to material covered in this chapter Suggested items include:
o o o o California Center for Sustainable Energy (CCSE) Closing the Green Gap Determining Computer or Server Energy Use Closing the Green Gap: WSRADIO Internet Radio Interview http://storageioblog.com/?p=1073 http://storageioblog.com/?p=70 http://storageioblog.com/?p=539 http://storageioblog.com/?p 539 http://storageioblog.com/?p=519
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter p 2: Energy Efficient and Ecological Friendly IT Data Centers

What you will learn in this chapter
Pay your speeding tickets and parking fines or spend your savings
Identification of various issues that impact PCFE resource availability Why achieving energy efficiency is important to sustain IT growth and business productivity How electrical power is generated, transmitted and used in typical data centers How electrical power is measured and charges determined
Closing g the Green Gap p
Asking the right questions can help close the Green Gap
Transition In T iti towards t d addressing dd i PCFE related l t d issues. i I other th words, d insight i i ht into i t how h infrastructure resources are being used to meet acceptable delivery and service levels is paramount. For example, instead of asking if there is a green mandate or initiative, try some of these questions:
Does the data center currently have a power issue or anticipate one in the next 18-24 months? Does the IT data center have enough primary and backup power capacity? Is there enough cooling capacity and floor space to support current and near term growth? How much power does the data center consume? How much of that power goes to cooling, lighting and other facility overhead items? Ho m How much ch po power er is used sed b by ser servers, ers storage and net networking orking components? Is power constrained due to facility, local substation, or lack of generating capability? What floor space constraints exist and are there adequate cooling capabilities for growth? C energy usage be Can b aligned li d t to llevell of f service i d delivered li d or amount t of f iinformation f ti stored? t d? What hazardous substances and materials exist in the data center?
www.storageio.com
Economic and Business Drivers
Demand Exceeding Supply Cost and Availability of Electrical Power
Source: U.S. EPA

www.storageio.com
Green Gap: p Green Stories vs. IT Issues

An Issue is Reliable Power Availability (Supply) vs. Demand IT Data Center Typical Power Consumption
Cooling / HVAC IT Equipment Other External Storage (All Tiers) 80% Tape Drive Library
50-60%
48-50%
50% of power for cooling 15-20x denser power needs These are typical relative values. Your usage will vary based on: Size and scale of IT environment Application and workload types Storage capacity vs. I/O centric Compute vs. vs data centric Types and ages of equipment Management approaches
48% Servers
37-40%
Storage (Disk & Tape)
Network (SAN/LAN/WAN)
Other
www.storageio.com
North American Electrical Power Grid

An Issue is Reliable Power Availability (Supply) vs. Demand
N th A North American i El Electrical ti lP Power G Grid id www.nerc.com
www.storageio.com
Electrical Power G & T ( (Distribution) )

Electrical Power Generating and Transmission (G & T)

High Voltage Transmission Lines Local Distribution
High Rise Office Building
Substation Step-Down Transformer Power Plant g Station Generating Step-Up Transformer IT Data Center
www.storageio.com
IT Data Center Consumers of Electricity y

www.storageio.com
Energy costs gy consumption p

Annual costs for various levels of energy consumption
Hourly Power Use 1 kWh 10 kWh 100 kWh
5 cents per kWh $438 $4,380 $43,800
8 cents per kWh $701 $7,010 $70,100
10 cents per kWh $806 $8,060 $80,600
12 cents per kWh $1 051 $1,051 $10,510 $105,100
15 cents per kWh $1 314 $1,314 $13,140 $131,400
20 cents per kWh $1 752 $1,752 $17,520 $175,200
Source: Table 2.1 The Green and Virtual Data Center (CRC)
www.storageio.com
What You Can Do Today y

Obtain as well as leverage financial incentives and rebates
Energy Efficiency Rebates and Certificates Database of State Incentives for Renewable & Efficiency (DSIRE) Rebates and savings for energy efficiency or avoidance Certificates C tifi t for f efficiency ffi i f for compliance li exists i t Low cost loans and financing for energy improvements Various programs around the U.S. and globally
http://www.dsireusa.org
www.storageio.com

Obtain as well as leverage financial incentives and rebates
Energy Efficiency Rebates and Certificates US Environmental Protection Agency (EPA) power portal site
http://www epa gov/greenpower http://www.epa.gov/greenpower

www.storageio.com

Leverage various approaches for different requirements
Mask or Move Issues Consolidation Reduce Data Footprint Tiered Storage Energy Avoidance Boost Energy Efficiency HVAC, Alternate Power E-Waste and Hazmat Financial Incentives Metrics/Measurements Best Practices/Policies
Outsource MSP, Outsource, MSP Carbon Credits Virtualization and Aggregation Archive, Compression, De-duplication RAID, SSD, Fast/Fat Disks, Optical, Tape Power Down, MAID, IPM More Performance Performance, Less Power, Power AVS Hot/Cold Aisles, CRAC, Co-generation RoHS, Recycling, WEEE, EHS Rebates and Incentives for Efficiency Provide insight into energy effectiveness Improve usage of IT resources
AVS = Adaptive Voltage Scaling IPM = Intelligent Power Management


Leverage various approaches for different requirements
Facilities tune-up Cabinets and conversion Power down equipment T h l Technology replacement l Tiered storage Improve performance Leverage fat drives Distribute workload Reduce data footprint Different RAID levels Management tools Fi Financial i li incentives ti Optimize cooling, HVAC, data center assessment cooling HVAC Improved cooling for cabinets, better power conversion Power off, leverage variable power modes, sleepy drives L Leverage f faster, more energy efficiency ffi i technology h l Cache/SSD/Flash/RAM, HHDD, fat disks, fast disks, tape Consolidate with faster technology and boost performance Use larger capacity drives at expense of performance Leverage clustering to distribute storage and processing Compaction compression Compaction, compression, archive archive, single-instance single-instance, etc etc Reduce number of drives to save on power consumption Thin provision, replication to sites with more power E Energy rebates b t for f efficient ffi i t t technology, h l carbon b offsets ff t
www.storageio.com

Key points and take away items Action suggested include: A i items i d in i this hi chapter h i l d
o Gain insight how electrical power is used to determine an energy efficiency baseline o Investigate rebates and incentives available from utilities and other sources o Explore incentives for conducting data center energy efficiency assessments o Understand where PCFE issues and bottlenecks exist and how to address them o Look at alternative energy options, balancing economic and environmental concerns o Review home and business electric utility y bills to learn about p power usage g and costs o Learn more about the various regulations related to environmental health and safety

Key points and take away items Other from this include: O h takeaways k f hi chapter h i l d
o Energy avoidance may involve powering down equipment o Energy efficiency equals more useful work and storing more data per unit of energy o Virtualization today is for consolidation o Virtualization will be used tomorrow to enhance productivity
o Energy incentives can be available for energy avoidance and energy efficiency

o o o o Green IT Confusion Continues, Opportunities Missed! Green IT, Green Gap, Tiered Energy and Green Myths Green IT, Power, Energy and Related Tools or Calculators Green IT and Virtual Data Centers http://storageioblog.com/?p=598 http://storageioblog.com/?p=1107 http://thegreenandvirtualdatacenter.com/calculator.html http://storageioblog.com/?p=850
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
What You Can Do Today: y Scenarios

Mask or move the issues or problems
set Credits Buy Carbon Off Off-set Enables compliance for energy trading schemes (ETS) Buys time until efficiency (ecological & economic) achieved Adds cost to business when not p part of compliance p Does not address energy efficiency, rather a deferral Full and Complete Outsource Move the problem and issues elsewhere Leverage Managed Service Providers (MSP) Variation of complete outsource, move some aspects of IT Build B ild N New F Facilities ili i and/or d/ R Relocation l i Expensive and time consuming, strategic vs. tactical Part of solution when combined with other techniques

RoHS, WEEE, Environmental Health Safety (EHS) Topic area that is not discussed enough
Perhaps not seen as a money maker by some vendors Perhaps seen as more of a cost of doing business by others
Does your data center have hazardous substances?

Batteries for cached memories in storage or servers Mercury lighting in some PCs or laptops
How are you disposing of retired IT equipment

Security addressing digital destruction of data Recycling R li via i chartable h bl venues of f certain i equipment i Disposal via service meeting regulatory requirements Some are prepaid, some are fee based, some are neutral

Asset management and technology disposal or recycling Real regulations and compliance standards exits
RoHS Removal of Hazardous Substances (RoHS Levels) Lead, mercury and other containments or chemicals WEEE Waste W t of f Electrical El t i l and d Electronic El t i E Equipment i t J-MOSS, JEITA and JEDEC J-STD-020C ELV End-of-life Vehicles Directive Electronics Waste Recycling Act of f 2003 (S (S.B. 20/ 20/50) 0)
When talking to vendors about Green, ask them:

What are they doing internally and externally to address EHS What are some of their metrics and accomplishments How much water, paper, other resources recycled Do they have an EHS site with rich content or a place holder?
Part II
Next Generation Data Centers Today Chapter 3 What Defines a Next Generation and Virtual Datacenter Virtual Datacenters Enable Data Mobility, Resiliency and IT Efficiency Chapter Ch t 4 IT I Infrastructure f t t R Resource M Management t (IRM) You cant go forward if you cannot go back - Jerry Graham IT Pro. Chapter 5 Measurement, Metrics and Management of IT Resources You cant manage what you dont know about or have insight into
Chapter p 3: What Defines a Next Generation and Virtual Datacenters

What you will learn in this chapter
What defines a green and virtual data center
Virtual Datacenters Enable Data Mobility, Resiliency and IT Efficiency
How virtualization can be applied to servers, storage, and networks The many faces of server, storage, and networking virtualization Leveraging virtualization beyond consolidation Components and capabilities that comprise a virtual data center Transforming existing into next-generation virtual data centers Various techniques, technologies and approaches to IT issues Differences between avoiding energy use and being energy efficient
Virtual Data Centers Physical Resources y

Resources include servers, networks, storage and facilities
VolCD \\SharedC1 VolCC
Video/Audio
File Serving Web Linux VM
Billing, e-tail Email
Database, DSS File
Email Messaging SQL
CAD, EDA, Development
Spreadsheets PPTs, PDFs
Windows Windows Windows VM VM VM Virtual Server Environment
Mainframes, Open Systems, Local, and Remote Storage Switch Servers
Replicate Shared Storage Networks

Networks
www.storageio.com
Tenets of Green and Virtual Data Centers

Common Characteristics and Capabilities
Flexible, Fl ibl scalable, l bl stable, t bl agile, il and d highly hi hl resilient ili t or self-healing lf h li systems t Quick adaptation and leverage of technology improvements Transparency T of f applications li ti and dd data t f from physical h i l resources Efficient operation without loss of performance or increased cost complexity Environmentally E i t ll f friendly i dl and d energy efficient ffi i t yet t economical i lt to maintain i t i Highly automated and seen as information factories as opposed to cost centers Measureable M bl with ith metrics t i and d reporting ti t to gauge relative l ti effectiveness ff ti Secure from various threat risks without impeding productivity
Different Facets of Virtualization

Consolidation, Aggregation, Emulation and Transparency
VolCD \\SharedC1 VolCC
Video/Audio
File Serving
Billing, e-tail
Database, DSS
Email Messaging
CAD, CAD EDA, EDA Development
Consolidation of Multiple Systems Boost Utilization of Servers or Storage
Scaling Beyond Limits of Single System Scale Up & Out for Performance & High Availability Applications Workloads Need More Resources Opposite of Consolidated Scenarios Virtualization for Management Transparency
WebApp Linux VM
Email File Apps Windows Windows Windows VM VM VM Virtual Infrastructure Multi Core Migration Processors Disk Storage DAS, SAN, or NAS
Applications Clustering or Grid Infrastructure Unix Unix Load Balancing VM VM Virtual Infrastructure Migration
www.storageio.com
Industry Continuum y Trends: Compute p

We Are In A Consolidation Phase (Again!) , PDAs, , Pocket PCs Cell Phones, Desktop PCs & Laptops Mid Mid-range & Servers S Mainframes
LPARs/VMs Distribute 1950s Distribute Converged Phones & Computers From Desktop to Laptop x86 and VMs From Proprietary to x86 & Hypervisors & Open Open Networking Native Linux Distribute
Consolidate
Consolidate
1960s 1970s 1980s 1990s 2000s 2010s Service Info (SaaS) Software or Storage as a Service Bureau Utilities Managed g Grid, , Cloud, , Out-source & In-source xSPs Service Web 2.0 Client Server Providers
www.storageio.com
Industry Continuum y Trends: Compute p

Server, Storage Capacity and I/O Performance Gap
Perfo ormance e
Processor to disk storage capacity
Disk storage capacity to I/O performance gap
Time Server processor performance curve g capacity p y curve Disk storage Disk storage performance curve (IOPS)
www.storageio.com
Common IRM activities

Infrastructure Resource Management (IRM)
Managing storage, networks, software, data) M i IT resources (servers, ( t t k hardware, h d ft d t ) Logical and physical security, including rights management and encryption Asset management, g , including g configuration g management g databases Change control and management, configuration validation management tools Data protection management (business continuity and disaster recovery) P f Performance and d capacity it planning l i and d management tt tools l Data search and classification tools for structured and unstructured data High-availability g y and automated self-healing g infrastructures Data footprint reduction, including archiving, compression, and de-duplication Planning and analysis, event correlation, and diagnostics Provisioning and allocation of resources across technology domains Policies and procedures, including best practices and usage template models
www.storageio.com

Green and G d next-generation t ti virtual i t l data d t centers t should h ld be b highly hi hl efficient, ffi i t flexible, resilient, and environmentally friendly while economical to operate. Current focus is on virtualization from a consolidation perspective, but in the future there will be even more opportunities for IT environments to adapt their processes, techniques, and technologies to sustain business growth and enhance application service delivery experience while reducing costs without compromising performance, availability, or ability to store and process more information. There are many aspects of data storage virtualization that address routine IT management and support tasks, including data protection, maintenance, and load-balancing for seasonal and transient project-oriented application workloads workloads.

The whether Th vendor d who h controls t l and d manages the th virtualization i t li ti software, ft h th on a server, storage, or in the network, controls the vendor lock-in or stickiness. If you are looking to virtualization to eliminate vendor lock-in, it is important to make sure you understand what lock-in is being left and what lock-in will be in its place. Vendor lock lock-in in is not a bad thing if the capabilities, capabilities efficiency efficiency, economics economics, and stability offered by a solution outweigh any real or perceived risks or issues. Bad technology and tools in the wrong hands for the wrong tasks make for a bad solution, solution while good technology and tools in the wrong hands for the wrong tasks make for a not-so-good solution. The goal is to put good tools and techniques in the right hands for the right tasks to make an enabling and good solution solution.

The virtualization the f form of Th idea id is i to t leverage l i t li ti technologies t h l i in i th f abstraction b t ti and transparency or emulation combined with tiered servers, tiered storage, and tiered networks to align the right technology to the task at hand at a particular time. Start to fix the problems instead of moving them around or bouncing from distributed to consolidated and moving the distributed problems back to a main site. You can get management of an increasing amount of data and resources under control, and you can do more work with less energy while supporting growth. growth

o o o o Green IT and Virtual Data Centers Should Everything Be Virtualized? The vPad Virtualization: Life beyond consolidation http://storageioblog.com/?p=850 http://storageioblog.com/?p=719 http://thevpad.com/ http://storageioblog.com/?p=426
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter (IRM) p 4: IT Infrastructure Resource Management g ( )

You cant go forward if you cannot go back - Jerry Graham IT Pro. What you will learn in this chapter
What infrastructure resource management (IRM) is Why y IRM is an important p p part of a virtual data center How IRM differs from data and information life-cycle managemen Data protection options for virtualized environments
Best Practices: Virtual Data Centers

Managing IT Resources Across Technology Domains
Infrastructure Resource Management Functions and Activities Namespace and virtualization Measurements and metrics Monitoring and reporting Modeling, analysis, planning Resource usage g and allocation Performance and capacity planning Thin provisioning and purposing Diagnostic and resolution Change g & configuration g validation Data protection and footprint reduction Policy management and service levels Facilities and asset management g and p physical y security y Logical Procurement and disposition
Processes and Tools
www.storageio.com
Protecting g Data on Virtual Servers

Agent-Based Backup over a LAN
Data Protection Management Tools
Data Movement
LAN, MAN, or WAN
WebApp Linux VM Backup Agent or Client
Email File Windows Linux VM VM Virtual Infrastructure Migration
Apps UNIX VM
Backup Server
Disk Storage
VTL / Disk Library y Tape Devices (Block or File) Encryption, Compression, & De-duplication
www.storageio.com

VMware VCB Proxy-Based Backup Example
Agents, Snapshots, Replication, Application Aware, HA, BC and DR WebApp Email File Linux Windows Linux Pre/Post VM VM VM Processing Virtual Infrastructure Migration Disk Storage Snapshots Apps UNIX VM Data Protection Management Tools
LAN, MAN, or WAN
Data Movement over SAN or DAS
Backup Server
VTL / Disk Library y Tape Devices (Block or File) Vol A Vol B Vol C Vol D Replication, Mirroring, Compress Encryption Compress, Encryption, & De-duplication
www.storageio.com

Data Replication for High Availability (HA) and Data Protection
Primary Site Blade Server Virtual Servers BC/DR Site Virtual Servers
Replication VTL / Disk Library or Storage System Encryption, Compression, p & De-duplication VTL / Disk Library or Storage System
www.storageio.com

Local and Remote Data Protection
Primary Site Blade Server Virtual Vi t l Servers S BC/DR Site Virtual Servers Backup Server Tape Library
Replication
Encryption Compression and Deduplication
SAN or NAS Disk Storage
VTL / Disk Library Storage System Backup Server
Data Protection D P i Management Tools
Remote Site A
Remote Site B
www.storageio.com
Remote Site C
Data and Storage g Management g

Managing IT Resources Across Technology Domains
Feed alerts to third-party frameworks such as Patrol and Open View Alerts and notification (Email, GUI, XML, SNMP, API) Key Performance Indicators, Resource Usage, and Accounting
Presentation
Predefined and custom reports and displays
T Transformation f ti
Analytics, planning, event, activity, and resource correlation Cross-Domain information collection and entity correlation Networks (LAN & SAN) Infrastructure I f t t Resource Repository or CMDB / PMDB Business and application-aware linkage and correlation
Collection
Servers Applications Backup Applications
Application and business service objectives Servers Applications
IT Resource and Information Technology Domains

www.storageio.com

There to various aspects Th are many vendors d with ith solutions l ti t address dd i t of f infrastructure resource management (IRM) in a physical or virtual data center. Examples include BMC, Brocade, Cisco, Egenera, EMC, Emerson, HP, IBM, LSI, Microsoft, NetApp, Novell, Opalis, Racemi, Scalent, Sun, Symantec, Teamquest, Tek-Tools, Uptime, Vizoncore, and VMware, among others. The benefits of server virtualization for consolidation as well as management transparency are becoming well understood, as are the issues associated with protecting data in virtualized server environments. There are many options to meet different recovery time objective and recovery point objective requirements. Virtualized server environments or infrastructures have varying functionalities and interfaces for application aware integration to enable complete and comprehensive data protection with data and transactional integrity.

A combination and bi ti of f tapet d disk-based di k b d data d t protection, t ti including i l di archiving hi i for f data preservation, coupled with a data footprint reduction strategy, can help to address power, cooling, floor space, and environmental needs and issues. There is no time like the present to reassess, re-architect, and reconfigure your data protection environment, particularly if you are planning on or have already initiated a server virtualization initiative. initiative Virtual server environments require real and physical data protection. After all, you cannot go forward from a disaster or loss of data if you cannot go back to a particular point in time and recover, restore, and restart, regardless of your business or organization size.

o o o o Clouds and Common sense Data Protection (CDP) Data Protection Options for Virtual Servers Long Term Data Protection and Preservation Business Benefits of Policy Based Dedupe http://storageioblog.com//?p=704
http://storageio.com/Reports/StorageIO_WP_DataProtect_Aug20_2009.pdf
http://storageio.com/Reports/IndustryPerspective_LongTermTape_Mar18_2009.pdf
http://storageio.com/Reports/IndustryPerspective_PolicyDepe_Oct29_2008.pdf
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter p 5: Measurement, Metrics & Management of IT Resources

You cant manage what you dont know about or have insight into What you will learn in this chapter
Why metrics and measurements are important for understanding how IT resources are used How to ensure that required resources are available Key tenets of metrics and benchmarks for different use scenarios
Metrics and Measurements

Storage & Networking Measurement Points of Interest
Time and Product Life-Cycle Continuum
Customer
Vendor
Certification Testing Development
Evaluate/Buy Acceptance IRM Activities Comparative Installation Ongoing Operations & Use Compete Diagnostics Support/Diagnostics/Tuning
Data in Flight
Active or Idle
www.storageio.com

Messaging Efficiency: Different Categories and Activities
Categories & Price Bands Usage Cases H Measured How M d
Easy to Use Reflective of Diversity of Storage Acti e & Idle Active Idle, etc. etc Needs to Be Applicable to Usage Model
Best Practices
Source: Figure 5..2 The Green and Virtual Data Center (CRC)
www.storageio.com

IT Resource and Service Points of Interest for Metrics
Business and Service Rules & Objectives
Business Applications Operating O ti & File Fil Systems Hypervisors/VMs & S Servers Connectivity Storage Systems / Appliances Facilities & Site Resources
IT Resource Management g Reporting, Analysis, Action
Facility-wide Metrics
Source: Figure 5..3 The Green and Virtual Data Center (CRC)
www.storageio.com

Different Metrics for Various Purposes and Focus Areas Address Different Categories of Storage & Networking
Performance, Availability, Capacity, Energy (PACE) PACE per PCFE Footprint and Density vs. Cost
Address Different Price Bands / Market Segments

Enterprise, Mid-Range, SMB, SOHO
Address Different Usage Models

Active (working), Idle (no work), Energy Saving Mode Activity (IOPS, Bandwidth) for storage systems Data in motion for net network ork and I/O connectivity connecti it
Address Different Audiences

Vendors Engineering/R&D, g g , Development, p ,Q Q/A, , Compete p IT Organizations Comparison, Ongoing Use/Efficiency

Storage & Networking Measurement Points of Interest
Metric PUE DCiE DCP Activity or Work per watt Density per footprint Description Power Usage Effectiveness Data Center Efficiency Data Center Productivity Useful work per amount of energy used for storing or moving data Measure floor space usage g effectiveness Comment Green Grid (GG) metrics of ratio of power used to run IT equipment (Total facility power / Total IT equipment power) in data center (GG) Ratio of data center infrastructure efficiency power consumption independent of workload (GG) Measure of useful work done per energy consumed (Useful Work / Facility Power) Performance such as performance IOPS, bandwidth, transactions per watt, similar to MPG (city or highway) for different classes of storage. storage IOPS per watt, bandwidth per watt Capacity / footprint, Performance / footprint, Energy / footprint, Cost per footprint. Active & idle storage, g data in flight for networks.
See www.storageio.com/metrics.htm for additional examples


Measuring and Comparing IT Resource Usage over Time
IT Resource Usage Compared to Forecast over Time
Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec Available Capacity Usage Activity
Capacity Threshold Usage Trend Line

www.storageio.com

Various power, cooling, footprint and Green IT related metrics
Comment The flow rate of electricity, for example 144 watts / 12 volts = Amps / Volts 12 amps Annual kWh kWh x 24 x 365 Amount of energy used in kWh in a year M Measure of fh how much hd data t iis moved d iin a given i ti timeframe f Bytes moved per Bandwidth such as per second. Used for measuring storage system as second well as network data in-flight performance Heat g generated in an hour from using g energy gy in British BTU/hour watts x 3.413 3 413 Thermal Units. 12,000 BTU/hour equates to 1 ton of cooling Avg. 1.341 lbs per kWh The amount of average carbon dioxide (CO2) emissions from CO2 Emission of electricity generated generating an average kWh of electricity I/O Operations Per Measure of the number of I/O operations, operations transactions, transactions file IOPS Second requests or activity in a given time frame such as per second Rate at which energy is used per second with one watt hour Joule 1 watt per second being equivalent to 3,600 joules. 1 kwh represents 3,600,000 joules, or 1,000 joules per second.
Acronym
Description
www.storageio.com

Various power, cooling, footprint and Green IT related metrics
Description Comment Volts x Amp / 1000 or kVA Number of kilovolt-amperes kW / power-factor kW kVA x power-factor Power factor is the energy efficiency of a piece of equipment Mh or Gh Mhz Ghz Megahertz M h t / GigaHertz Gi H t I di t of Indicator f processor clock l k speed d Measure of how effectively power is used and converted by Power factor Efficiency of power power supplies. Power supplies that are 80 percent efficiency (pf) conversion y be referred to as 80 p plus. or better may U or Rack 1U = 1.75 EIA metric describing height of IT equipment in racks units Unit (RU) VA/VoltVolts x Amps p Power can be expressed p in Volt-Amperes p Amperes Volts or The amount of force on electrons as a measurement of / Amps Voltage electricity as AC or DC Amps x Volts or Unit of electrical energy power to accomplish some amount Watt multiple Btu/hr x 0.293 of work.
Acronym
www.storageio.com

IRM counting schemes for servers, storage and networks
Binary Number of Bytes Kilo Mega Giga Tera Peta Exa Zetta Yotta 1,024 1 024 1,048,576 1,073,741,824 1,099,511,627,776 1,125,899,906,842,620 1,152,921,504,606,850,000 1,180,591,620,717,410,000,000 1 208 925 819 614 630 000 000 000 1,208,925,819,614,630,000,000,000
Abbreviation 1 000 K, 1,000 K ki, ki kibi 1,000,000 M, Mi, bebi 1,000,000,000 G, Gi, gibi 1,000,000,000,000 T, Ti, tebi 1,000,000,000,000,000 P, Pi, pebi 1,000,000,000,000,000,000 E, Ei, exbi 1,000,000,000,000,000,000,000 Z, Zi, zebi 1 000 000 000 000 000 000 000 000 Y, 1,000,000,000,000,000,000,000,000 Y Ui, Ui yobi
Decimal Number of Bytes
www.storageio.com

I/O and Performance Response Time Impact on Efficiency
Respo onse Time e
Response time and latency degrades as workload or activity is increased, resulting in delays
Workload
Acceptable A bl SLA Response R Time Threshold
Bad Performance Good Performance
Activity or workload (IOPS, transactions, messages, etc.) Response time impact on users as workload is increased
www.storageio.com

Measuring I/O Bottlenecks and Peak Workload Activity
Seasonal workload surges (top dotted line) and resulting I/O performance bottlenecks (solid line)
Re esponse T Time
Bad B d Performance P f Good Performance
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Activity or workload (IOPS, transactions, messages, etc.) Response time impact on users as workload is increased Threshold for acceptable performance for response time
www.storageio.com

IT Resources (Server, Storage and Networking) Example
Server ID 1 8 50 0.4 2 12 550 6.4 3 4 64 16 250 1,100 15.6 17.2 5 16 500 7.8 6 4 1,500 5.9 7 8 800 6.3 8 32 Avg. I/O Size (KB) 250 Avg. I/O Rate 7.8 Avg. Transfer Rate Totals 20KB 5,000 67.4
Adapters
Switch Storage
www.storageio.com

Activity Metrics for Server, Storage and Networking Example
Detail from p previous slide
Server Average watts per server I/O Size Kbyte I/O Rate per sec. Bandwidth (Kbyte/sec) IOPS per watt tt Bandwidth per watt 1 2 3 4 5 6 7 8 Total 800 800 800 800 800 800 800 800 6,400 8 12 64 16 16 4 8 32 50 550 250 1,100 500 1,500 800 250 5,000 400 6,600 16,000 17,600 8,000 6,000 6,400 8,000 69,000 01 0.1 07 0.7 03 0.3 14 1.4 06 0.6 19 1.9 10 1.0 03 0.3 0.5 8.3 20.0 22.0 10.0 7.5 8.0 10.0
www.storageio.com

Availability and Reliability Related Items
Term or Acronym AFR A il bili Availability MTBF RPO RTO MTTR Reliability Outage Scheduled downtime Un-scheduled
Description Annual failure rate measured or estimated failures per year Th amount or percentage of The f time i a system able bl and d ready d to work k Mean Time Between Failures measured or estimated reliability Recovery point objective to where data can be restored to Recovery time objective when recovery data is usable again Mean Time To Repair or Replace failed item back into service Systems function as expected when expected with confidence Systems or sub-systems are not available for use or to perform work Planned downtime for maintenance, replacement, and upgrades Un-planned downtime for emergency repair or maintenance
www.storageio.com

Determining Performance and other Measurements
Activity per Second Storage Devices
User Client or Workstation
Network Switch
Application Server
Transient or Pass-Thru Data Traffic (Examples include among others: Frames, Packets, IOPS, Messages, Transactions, Files, Mbytes, Mbits )
www.storageio.com

Virtual Vi t l data d t centers t require i physical h i l resources to t function f ti efficiently ffi i tl and d in i a green or environmentally friendly manner. Thus it is vital to understand the value of resource performance, performance availability availability, capacity, and energy (PACE) usage to deliver various IT services. Understanding the relationship between different resources and how they are used is important to gauge improvement and productivity as well as data center efficiency. For example, while the cost per raw terabyte may seem relatively inexpensive, the cost for I/O response time performance needs to be considered for active data.

Having and H i enough h resources to t support t business b i d application li ti needs d is i essential to a resilient storage network. Without adequate storage and storage networking resources, resources availability and performance can be negatively impacted. Poor metrics and information can lead to poor decisions and management. Establish availability, performance, response time, and other objectives to gauge and measure performance of the end-to-end storage and storage networking infrastructure. Be practical, as it can be easy to get caught up in the details and lose sight of the bigger picture and objectives.

Additional Additi l key k points i t include: i l d
o Balance PACE and PCFE requirements to various levels of service o Compare resources apples to apples apples, not apples to oranges o Look at multiple metrics to get a multidimensional view of resource usage o Use caution with marketing-focused magic magic metrics that may not reflect reality o Metrics and measurements can be obtained or derived from many different sources o Use metrics et cs t that at link to bus business ess a and d app application cat o act activity ty to dete determine ee efficiency c e cy o Establish baseline metrics and profiles to compare current use with historical trends

o o o o Metrics and measurement for management insight Optimize Data Storage for Performance & Capacity Efficiency Performance = Availability PUE, Are you Managing Power, Energy or Productivity?
http:// searchstorage.bitpipe.com/detail/RES/1261065376_927.html
http://storageioblog.com/?p=749 http://storageioblog.com/?p=640 http://storageioblog.com/?p 640 http://storageioblog.com/?p=711
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Part III
Technologies for enabling Green and Virtual Data Centers Chapter 6 Data Center Facilities and Habitats for Technology Green Acres Is the Place to Be Popular Syndicated TV Show Chapter 7 Servers - Physical, Physical Virtual And Software Virtual Data Centers Require Physical Resources Chapter 8 Data Storage Disk, Disk Tape Tape, Optical Optical, and Memory I Cant Remember Where I Stored Those Items Chapter 9 Networking with your Servers and Storage I/O, I/O, Its Off To Virtual Work We Go
Chapter p 6: Data Center Facilities and Habitats for Technology gy

Green Acres Is the Place to Be Popular Syndicated TV Show What you will learn in this chapter
Data centers are habitats for technology Virtual and cloud environments rely on physical resources Physical resources include servers, storage and networking hardware Energy is needed to power IT equipment as well as cool it Heat H t (Btu) (Bt ) is i th the b byproduct d t of f doing d i work k How data centers use power and cooling for IT equipment Standby and alternative power and cooling options Environmental health and safety issues and relevant standards Physical security, fire and smoke detection and isolation
Habitats for Technology gy

Virtual and Cloud Data Centers require Physical Resources
Virtual require Vi t l and d cloud l d datacenters d t t i physical h i l resources to t function f ti and d deliver IT services. Similarly, physical IT resources including servers, storage and networks require habitats or physical facilities to safely and securely house them. An IT datacenter is similar to a factory in that it is a combination of equipment used to transform resources into useful goods and services. Likewise, a factory is more than a room or building full of equipment to process raw goods. A productive factory requires energy, management, automation and other tools to run at peak efficiency In the case of IT data centers, best practices, metrics and measurements for insight into IRM combine with facilities and equipment operating in an energy efficient manner result in a viable and economic data center. center

In and and I addition dditi to t supporting ti growth th of f servers, storage t d networks, t k Green G d Virtual efficient IT data centers need to:
o o o o o o o Support service oriented infrastructure and applications Sustain business growth and dynamic market conditions Enhance business agility and IT service delivery Reduce or contain costs by doing more with less Boost efficiency and productivity of IT equipment and PCFE resources Address PCFE issues and challenges I Increase amount t of f resources managed d per person and d IT b budget d td dollar ll

Common data and include: C d t center t issues i d challenges h ll i l d
o o o o o o o o o o o o Continued demand for more IT services including processing, storage and I/O More data being stored and more copies being retained for longer periods of time Rising energy prices, limits on power availability and distribution bottlenecks HVAC and power distribution use, on average, half of power going into data centers g air handling g units, chillers and related HVAC equipment q p Inefficient existing Over cooling facilities based on dated best practices or older equipment standards Limits on floor space to support and sustain growth Increasing c eas g de density s ty o of IT equ equipment p e t occupy occupying g reclaimed ec a ed floor oo space a and d po power e Constraints on existing standby power generation or cooling capabilities Existing and emerging EHS related recycling and equipment disposition legislation Emerging emissions tax schemes and energy efficiency regulations Shrinking or frozen capital and operating budgets and the need to do more with less
www.storageio.com

The growth Th increasing i i density d it of f IT equipment i t to t sustain t i business b i th and d support t new application capabilities is also resulting in several challenges. Challenges and characteristics of higher density IT equipment include:
o o o o o o o More power required per square or cubic foot (or meter) footprint More servers, storage and networking equipment per rack or cabinet More server compute, storage capacity and performance per footprint More weight per footprint requiring stronger floors More cooling required per footprint from denser equipment More dependency on resources in a given footprint requiring high availability (HA) More images, VMs or operating systems per physical server per footprint
Physical Resources: Servers y

Server density and performance improves to meet demand More Servers in the Same Cabinet Footprint
Server S Server
3rd 4th 5th 6th Generation Generation Generation Generation Time Generation of IT Equipment (Servers, Storage, or Networks) In addition to occupying less physical space within a cabinet, cabinet rack or blade center, center each successive generation also provides an increase in net processing or compute power along with a boost in memory and I/O capabilities, as seen in figure 6.2. Figure 6.2 shows an example of how primary and secondary power constraints exist until a future upgrade to facility powering capabilities boosts the per cabinet power footprint. Also shown in figure 6.2 are the relative increases in power required per cabinet as the quantity of servers, their speed and number of processing cores increase.
1st Generation
2nd Generation
www.storageio.com
Physical Resources: Servers y

Server density and performance improves to meet demand Impact of Increasing Density of IT Equipment
Available Power & Cooling per Cabinet Footprint Threshold Required Power per C bi t Cabinet Relative Processing Capabilities per Server (Quantity of Mhz or Ghz and Cores)
Server Density per Rack 1st Generation 3rd 4th 5th 6th Generation Generation Generation Generation Time Generation of IT Equipment (Servers, Storage, or Networks)
www.storageio.com
2nd Generation

Power Generation Power Transmission
Power Control Unit Generator
UPS Motor Generator Battery Backup
PDU
PDU
CRAC Storage g Switch Servers
CRAC
Uninterruptible Power System (UPS), Power Distribution Unit (PDU), Computer Room Air Conditioning (CRAC)
www.storageio.com

Basic B i or essential ti l tenets t t of f a habitat h bit t for f IT equipment i t resources include: i l d
o o o o Electrical Power primary and standby, distribution and conversion Cooling chilling, heating, ventilation, air conditioning (HVAC) Floor space and cable management raised floor or overhead conveyance EHS related practices and management recycling, reuse, disposal of resources

Additional Additi l components t include: i l d
o o o o o o o o o o o Fire detection and suppression Computer room air conditioners (CRAC) Smoke and exhaust ventilation and air filtration Physical security, monitoring and surveillance Receiving shipping Receiving, shipping, storage and staging areas Workspace and operations control centers Mechanical rooms, zones Water and fuel f reserves f for standby power Communications write closets and demarcation points Racks, cabinets, cable management and conveyance Asset management, monitoring, measurement, test, diagnostic and IRM tools
www.storageio.com

Examples of standby and alternate power for data centers
Standby Alternate Backup Automatic Surge Perform an Generator Power or UPS Power Suppress Energy Feed Switching g Assessment Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Optional Optional Optional Optional Yes Yes Optional Optional Optional Optional Yes Yes O ti l Optional Optional O ti l Optional O ti l Optional O ti l Y Yes Y Yes Optional Optional Optional Optional Yes Yes
Ultra-Large Large Equipment Closet Coffee, Copy Room Digital Home
www.storageio.com
Habitats for Technology: gy Power & Cooling g

IT Data center cooling without plenums or exhaust ducting
Building Roof
H t Ai Hot Air
H t Ai Hot Air
Equipmen nt Cabinet
Equipmen nt Cabinet
Equipmen nt Cabinet
CRAC
Equipmen nt Cabinet
Hot Aisle
Cool Aisle
Perforated Floor Tile
Hot Aisle
Cool Aisle
Hot Aisle CRAC
Raised Floor
Cool Air
Cool Air
Power and Networking Cable Conveyance

www.storageio.com

Overhead ceilings with air return via plenums to CRAC units
Building Roof
Perforated Ceiling Tile

H t Ai Hot Air

H t Ai Hot Air
Plenum
Equipmen nt Cabinet
Equipmen nt Cabinet
Equipmen nt Cabinet
CRAC
Equipmen nt Cabinet
Hot Aisle
Cool Aisle
Hot Aisle
Cool Aisle
Hot Aisle
CRAC
Raised Floor
Cool Air
Cool Air

www.storageio.com
Plenum

Cooling using sloped ceiling with warmer air near the ceiling
Building Roof
Hot Air
Hot Air
Equipmen nt Cabinet
Equipmen nt Cabinet
Equipmen nt Cabinet
FAN
Equipmen nt Cabinet
Cool Aisle
Hot Aisle
Cool Aisle
FAN
CRAC or Heat Exchange
Raised Floor
Cool Air
Cool Air
CRAC or Heat Exchange

www.storageio.com

Hybrid Data Center with Alternative Cooling & Energy Sources
Natural Gas, Coal, Nuclear, Hydro, Wind, Fuel Wi d Solar, S l Methane, M th F l Cell C ll Electric Utility Co-Generation Solar Power
Power Control System Generator UPS Cooling Facility or Mechanism Economizer, Heat Pumps, Central Heating and Cooling
www.storageio.com

Fire include: Fi suppression i topics t i and d issues i i l d
o Water based solutions do not mix well with electrically powered IT equipment o Metallic and other water based residue can damage equipment after drying o Chemical Ch i l b based d approaches h address dd water t iissues b but th have other th challenges h ll o Hydroflourocarbon (HFC) are liquefied for storage and dispensed as a gas o Halon based systems are costly to maintain, recharge and being discouraged o FM200, FM200 NAFS3 solutions l ti are being b i used d iin place l of fH Halon l systems t o CO2 cause thermal shock from rapid temperature drop damaging circuit cards o Halon, FM200 and other agents separate CO2 from the fire triangle o Some concerns exist around FM200 due to Montreal Protocol treaty o Costly equipment or plumbing changes may be needed to change suppressants o Inergin is emerging as both an environmental and equipment friendly solution o Some agents and suppression techniques are not safe for human occupied areas o Some agents leave residue that can damage sensitive electronic equipment

Environmental, Health and Safety (EH&S)
Green is being G i often ft associated i t d with ith or perceived i d as b i an electrical l t i l power iissue with ith regard to IT data center, including the reduction of associated emissions. From a physical facilities perspective, the U.S. Green Building Council (www.usgbc.org) has established the Leaders in Energy and Environmental Desig (LEED) green building rating system. system LEED exists for residential and commercial as well as other types of building. There are various LEED rating systems and guides for f both new construction and remodeling of existing structures.

Environmental, Health and Safety (EH&S)
For F data d t centers t in i addition dditi to t reducing d i the th amount t of f electrical l t i l power used d or making more efficient use of available electrical power to support growth by reducing cooling demands, other actions include:
o o o o o o o o Reduction in the amount of water required for cooling Leveraging technology and digital media disposal services Elimination of hazardous waste material from discarded IT equipment Recycling of paper from printers and copiers along with equipment shipping cartons Removal of non RoHS equipment mercury, containing bromine, chlorine and lead Implementing an ISO 14001 and OHSAS 18001 EHS and related systems Adhering to other existing and emerging EHS and emissions related legislation Measuring vendors or suppliers on their EHS and related management programs
Habitats for Technology: gy Fire Protection

Type and Classes of Fires and Suppressants
Symbol US Europe Fuel or Heat Source Comment on Usage Type of Suppressant
Class A
Class A
Class D
Class D
Class C
Class E
Class B
Class B
Class B
Class C
For use on wood, Remove heat, wood heat oxygen or fuel applying paper and other water to cool, removing oxygen with common combustible CO2, nitrogen or foam from an materials extinguishers or elimination of fuel. Combustible Flammable metals Water can enhance metal based fires Metals such as titanium, and instead suppressed with dry agents magnesium and to smother and remove heat. lithium Electrical Suitable for electrical Avoid water or other conductive foam Equipment fires using nonagents that put fire fighter into danger of conductive agents electrical shock if electricity is not disabled. CO2 and dry chemical agent based suppressants should be used. Flammable Fires involving Avoid water which causes fuel to Liquids flammable liquids spreading. Inhibit chemical chain reaction including grease, with dry chemicals or suppression agents gasoline and oil. or smothering with foam and CO2. Flammable gases Similar to above, focused on gases
www.storageio.com
Ordinary combustible
Habitats for Technology: gy High g Density y

Data Center in a Box: Data Center in a Shipping Container
www.storageio.com

Have an assessment H t including i l di air i flow fl and d temperature t t analysis l i performed f d Investigate where power is used along with upgrades to newer technology Consolidate where practical, implement newer faster technology where needed Investigate safely raising air temperature in different zones Practice IRM and data management to reduce impact of expanding data footprint Leverage alternative energy sources and co-generation Capitalize on energy incentives and rebate opportunities Integrate technology and facilities planning across IT groups

o Virtual and cloud data centers require physical resources o Physical resources include servers, storage, networks o Habitats for technology house physical IT resources o Habitats for technology have primary and secondary power and cooling o Heat is the by product of converting energy to useful work (btus) o Avoid work and you avoid energy consumption and heat removal (cooling) o However avoid work and what is purpose of a data center? o Instead I t d maximize i i useful f l work k accomplished li h d per watt tt of f energy consumed d o Heat removal (cooling) as close to the heat sources is the most effective o Macro metrics such as the Green grid PUE indicate facility efficiency

o PUE does not indicate how well energy is used to accomplish useful work o Leverage metrics that show how much work per watt of energy is accomplished o Server, storage and networking densities are increasing as are their performance o Consequently, look for more work to be done, data to be moved, or data stored per watt of energy as well as require less energy for heat removal o Some data centers are constrained by available primary power o Some data centers are constrained by available secondary (standby) power o Some data centers are constrained by available cooling or floor space o Keep physical security of the data center and its resources in mind o Look to avoid single points of failure in the physical facility

o o o o Time To Invest In Information Factories Shifting from energy avoidance to energy efficiency The Changing Dynamic of the Data Center Power Play http://storageioblog.com/?p=767 http://storageioblog.com/?p=562
http://ipip.intel.com/go/7219/the-changing-dynamic-of-the-data-center/ http://ipip.intel.com/go/7219/the changing dynamic of the data center/
http://edtechmag.tmg-dev.net/k12/events/updates/power-play.html
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter Virtual And Software p 7: Servers - Physical, y

Virtual Data Centers Require Physical Resources What you will learn in this chapter
Demand drivers for more servers More servers consume more p power and g generate more heat The challenges associated with increased server densities The benefits associated with increased server densities Differences between physical and virtual servers The many facets of server virtualization Next big server virtualization wave: Life beyond consolidation Differences between cloud, clustering and grid computing
Physical and Virtual Servers y

Virtual also and blade Vi t l Computers, C t l known k d referred f d to t as blade bl d centers t or bl d servers, desktops, laptops, Mainframes, personal computers (PCs), processors, servers and workstations, are a key component and resource of any data center or information factory. The importance of computers is that they run or execute the program software that performs various application and business functions. Hardware does not function without some form of software including microcode, firmware, operating or application software, software and software does not function without hardware. The next truly revolutionary technology, in my opinion, will be software that does not require hardware and hardware that does not require software software.

In on average, are the I the th typical t i l datacenter d t t computers, t th second d largest l t consumer of f electrical power behind cooling. Computers, in addition to requiring power, cooling, and floor space, have an environmental health and safety (EHS) footprint in the form of electronic circuit boards, battery backed internal power supplies along with other potential hazardous substances b t th t need that d to t be b recycled l d and d disposed di d of f properly. l The larger the computer, the more components, the smaller the computer, for example a laptop or desktop workstation PC, the fewer and smaller components, however they have monitors or screens and batteries.

Servers in S i generall need d to: t o Be available, able to run applications when needed to meet service requirements o Fit into a smaller physical, power and cooling footprint doing more work efficiently o Achieve more performance per watt of energy o Support applications that continue to grow and add new functionality and features o Be configured and redeployed to meet changing market and business dynamics o Be seen as a key resource to enable IT services in an effective manner

Servers are a key technology based S k resource for f supporting ti information i f ti t h l b d services. Some drivers that are pushing the continued demand and limits of available processing performance include:
o Expansion and enhancement of existing applications with faster response time o Higher volume of transactions, messages, downloads, queries and searches o Marketing analysis and data mining to support targeted marketing efforts o Simulation and modeling for product design and other predictive services o On-demand media and entertainment services including gaming and social networking pp ( (SOA) ) to support pp data mobility y and Web 2.0 o Service oriented applications o Medical and life science along with essential emergency support services o High performance scientific, energy, entertainment, manufacturing & financial services o Defense and security surveillance related applications o Massive scale-out and extreme computing- the opposite of consolidation opportunities

Some common issues and pertaining S i d challenges h ll t i i to t servers in i generall include: i l d
o Continued sprawl of servers in environments with reduced PCFE footprint capabilities o Multiple low cost or volume servers dedicated to specific functions or applications o Under-utilized servers and increasing software and management costs o Servers that cannot be consolidated due to application, business or other concerns o Applications that have or will out-grow the capabilities of a single server o Performance, availability, capacity and energy consumption o Timely and complex technology migration with associated application downtime o Support S for f new computing and IT service capacity and models o Growing awareness of importance of data and information security concerns o Dependencies by IT services users on the availability of applications when needed o Shifting focus from disaster recovery to business continuance and disaster avoidance

The growth Th increasing i i density d it of f IT equipment i t to t sustain t i business b i th and d support t new application capabilities is also resulting in several challenges. Challenges and characteristics of higher density IT equipment include:
o o o o o o o More power required per square or cubic foot (or meter) footprint More servers, storage and networking equipment per rack or cabinet More server compute, storage capacity and performance per footprint More weight per footprint requiring stronger floors More cooling required per footprint from denser equipment More dependency on resources in a given footprint requiring high availability (HA) More images, VMs or operating systems per physical server per footprint

Servers consume different S diff t amounts t of f electrical l t i l power and d generate t various i amounts of heat depending on their operating mode. For example, from no power consumption when powered off, to higher amounts of energy used during startup. Other states of energy use by servers include running with active or busy workload without energy saving reduced performance modes enabled and less power used during low power, sleep or standby modes. With the need for faster processors to do more work in less time, time there is a corresponding effort by manufacturers to enable processing or computer chips to do more work per watt of energy as well as reduce the overall amount of energy consumed.

Servers and S d computers t in i generall generate t heat h t by b using i electricity: l t i it
o Increased density of chip level logic gates and corresponding switching speed o Processing chips and support chips can consume 30% or more power per server o Power supplies and cooling fans can account for 30-40% of power used by a server o Video monitors are a large consumer of power on laptops and workstations o Power used for memory for storing data and programs o Support chips for memory, I/O and other peripheral access and internal busses o Adapter cards for networking and I/O including transceiver optics o Power supplies, power distribution and cooling fans f o Optional battery backup UPS that may be part of a server

To server demands techniques and T address dd d d and d issues, i t h i d approaches h include: i l d
o Consolidation of under-utilized servers using virtualization software o Shift from consolidation to using virtualization for management transparency o Enable rapid provisioning or re-provisioning of servers to meet changing needs o Facilitate BC and DR testing and implementation using fewer physical resources p y and enable faster technology gy upgrades pg and replacement p o Remove complexity o Reduce application downtime for scheduled and un-planned maintenance o Awareness and demand for clustered, grid and cloud services oriented applications o Desktop es top virtualization tua at o for o consolidation co so dat o of o thin t client c e t app applications cat o s a and d dy dynamics a cs o Technology to address PCFE issues including 80% plus efficient power supplies o Improved best practices and rules of thumb to boost efficient use of energy o ENERGY STAR for servers as a means to compare server energy efficiency o Recycle of retired equipment along with RoHS and EHS friendly technology

Moores Law
Courtesy of Intel.com
In 1965, Gordon Moore, who co-founded computing chip giant Intel, made an observation (now known as Moores Law) that the number of transistors per square inch on an integrated circuit (IC) had doubled every year since the IC ( chip) (or hi ) was invented. i t d Moores M Law L predicted di t d that th t the th trend t d would ld continue ti i t the into th foreseeable f bl future f t which, hi h for f the th most part, is holding true over 40 years later (Figure 7.1). While the pace has slowed a bit for processors, the amount of data density doubling every 18 to 24 months is also included under Moores Law. What is important about understanding Moores Law is that the general industry consensus among IT professionals, manufactures, analysts and d researchers h is i that th t the th current t trends t d will ill hold h ld true t into i t the th foreseeable f bl future f t or at t least l t a few f more decades. d d Thus, future processor and storage needs can be estimated by looking at past supply and demand.
www.storageio.com
The need for virtual and p physical servers y

Growth and Demand Drivers for Server Compute Capabilities
Denser servers, storage, and networks Virtualized development and IT resources Services oriented architectures Smaller, faster, more affordable, increased volume Advanced operating and file system features Advanced programming and development tools Graphical user interfaces and ad-hoc tools Increased memory and processor capabilities Physically smaller, more affordable and reliable Enhanced operating and file system features Applications need more processing capabilities Compilers and programming languages Interactive, online, and time sharing Limited memory and processor constraints Physically large, expensive capabilities Assembler, machine code, batch processing
Web 2.0, SOA, SaaS Virtualization and Massive Scaling ISP, MSP, ISP, SSP Web 1.0 Client server, GUIs PCs Internet PCs, Minis and Servers Online
Cloud
Consolidate Redistribute Consolidation Distributed IT
Mainframe Batch
Service Bureau Highly Centralized
www.storageio.com
Server Footprint Evolution p

Doing More in the Same or Smaller Footprint
More processing power per footprint (square foot or meter, cabinet U space) Performance density improvements and cost reductions continue Same floor space occupied to host more compute capabilities More processing cycles will be needed moving forward More processing g cycles y per watt of energy gy consumed Power, cooling, floor space, and EHS improvements 128 Servers (blade centers)
Single large server
Same footprint Different generations over time
24 Servers
Four servers
Eight servers

General Purpose Computer Hardware Architecture
Representative Computer Hardware Architecture SAS Ports LAN Ports USB Ports IDE Ports SATA Ports PCIe PCIe PCIe PCIe PCI/PCIx Bridge g Graphics MCH or Internal Connection Bus Processor CPU Processor CPU Single, double, quad, Multicore (e.g. 8-way) Memory- -DIMM DIMM M Memory Memory DIMM Memory - DIMM Memory - -DIMM Memory DIMM Memory Memory- -DIMM DIMM DDR RAM
www.storageio.com
Memory y and Storage g Pyramid y

Balancing Performance, Capacity and Cost
Most performance Least capacity Highest cost Processor Registers, L1 & L2 Cache Onboard memory Quality of service (QoS) and service level vs. Server cost trade trade-offs offs Main memory RAM, RAM ROM, NVRAM, internal HDDs External Storage Cache appliance and cache on storage SSD RAM and FLASH-based Fast 2.5 & 3.5 SAS and FC HDDs Slower high-capacity SAS and SATA HDDs Magnetic tape and optical storage media I t Internet/Web t/W b and d cloud-based l d b d storage t services i
Less energy/cooling Most persistency Less performance Lowest cost
www.storageio.com

Blade Center with Various Types of Blades
Processing or Compute Blade Number and Speed of Processors (CPU Cores) Memory Speed and Capacity (Mirrored or Nonmirrored) Number and type of I/O and Network Connectivity Optional Hard Disk Drives or Storage Storage Blade Multiple Hard Disk Drives SAS or SATA Storage Optional Solid-State Disk RAM or FLASH I/O and Networking Connectivity Blade O ti l Pass-Thru Optical P Th to t External E t l Devices D i Embedded Switches 1 GbE/10 GbE, Fibre Channel, InfiniBand PCIe IOV ( (PCIe Bus Extension) ) Converged Network Adapters
www.storageio.com
Blade Center
Many y Faces of Server Virtualization

When and Where to Use Server Virtualization
Virtualization for Vi t li ti is i not t new technology t h l f servers. Virtualization Vi t li ti has h been b around for decades on a proprietary basis with PC emulation, LPARs and hypervisors as well as virtual memory and virtual devices. What is new and different is the maturity and robustness of virtualization as a technology including the broad support for x86 based hypervisors and other proprietary hardware ISA based solutions.

Examples of virtualization HyperVisors include E l f software ft i t li ti H Vi i l d vSphere/ESX. Microsoft HyperV and Citrix Xen among others VMware VM
There are many facets and functionalities of server virtualization that vary by specific implementation and product focus. Primary functionalities different virtualization solutions can support in various combinations include:
o Emulation co-existence with existing technologies and procedures o Abstraction Ab t ti management t transparency t of f physical h i l resources o Segmentation isolation of applications, users or other entities o Aggregation consolidation of applications, operating systems or servers o Provisioning rapid deployment of new servers using predefined templates

Server virtualization S i t li ti can be b used d for: f
o Support and enable server consolidation to improve resource utilization o Address PCFE issues and costs to support pp new applications pp and sustain g growth o Enable faster backup and data protection to enhance BC and DR capabilities o Eliminate vendor lock-in and lower hardware costs and operating costs o Enable E bl t transparent td data t movement t and d migration i ti f for f faster t t technology h l upgrades d o Facilitate scaling beyond limits of a single server and enable dynamic load balancing o Improve application response time performance and user productivity o Reduce complexity or streamline IT resource management

Different Usage Scenarios From Consolidation to Availability
Consolidation Single Server Consolidation with High Availability Redundant Servers
Scaling S li Beyond B d Single Si l Server S Scaling S li Beyond B d Single Si l Server S Software Changes Single Operating System
www.storageio.com

Server Virtualization Deployment Topics
Questions to Q ti t consider id pertaining t i i to t deploying d l i server virtualization i t li ti include: i l d
o o o o o o o o o o What are application requirements (performance, availability, capacity, costs)? What servers can and cannot be consolidated? Will a solution enable simplified software management or hardware management? Will a solution be workable for enabling dynamic resource management? How will a technology work with existing and other new technologies? How will scaling performance, capacity, availability and energy (PACE) be addressed? Who will deploy, maintain and manage a solution? Will vendor lock-in be shifted f from f hardware to a software f vendor? ? How will different hardware architectures, and generations of equipment co-exist? How will a solution scale with stability?

Non Virtualized and Virtualized for Consolidation Example
Non virtualized Virtualized for Consolidation
Applications Operating System Virtualization Solution Layer Hardware Architecture CPUs M Memory Disk HBA or NIC
Hardware Architecture CPUs M Memory Disk HBA or NIC
www.storageio.com

Virtual Servers and Virtual Disk File Replacements
Virtualized Server for Consolidation
Generic VM Virtual Disk Representation Other Files OS Image Files VM Files
Virtualization Solution Layer Hardware Architecture CPUs M Memory Disk HBA or NIC Physical Server
www.storageio.com

Server and Operating System Containers & Partition Example
Applications Applications pp Applications Partition or Container
Applications Applications pp Applications Partition or Container Operating System
Applications Applications pp Database Partition or Container
Hardware Architecture
CPUs Memory
Disk HBA or NIC
www.storageio.com

Application Virtual Machine Examples
JRE and Java Machine
Applications Applications pp Applications
Applications pp Applications pp Database
Application Virtual Machine
File Systems
Operating System Hardware Architecture CPUs M Memory Disk HBA or NIC
www.storageio.com
Virtualization: Life Beyond Consolidation y

Markets and IT Opportunity for Server Virtualization
Issues That Inhibit Consolidation QoS and performance barriers Politics and financial constraints Competitive or legal purposes Security and compliance
Total Server or Storage Market Size Functionality F ti lit Emulation Abstraction Aggregation gg g Migration
Consolidated Servers or Storage Using Virtualization
Nonconsolidated Servers or Storage g Only a fraction of all servers or storage can be Market and IT consolidated! Virtualization Opportunity!
Market and IT Opportunity = Life Beyond Consolidation Using server virtualization for IT resource management enabling abstraction and transparency for massive scaling and routine infrastructure resource management operational functions
www.storageio.com

Memory Usages for Server Virtual Machines
Virtualized for Consolidation Guest Operating System Virtual Memory VM Memory Physical Shared RAM Memory
Hardware Architecture CPUs Memory Disk HBA or NIC
Memory Paging File
www.storageio.com

Server Virtualization Deployment Topics
Questions to Q ti t consider id pertaining t i i to t deploying d l i server virtualization i t li ti include: i l d
o o o o o o o o o o What are application requirements (performance, availability, capacity, costs)? What servers can and cannot be consolidated? Will a solution enable simplified software management or hardware management? Will a solution be workable for enabling dynamic resource management? How will a technology work with existing and other new technologies? How will scaling performance, capacity, availability and energy (PACE) be addressed? Who will deploy, maintain and manage a solution? Will vendor lock-in be shifted f from f hardware to a software f vendor? ? How will different hardware architectures, and generations of equipment co-exist? How will a solution scale with stability?

Servers are essential applications and S ti l for f running i business b i li ti d processing i data. d t Demand for server compute power continues to increase, and servers depend on electrical energy to function. The by product of electrical consumption by servers that run faster and do more work in a smaller density footprint is heat that needs to be removed. Heat removall requires i additional dditi l energy. Consequently, if servers can generate less heat while doing more work, less cooling is needed resulting in energy savings. savings Energy savings can be used to reduce costs or to support and sustain growth.

One O approach h to t eliminate li i t server heat h t and d energy consumption ti is i to t power servers off. While this is relatively easy for laptops, desktops and workstations, simply turning all servers off is generally easier said than done. Implementation of intelligent power management, smart power switching, dynamic cooling and other techniques, manually or automatically, will enable servers t to use lless energy during d i low l usage or idl idle periods. i d Servers will continue to improve in processing ability while fitting into smaller footprints and improving on energy efficiency and cooling cooling. Some of the improvements are coming from low level fabric techniques on chips, level resources usage, including power gating and variable speed or frequency, along with packing improvements. improvements

Consolidation PCFE iissues and C lid ti of f under-utilized d tili d servers can address dd d reduce d hardware costs. However, server virtualization does not by itself address operating system and application consolation and associated cost savings. If cost savings are a key objective, in addition to reducing hardware costs, consider how software costs, including licenses and maintenance fees can be reduced d d or shifted, hift d t to b boost t savings. i Near term, there is a large market opportunity for server consolidation with an even larger market opportunity for virtualization of servers to enable scaling and transparent management on a longer term basis.

Additional Points: Additi l Take T k Away A P i t o Use caution with consolation to avoid introducing performance or availability problems o Look into how virtualization can be used to boost productivity and support scaling o Explore new technologies that support energy efficiency and boost productivity o Understand data protection and management issues pertaining to virtualization o Server consolation addresses hardware costs, costs consider software costs separately o Blade servers can be used for consolation along with enabling scaling o Not all servers can be powered down, not all redundancy can be simply removed o Some servers can run part of the time at lower performance and energy consumption o Investigate intelligent and dynamic cooling including cooling closer to heat sources

o o o o Should Everything Be Virtualized? The vPad Virtualization: Life beyond consolidation The Changing Dynamic of the Data Center http://storageioblog.com/?p=719 http://thevpad.com/ http://storageioblog.com/?p=426 http://storageioblog.com/?p 426 http://ipip.intel.com/go/7219/the-changing-dynamic-of-the-data-center/
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter p 8: Data Storage g Disk, Tape, Optical, and Memory y

I Cant Remember Where I Stored Those Items What you will learn in this chapter
How an expanding data footprint results in increased management costs and complexity Data storage management is a growing concern from a PCFE standpoint There are many aspects of storage virtualization that can help address PCFE challenges
Servers rely on data storage for applications, data and virtual machines
Data Storage g
Importance of Storage and Impact on Virtual Data Centers
Next N t to t facilities f iliti cooling li for f all ll IT equipment i t and d server energy usage, external data storage is the next largest impact on power, cooling, floor space, environmental (PCFE) in most environments. In addition to being one of the large users of electrical power and floor space with subsequent environmental impact, the amount of data being stored and th size the i of f it its corresponding di data d t f footprint t i t continue ti t to expand. d Though more data can be stored in the same or smaller physical footprint than in the past past, thus requiring less power and cooling, cooling data growth rates necessary to sustain business growth, enhanced IT service delivery and enable new applications are placing continued demands on available power, cooling floor space and environmental resources cooling, resources.
Data Storage g
There are many approaches associated Th h to t addressing dd i PCFE issues i i t d with ith storage ranging from using faster more energy efficient storage that performs more work with less energy to powering down storage supporting inactive data, such as backup or archive data, when not in use for extended periods of time. Whil While adaptive d ti and d intelligent i t lli t power management t techniques t h i are increasingly i i l being found in servers and workstations along with their associated operating system support, power management for storage has lagged behind on a relative l ti basis. b i
Data Storage g
General to related G l steps t t doing d i more with ith your storage t l t d resources without ith t negatively impacting application service availability, capacity or performance include:
o Assess and gain insight as to what you have and how it is being used o Develop a strategy and plan (near-term and long-term) for deployment o Use energy effective data storage solutions (hardware and software) o Optimize data and storage management functions o Shift usage habits to allocate and use storage more effectively o Reduce your data footprint and subsequent impact on data protection o Balance performance, availability, capacity and energy consumption o Change buying habits to focus on effectiveness o Measure, reassess, adjust and repeat the process
Data Storage g
Approaches, and storage efficiency include: A h techniques t h i d technologies t h l i to t improve i t ffi i i l d
o Spinning down and powering off HDDs when not in use o Reducing power consumption by placing HDDs into a slower mode o Doing more work with less power to boost efficiency o FLASH and Random Access Memory (RAM) and solid state disk (SSD) o Consolidation to larger capacity storage devices and storage systems o Using various RAID levels and tiered storage to maximize resource usage o Leverage management tools and software to balance resource usage o Reducing your data footprint f via archiving, compression, and de-duplication
Expanding p g Data Footprint p

More Data Being Stored, Copied, Backed-up, Protected
Sparse, Duplicate Files and Content Original Data Copies/Data Proliferation and Expanding Data Footprint In addition to storage space capacity, IOPS and MBPS to move data also need to be considered.
App-a App a
App-b App b
App-c App c
10 TB
8 TB
2 TB
RAID 1+ 0 RAID 1 RAID 5
10 TB 10 TB 10 TB
8 TB 8 TB
2 TB
10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB
Challenge: More data to backup, protect and manage Solution: Reduce footprint impact: Archive, Compress, De De-dupe, dupe, Tiered Storage
See Business Benefits of Data Footprint Reduction www.storageio.com
www.storageio.com
Data Storage g
The Th overall ll data d t footprint f t i t is i the th total t t l amount t of f data d t including i l di all ll copies i plus l the additional storage required for supporting that data such as extra disks for Redundant Array of Independent Disks (RAID) protection or remote mirroring. Consequently, the larger the data footprint the more data storage capacity and performance bandwidth needed and that have to be powered, cooled and housed in a rack or cabinet on a floor somewhere. Costs associated with supporting an increased data footprint include:
o Data storage hardware and management software tools acquisition o Associated A i t d networking t ki or I/O connectivity ti it hardware h d and d services i o Recurring maintenance and software renewal fees o Facilities fees for floor space, power and cooling o Physical and logical security of data and IT technology assets o Data protection for HA, BC/DR including backup, replication and archiving
Tiered Storage g and Storage g Access

Balancing Performance, Availability, Capacity, Energy (PACE)
$ / GB
G (Capac GB city) per k kWh Best Worse Balancing IT Resources Performance, Availability, Capacity, and Energy (PACE) RAID5 Tier-2 Tier-1 FC and SAS 10K and 15K SATA 5.4K and 7.2K 750 GB and 1 TB Tape, Optical Tier-3 MAID 2 2.0 0 RAID 6 etc IPM RAID 0, 1, 1+0 SSD, FLASH, , CACHE RAM, $ / IOPS Best Tier-0 IOPS or Bandwidth (Performance) per kWh RPM = Revolution Per Minute performance
Worse
www.storageio.com
Tiered Storage: g Different Types yp of HDDs

Balancing Performance, Availability, Capacity, Energy
How much energy is needed to power 100TByte of storage? The answer is that it depends on the type, type category and even price band of the storage being considered. There are several variables. For example, the size of the storage system (e.g. price band) or category or type of tiered storage medium being used and how it is configured and if comparing raw vs. usable RAID protected storage and which RAID level along with the storage is being compared on an effective basis using a compression or deduplication p ratio.
Capacity Speed (RPM) Interface Active Watts/hr Capacity Increase
73GB 73GB 73GB 15.4K 15.4K 15.5K 2GFC 4GFC 4GFC 18.7 15.8 15.2 N/A N/A N/A
146GB 15.5K 4GFC 17.44 2x
300GB 15.5K 4GFC 21.04 4x
500GB 7.2K SATA 16.34 6.5x
750GB 7.2K SATA 17.7 10x
1.5TB 7.2K SATA 17.7 20x
In Table 8.1, the active watts represent an average burdened configuration, that is, the HDD itself plus associated power supplies, cooling and enclosure electronics per disk for active running mode. Lower power consumption can be expected during low power or idle modes as well as for an individual disk drive minus any enclosure or packaging. In general, 100TBytes of high performance storage will require more power and subsequent cooling capacity than 100TBytes of low cost, high capacity disk based storage. Similarly, 100TBytes of high capacity disk based storage will consume more power than 100TBytes of magnetic t tape b d storage. based t A an example, As l a mid-range, id mid id price i band b d storage t system t with ith redundant d d t RAID controllers t ll and d 192 750GByte 7,200RPM or 5,400RPM SATA HDDs in a single cabinet could consume about 52,560 kWh of power per year (not including cooling).
www.storageio.com
Tiered Storage: Design g Storage g System y g

Traditional Mid-range Storage (SAN, DAS, NAS) Architecture
Blade center Application Servers LAN SAN / DAS Block or File/NAS Storage controllers, NAS nodes, Storage processors o Front o te d po ts end ports o Back end ports o Single/dual controller o Active / Active or o Active / Passive o Mirrored cache o Shared disk Front end (FE)
GbE CPU Memory PCI 4Gb FC 4Gb FC PCI 4Gb FC 4Gb FC GbE PCI CPU Memory
FC, GbE, SAS
Cache Mirroring
4Gb FC PCI 4Gb FC
Back end (BE) FC/SAS/SATA disk di k drives di

EMC CLARiiON/Celerra, HDS AMS/WMS, HP EVA, IBM DS3K/DS4K, LSI, SGI, Sun, NetApp & IBM NSxx and many others
FC & SAS
Tiered Storage: g Clustered Storage g

Clustered Storage and Clustered File Serving Landscape
Clustered Storage Characteristics

Aka Grid, Peer, RAIN, Etc Host and server connectivity access Block File, Block, File Object based access iSCSI, Fibre Channel, NAS, CAS, VTL Tightly or loosely coupled cluster D di Dedicated d or shared h d storage d devices i Open or closed, tight or loosely coupled Share everything, nothing, something Workload and application optimization Small random vs. large sequential Workload and capacity load balancing Management tools and interfaces

Clustered and Bulk Storage Example
Applications (Structured and Unstructured Data)
VolCD V lCD \\SharedC1 VolCC
Video/Audio
File Serving
Billing, e-tail
Database, DSS
Email Messaging
CAD, EDA, ERP, Software Dev.
Application Servers Data Access Network Storage g and File Serving g and Cluster Storage g Software Internal DAS
Front End
Processors
External DAS RAID / JBOD External shared RAID P Proprietary i t or third thi d storage party storage
Back End Disk storage access


Applications That Benefit From Clustered and Bulk Storage
o Unstructured data, spreadsheets, PDFs and slide decks o Email systems including Microsoft Exchange personal (.PST) files o Web on-line on line data storage and data protection or backup o Rich media content data delivery, hosting or social networking o Media entertainment including rendering and post-processing o Databases such as Oracle with NFS V3 direct I/O (DIO) o Financial services and telecommunications, transportation, logistics and manufacturing o Project-oriented software and technology development, simulation and energy exploration o Real-time security, y, fraud detection, , electronic surveillance o Life sciences, chemical research, software development & computer aided design (CAD)
Storage and Efficiency g Optimization p y

Different Tiers of Storage and Service Characteristics
Tier-1 Tier-2 Tier-3 Performance and Capacity Capacity and Low Cost High Capacity Low cost Centric Centric Centric Transaction logs and Active on-line files, Home directories, file Monthly or yearly full journal files, paging files, databases, email and file serving, Web 2.0, data backups, long term lookup and meta data files files, servers video serving servers, backups and snapshots, snapshots archives or data retention very active database needing performance and bulk data storage needing with accessibility traded for tables or indices storage capacity large capacity low cost cost or power savings Dollar per IOPSs Activity per watt of energy Capacity density per Capacity density per IOPS or Activity per watt of and capacity density and energy used with energy used with energy and given data given data protection level performance for active bandwidth when accessed protection level data at protection level at protection level Low capacity and high Primary active data Low cost point, high Low cost and high capacity performance very low requiring availability and density. or FAT 5.4K or 7.2K RPM power consumption. consumption performance 10K or 15K performance. 5 4K or 7 5.4K 7.2K 2K RPM SAS SAS, SAS SATA or FC HDDs. SAS, HDDs DDR/RAM, FLASH or RPM 2.5 or 3.5 FC, SCSI SATA or FC HDDs with Magnetic tape and optical some combination and SAS HDDs capacities in excess of 1TByte and mid-range arrays Bulk and IPM based Tape libraries, MAID/IPM Cache, Caching A li Appliances, SSD (FLASH (FLASH, t or optical ti l storage, t storage RAM). removable HDDs Tier-0 Tier 0 Very high performance
www.storageio.com
Usage
Comparison
Attributes
Examples

MAID and Intelligent Power Management (IPM)
Massive/Monolithic/Misunderstood Array of Idle/Inactive Disks (MAID)
No MAID
Some MAID
More MAID 1.0
All Disks Spinning/Active No Performance Impact No Energy Savings
25% of Disks Spun Down Some Performance Impact 25% Energy Savings Disk On
25% of Disks Active Major Performance Impact 75% Energy Savings Power Surge on Startup Disk Off
See MAID 2.0: Energy Savings without Performance Compromises www.storageio.com

www.storageio.com

Energy Avoidance Power Off Servers and Storage
Address issues of 1st generation MAID
o o o o o Shift from energy avoidance to energy efficiency Similar to multiple power management settings on a PC Intelligently align energy savings to service needs More flexible granularity for different applications Multiple MAID levels vary performance and energy savings MAID Level 0 MAID enabled, no savings, no impact to applications MAID Level 1 Park heads, disable read/write heads, Some savings MAID Level 2 Slow disk drive to slower speed, saving more power MAID Level 3 Spin down disk to standby mode, save more power
See MAID 2.0: Energy Savings without Performance Compromises www.storageio.com


Examples of Data Footprint Reduction (DFR)
Archiving Compression De-Duplication A hi i C i D D li ti Backup or Archiving or Structured (Database), On-line (Database, Email, Email and UnFile Sharing), Backup or recurring and similar data Archive structured Software to identify and Reduce amount of data to Eliminate duplicate files or remove un-used data be moved (transmitted) or file content observed over a from active storage stored on disk or tape. period of time to reduce devices data footprint Database, Email, UnHost software, disk or Backup and archive target structured file solutions tape, (network routers) devices and VTLs, with archive storage and compression specialized appliances appliances Time and knowledge to Software based solutions Works well in background know what and when to require host CPU cycles mode for backup data to archive and delete, delete data impacting application avoid performance impact and application aware performance during data ingestion
www.storageio.com
When to use Characteristics
Examples
Caveats
Summary y of RAID Levels

RAID Levels and Their PCFE and PACE Impacts
RAID Level 0 1 Characteristics Applications Spreads data across two or more disks to Use for applications that can tolerate loss boost performance with no enhanced of access to data that can be easily availability. reproduced Data Mirroring provides protection and I/O intensive OLTP and other data with good I/O performance with n+n disks high availability including email, databases where n is the number of data disks or other I/O intensive applications. Stripe plus mirroring of data for I/O-intensive applications requiring performance and availability, n+n disks. performance and availability. I/O-intensive applications requiring Similar to RAID 0+1, however mirrors and p data. performance and availability. p y stripes Stripes with single dedicated parity disk Good performance for large sequential n+1 single stream applications Using read and write cache is well suited Similar to RAID 3 with block-level parity protection. p with file serving g environments. Striping with rotating parity protection using Good for reads, write performance n+1 disks. Parity spread across all disks for impacted if no write cache. Use for read performance. intensive data, general file and Web serving p g with dual p parity y using g n+2 Large g data capacity p y intensive applications pp Disk striping HDDs. Reduces data exposure during a that need better availability than RAID5 rebuild with larger capacity HDDs. provides Performance Capabilities Very Good Very Good Energy Footprint Very Good Fewest Disks Not Good Twice As Many Disks Needed Not Good Twice The Disks Not Good Twice The Disks Good Good Good, better than RAID 1 Very y Good
0+1 1+0 or 10 3 4 5
Very Good Very Good Good Good Good For Read, Potential Write Penalty Good for read with potential write penalty
www.storageio.com

Categories of Tiered Storage
RAM Rela ative Comparison Sim milar Capa acities FLASH Performance Fast HDD Balancing Act PACE Footprint Cost PCFE Service Level Price FAT HDD Tape and Optical Tier 2 Tier 3
Power Tier 0 Tier 1
Enterprise Mid-Range Small/Medium Business Small Office/Home Office
Price Ba ands
Different Price Bands and Categories g

www.storageio.com
Storage Capacity g Space p p y Optimization p

Example of Thin Provisioning
The value proposition: Think in terms of an airline booking more seat reservations than exist on a given flight knowing some people will not show up. If you know your workloads and forecast, this can be useful for some applications.
Volume A Volume B Volume C Volume D Volume E 50% Alloc. 20% Alloc. 10% Alloc. 10% Alloc. 10% Alloc. Thin Provisioned 100% Allocated Vol A Vol B Vol C Vol D Vol E Or
The caveat and risk: Contention and performance bottlenecks for dynamic and active environments. Look for solutions that can leverage performance history data in addition to space capacity data to help make informed allocation decisions. Proceed with caution!
www.storageio.com
Summary y of RAID Levels

Levels Balancing PACE for QoS and Application Needs
Performance Performance Availability Overhead RAID 0 Very Good RAID 1 Good None Very Good Good Better None Minimum High on Write Availability Overhead N + 0 = 0% 50% (1P / N) 6%
RAID 5 Poor Writes RAID 6 Poor Writes
High on Write (2P / N) 12.5%
o o o o o o o o
N = Number of disks in the RAID group or RAID set Larger RAID sets can enable more performance and lower Availability overhead Some solutions force RAID sets to a p particular shelve or drive enclosure rack Balance RAID level performance and availability to type of data, active or in-active Boost performance with faster drivers, boost capacity with large capacity drives Drive rebuild times will be impacted by drive size for large capacity SAS and SATA Balance exposure risk during drive rebuild with RAID appropriate RAID level Design for fault containment or isolation balancing best practices and technology
www.storageio.com
Many y Faces of Storage g Virtualization

What issues are you looking to address with virtualization
Why do you want to deploy virtualization?
o Support and enable server virtualization o Improve storage capacity utilization to save money o Address energy costs or availability to sustain growth o Faster backup and data protection or eliminate tape o Eliminate vendor lock-in lock in and lower storage costs o Enable transparent data movement or migration o Boost application performance or enable load-balancing o Reduce complexity or streamline storage and data management o Someone told you to do it and it will solve all of your issues

Abstraction, Emulation, Aggregation and Migration
Abstraction Emulation Aggregation gg g Pooling Migration Protection B k Backup Management Device emulation, existence, backward emulation interoperability, interoperability co co-existence compatibility, transition to new technology LUN and volume p pooling g and management, g increased capacity p y utilization, investment protection Data movement for tiered storage or technology replacement and upgrades, performance optimization Replication, mirroring, snapshots, backup, data archiving, security, compliance, li application li ti aware Performance optimization and resource monitoring and management dynamic allocation management,

Different Approaches And Locations For Virtualization
Servers
Virtual File systems Global File systems Storage Access Block Access LUN / Volume
Virtual Disk Libraries Virtual Tape Libraries Virtual Tape Systems

Backup p Snapshots Mirror Copies
Data Migration 3
Virtual Storage Environment D2D2[D|T|O]
Volume Rotation
Data Protection Management g (DPM) Tools
Physical Devices
Aggregation of Individual disk drives

www.storageio.com
Tiered Storage
Tape Devices
Storage g Virtualization
Storage Virtualization & Virtual Storage Servers or Partitions
A B C
Why Use Virtualization? g Ease of Management Improve, Utilization, Interoperability, Transparency, Abstraction, & Emulation
C
Device Emulation C Consolidated lid d Storage S Virtual Storage Servers

www.storageio.com

Different Approaches For Block and File Virtualization
Storage Virtualization Architecture Options Terminate Pass-thru T i P h and ReIntervene Only Agent 1 initiate I/O As Needed 1A 2 1 Control 1 4 4 6 Processor 3 Control Processor Virtualization Virtualization Virtualization 1B Functionality Functionality Functionality 3 3 5 2 2 4
In-band Symmetric Software + Appliance Storage System Based Block, File, VTLs
Fast Path / Control Path Split Path / SPAID Software + Special Blades Block or File Based
www.storageio.com
Out of Band Asymmetric

Source: Resilient Storage Networks (Elsevier)

Fast Path Control Path / Split Path Best of Both Worlds
Servers
Virtual Vi t l I/O Request R t
I/O Request 1
Leverages and compliments underling storage and feature functionality Not all I/Os need to be terminated and reinitiated improving performance and scalability Specialized Processing Card(s)
3
Switch
X-Path (Fast Path) 2 I/O Request
Control Path
Tape Devices
Storage Devices
Only special processing results in i t intervention ti of f I/O operations ti Difficult and time consuming to implement Requires combination of software and special p processing p g hardware
Source: Resilient Storage Networks (Elsevier)
Examples: EMC Invista / Rainfinity; Fujitsu VS900; Incipient; LSI StorAge

Balancing g Performance and Capacity p y

Importance of Using Multiple Metrics for Comparison
IOPS Watts Number of Disks TBytes IOPS Watt
Product A
Product B
IOPS / Watt OLTP IOPS
Product C
Product D
Number of 146 GB 15.5K RPM Disks Drives
Raw Capacity in TB Total Watts (disk & controller)
www.storageio.com
Balancing g Performance and Capacity p y

How Various Storage Solutions Vary in PCFE & Performance
See MAID Overview and IPM and MAID 2.0 reports at www.storageio.com
www.storageio.com

Reduce Data Footprint (Archive, Compress, De-dupe)
Develop an overall data foot reduction strategy
o Leverage different techniques and technologies o Address on-line primary, secondary and off-line data o Assess and discovery what you have have, how it is used o Determine policies and rules for retention and deletion o Combine archiving, compression and de-dupe in strategy
Archiving and pruning with data classification

o Requires management and insight as to what you have o Database, email, un-structured block and file o Multiple software tools and technologies may be required o Requires hardware, software, time and people expertise o Big benefit, costly to deploy (people, hardware, software)
See Business Benefits of Data Footprint Reduction www.storageio.com/reports

Reduce Data Footprint (Archive, Compress, De-dupe)
Compression for on-line on line and off-line off line storage
o Can be applied to most any data type for some benefit o Software, disk, tape or network-based appliance or router o Off Off-line line and time time-delayed delayed compression o On-line real-time compression for active primary data o Can be used to boost de-duplication benefit
Single Instance Storage (SIS) & De-duplication

o In-line (in-band) or post-processing (out-of-band) o Initially targeted at backup and archive o Beware of potential restoration delays and scaling issues o Requires seeing the same data for maximum benefits o Look into scaling capabilities and claims by vendors
See Business Benefits of Data Footprint Reduction www.storageio.com/reports

IT organizations are realizing that to power conservation i ti li i th t iin addition dditi t ti and d power avoidance, addressing time sensitive applications with performance enhancements can lead to energy efficiency. There are various techniques and existing technologies that can be leveraged to either reduce or support growth with current power and cooling capabilities, as well ll as with ith supplemented l t d capabilities. biliti There are also several new and emerging technologies to be aware of and consider These range from more energy efficient power supplies consider. supplies, storage systems and disk drive components to performance enhancements to get more work done and store more data per unit of energy consumed in a given footprint. Improvements are also being made in measuring and reporting tools to provide timely feedback on energy usage and enable tuning of cooling resources.

Additional Additi l Points P i t To T Consider: C id
o Deploy a comprehensive data footprint reduction strategy combining various techniques and technologies to address point solution needs as well as the overall environment, including on-line, near-line for backup, and off-line for archive data. o Using more energy efficient solutions that are capable of doing more work per unit of energy consumed (for example transaction per watt, IOPS per watt or bandwidth per watt) is similar to improving the energy efficiency of an automobile. o Leveraging virtualization techniques and technologies provides management transparency and abstraction across different tiers, categories and types of storage to meet various application service requirements for f active and inactive or idle data. o Keep performance, availability, capacity and energy (PACE) in balance to meet application service requirements and avoid introducing performance bottlenecks in your quest to reduce d or maximize i i your existing i i IT resources iincluding l di power and d cooling.

Action A ti and d take t k away points: i t
o Develop a data footprint reduction strategy for on-line and off-line data o Energy gy avoidance can be accomplished p by yp powering g down storage g o Energy efficiency can be accomplished by using tiered storage to meet different needs o Measure and compare storage based on idle and active workload conditions o Storage St efficiency ffi i metrics t i iinclude l d IOPS or b bandwidth d idth per watt tt f for active ti d data t o Storage capacity per watt per footprint and cost is a measure for in-active data o Align the applicable form of virtualization for the given task at hand

www.storageio.com and www.storageioblog.com Various videos, webcasts, podcasts, articles, presentations, tips and comments pertaining to material covered in this chapter
o o o o o o o Green Storage is Alive and Well Is MAID Storage Dead? I Dont Think So! Saving Money with Green Data Storage Technology Server and Storage Virtualization Life beyond Consolidation Shifting from energy avoidance to energy efficiency St Storage Efficiency Effi i and d Optimization: O ti i ti The Th Other Oth G Green Storage Efficiency and Optimization: Balancing Time &Space http://storageioblog.com/?p=580 http://storageioblog.com/?p=872 http:// www.enterprisestorageforum.com/management/features/article.php/3830996 http://storageioblog.com/?p=426 http://storageioblog.com/?p=562 htt // t http://storageioblog.com/?p=644 i bl /? 644 http://storageioblog.com/?p=510
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter your Servers and Storage p 9: Networking g with y g

I/O, I/O, Its Off To Virtual Work We Go What you will learn in this chapter
The importance of I/O and networking for virtual data centers Associated demand drivers and challenges g How tiered access can be used to address various challenges I/O virtualization and converged data and storage networking
Fibre Channel over Ethernet (FCoE) Converged Networking Architectures (CNA) Unified Communications Systems (UCS)
Networking g with Your Servers & Storage g

Importance of I/O and Networking
Networking N t ki and d I/O connectivity ti it technologies t h l i tie ti facilities, f iliti servers, storage t tools for measurement and management and best practices on a local and wide area basis to enable efficient data centers. I/O and networking in general are becoming faster, more reliable, and able to support more data movement over longer distances in a shorter timeframe at a lower l cost. t However, as with server and storage technology improvements, the increase in networking and I/O capabilities are being challenged by continued demand to move or access more data over longer distances in even less time and at a lower cost

I/O and Networking Challenges
I/O networking drivers and t ki and d connectivity ti it demand d dd i d challenges h ll iinclude: l d
o Access to general web servers as along with email o Impact to faster servers having to wait for slower I/Os to complete o IT services users access of data center based applications and servers o IP based telephone and other communication services o Data sharing and movement between facilities and remote offices o Remote backup and restore of data using managed service providers o Enabling workload and application load balancing and resource sharing o Support collaborative and other Web 2.0 based applications o Local oca a area ea networking et o g bet between ee use users, s, c clients e ts a and d se servers es o Access of direct attached, dedicated & internal to external networked shared storage o Local, regional & international business continuance (BC) and disaster recovery (DR) o Facilitate remote work forces from virtual offices and small office home offices (SOHO) o Enable access to Cloud, MSP and Software as a Service (SaaS) solutions o The ability to shift workload to take advantage of energy opportunities

I/O and Networking Components
I/O and d networking t ki components t include: i l d
o Host bus adapters (HBA), host channel adapters (HCA), network interface cards (NIC) o Embedded, , blade, , stackable switches and directors o Routers and gateways for protocol conversion, distance, segmentation and isolation o Specialized appliances for security, performance and application optimization o Distance Di t and d bandwidth b d idth optimization ti i ti f for remote t d data t access and d movement t o Managed service providers and bandwidth service providers o Diagnostic and monitoring tools including analyzers and sniffers o Cabinets, racks, cabling and cable management, optical transceivers o Management software tools and drivers

Data Center I/O and Networking: The Big Picture
Networking and I/O connectivity supports: Local, L l campus, metropolitan, t lit wide id area Servers Server-to-server communications Inter-clustering communications Server-to-storage access Storage to storage access Internet and wide area access Telecommunications and telephony Telecom Network
Firewalls
Users, Clients Customers
Local Area Network NAS
InfiniBand (IBA) Network IBA Storage
SAS SATA FC Storage Storage Area Network iSCSI Storage
Internet
Fibre Channel (FC), Universal Serial Bus (USB), 1 Gb Ethernet (GbE)

www.storageio.com

Positioning Various I/O and Networking Protocols
Fibre Channel SAN Layers File system, FTP, SCSI-3, NFS, FCP, IPFC, FICON Transport FC-4 ULP Network FC-3 Services FC-2 Framing, Flow Flow Control FC-1 Encoding, Link FC-0 Physical Data link 3 2 IP LAN, WAN, MAN Physical TCP (IP & UDP) MAC Client MAC Client MAC Physical 4 TCP, UDP Description Application Presentation Session OSI Layer 7 6 5 IP Routed Network FTP, Telnet, HTTP iSCSI NFS iSCSI, GbE Network FTP, Telnet, HTTP iSCSI NFS iSCSI,
Physical
www.storageio.com

Tiered I/O and Networking Access
Internal to server, or external using PCI bridging PCI, 32 bit/33 MHz, 132 MB/sec PCIx, 64 bit/66 MHz, 528 MB/sec PCIe, 32 lane, 8GB/sec each direction Short distances (measured in feet or meters) USB2 60 MB/sec IDE/ATA, IDE/ATA 100MB/sec 100MB/ UltraSCSI (parallel), 320 MB/sec SAS, 3 to 6Gb/sec per link Longer distances (measured in meters or kilometers) InfiniBand, 10Gbit/sec and higher Fibre Channel 1, 2, 4, 8, 10, 16 Gbit/sec Ethernet, Eth t 10/100 Mbit, Mbit 1, 1 10 10, 40 40, and d 100 Gb/ Gb/sec
www.storageio.com

PCI Single Root Configuration Example
PCIe Model Example Processor Processor CPU CPU Single, Double, Quad, or Multicore, e.g., 8-Way Memory- -DIMM DIMM Memory Memory DIMM Memory y - DIMM Memory - -DIMM Memory DIMM Memory Memory- -DIMM DIMM DDR RAM
SAS Ports LAN Ports USB Ports IDE Ports SATA Ports PCIe PCIe PCIe PCIe Devices/Adapters Endpoint p Devices
MCH or Internal Connection Bus PCIe Root Complex
PCI Bridge PCIe PCIe PCIe PCI PCI or PCIx Devices/Adapters

www.storageio.com
Graphics
PCI Switch Endpoint p Endpoint Endpoint E d i t Devices Devices Devices
Fibre Channel over Ethernet ( (FCoE) )

Positioning of Data Center I/O Protocols and Interfaces
iSCSI Open Systems FCoE FC & FICON zOS Mainframe
Applications Protocol iSCSI

Encapsulate
FC-SB2 ECKD SRP

FC-4 FC-3 FC-2 FC-1 FC 1 FC-0 Fibre Channel InfiniBand
SCSI Commands FCP iFCP TCP IP TCP IP FCIP TCP IP

FC-4 FC-3 FC-2
FICON
FCoE
Transport
Ethernet ( (802.x MAC & PHY) )
www.storageio.com

Ethernet Ecosystem and Features
802.3ad Link Aggregation 10/100 Ethernet Copper, Fiber, Wireless Gigabit 10 Gigabit 802.1d 802 1d STP IPv4 802.1w Rapid STP 802.1X Port Authentication
TCP UDP
802.1q 802 1q Virtual LAN 40 Gigabit 100 Gigabit 802.1p Class of Service 802.3x Flow Control Lossless and Pause Service IPv6
IP
www.storageio.com

Various Uses and Locations of SAS as a Technology
Desktop PC, workstation, workstation Laptop, JBOD shoe or pizza box Mid-range storage arrays, blade centers, centers and servers Mid-range and enterpriseclass storage systems (iSCSI, FC, FCoE, FICON, IBA, NAS)
SAS SATA coexist
SAS HBAs and RAID adapters
SATA Desktop D kt and d enterprise-class t i l HDDs, low cost, high capacity

SAS
Enterprise-class HDD Hi h performance, High f scalable capacity, dual port
FC
www.storageio.com

Wide Area and Internet Networking
Data movement and access between sites Remote office branch office data access High availability and BC/DR Leveraging off-site off site managed services Remote data archiving
Privately owned facilities Hosted or co-location BC/DR standby hot/cold site Cloud or SaaS and MSP Clustered and non-clustered servers
Firewalls
Internet MAN & WAN Remote Storage
Data replicated for high availability, and BC/DR Remote R t backup b k and archives
www.storageio.com

Latency and Impact of Adding Technology Layers g and I/O Latency y Increases with Layers y Storage
Effective utilization Effective bandwidth
FC/FICON FCIP TCP IP SONET/SDH Fiber Optics
Transport lay yers
Fib Channel Fibre Ch l Adaptation ATM SONET/SDH Fiber Optics Fibre Channel SONET/SDH Fiber Optics Fibre Channel Fiber Optics Latency
Impact of Protocols, Interfaces, Software Stacks, and Distance

www.storageio.com

I/O Virtualization (IOV), Consolidated Network Architecture (CNA)
Sharing of physical adapters and unique addressing
o Fibre Channel N_Port Virtual IDs Unique N_Port addresses o Virtual Machine NICs and HBAs E.g. VMware, Virtual Iron Virtual NICs and Virtual HBAs for virtual machines
PCI Bus Extension, Switching and Sharing Very Short Distances

o PCI C SIG S G SR-IOV S O a and d MR-IOV: O S Share a e PCI C Adapters dapte s
Converged I/O and Networking

o Virtual and Converged Adapters and NICs Transform physical adapter into virtual adapters and NICs o Converged Networks and Fabrics InfiniBand and Converged Enhanced Ethernet and FCoE
Fibre Channel over Ethernet (FCoE); Single-Root IOV (SR-IOV); Multi-Root IOV (MR-IOV)

I/O Virtualization (IOV), Consolidated Network Architecture (CNA)
Fibre Channel Virtual Machine PCISIG IOV NPVID Software Based S ft B d Server Centric Inter Server Inter Cabinet (Inches to feet) Data Center Scaling (Many Meters) Unique FC Addressing On Shared Adapters Converged Networks N t k
Virtual Switch Hardware, Interoperability VNICs, VHBAs Operating Converged Using Shared System SR/MR NIC/HBA Adapters IOV Dependent Support Decouple PCIe Converged Adapter From Switch Server, Shared Fabric Adapters Network Converged Switch Fabric Network Today
www.storageio.com
SR = Single Root MR = Multi-Root

Emerging

Fibre Channel N_Port ID Virtualization
Fibre Channel Switch WWN3 Zoned to Vol-A WWN2 Zoned to Vol-B WWN1 Zoned to Vol-D
Vol-A Vol-B Vol-C Vol-D

www.storageio.com
Storage System WWN7 Zoned to Vol-A WWN8 Zoned to Vol-B WWN9 Zoned to Vol-D

Unified Converged Data Center Fabric or Networks Traditional Approaches
Separate Networks & Interconnects (Fibre Channel, GbE, IBA)
Evolving Approaches
Unified and Converged Interconnects (Virtualized FC, FCoE, CEE, GbE, Etc. Physical Converged Enhanced Ethernet or IBA)
www.storageio.com

Network and I/O Convergence
IDE/ATA SCSI SCSI-3 (Command Set) Ultra SCSI IBM SSA SATA SAS 3GB 6GB 16GFC
Block Mux/B&T Various Proprietary
ESCON (FC-SB1) HP-FL, Sun FL FDDI/MSCP Quarter Speed Proprietary Optical
FICON (FC-SB2) SCSI_FCP (FCP) 2/4/8 [10] GFC Fibre Channel
FDDI, Ethernet TCP/IP NFS TCP/IP, ATM, Token Ring Banyan Vines Novell, , DECnet SNA, XNS, LAT
Ethernet C Copper, Wi Wireless l Copper 10/100/1000/1000 TCP/IP, UDP, iSCSI, FCIP NFS, , CIFS, , HTTP Time
40GbE FCoE 100GbE Premium D t C Data Center t Converged Ethernet iSCSI, TCP/IP, FCIP NFS, , CIFS, , HTTP
www.storageio.com

Converged Network (Top) and Separate Networks (Bottom)
FCP FCP FICON FCP
FCoE = Unified Data Center Network Fibre Channel TCP/IP
FICON FCP
Physical Cable (Copper or Optical)
802.x 802 x Ethernet
FC F Frames
HTTP NFS CIFS HTTP NFS FTP
FCoE has a data center focus Full-duplex lossless Ethernet Nonroutable - WAN via FCIP IP-Based Network
Physical Cable (Copper or Optical) 802.x Ethernet Eth t TCP/IP
IP Packets Fibre Channel SAN

Fibre Channel Ch l FCP FICON
Physical Cable (Copper or Optical)
www.storageio.com

FCoE and Converged Enhanced Ethernet (CEE) and DCB
Converged NIC/HBA Converged g Enhanced Ethernet Switch Legacy Local Area Network Vol-A Vol-B Vol-C V lD Vol-D
Blade Servers CEE IP Local Area Network iSCSI NAS
FC & FCoE Storage System
www.storageio.com

PCI SIG I/O Virtualization (IOV)
Applications Operating System Applications Applications Applications Guest OS Guest OS Guest OS VM VM VM Virtualization Layer
PCI Switch Physical Server or Blade PCI Switch Single-Root Or Multiroot PCI IOV Endpoint Endpoint Endpoint p Devices D Devices i Devices PCIe PCIe PCIe PCI or PCIx Devices/Adapters
PCI Switch Physical Server or Blade
External Enclosure or Card Cage
www.storageio.com

The not to occur, however I/Os Th best b t I/O is i one that th t does d t have h t h I/O cant t be b eliminated li i t d The second best I/O is one that is efficient and effective with minimum overhead Fast servers need fast storage, storage fast storage needs fast networks Minimize the impact of I/O to applications, servers, storage and networks Do more with less including improved utilization and performance Consider latency, effective bandwidth and availability in addition to cost Apply the appropriate type and tier of I/O and networking to task at hand I/O operations and connectivity are being virtualized to simply management Convergence of networking transports and protocols continues to evolve

o Networks can have a positive environmental impact by increasing telecommuting and reducing then number of vehicles on the road. o Telecommunicating also requires that telecommunications networking and IT servers and associated networks be available and efficient. o Moving forward, premium or low latency lossless converged enhanced Ethernet (CEE) also a so known o as Fibre beC Channel a e o over e Ethernet t e et ( (FCoE) Co ) a and d Data ata Ce Center te Bridging dg g ( (DCB) C ) will compliment traditional or volume Ethernet based solutions leveraging various degrees of commonality.

o For storage related applications that are not planned to be migrated to NAS or iSCSI, FCoE addresses and removes traditional issues about Ethernet based TCP/IP overhead, latency and non-deterministic behavior while preserving experience and knowledge associated with Fibre Channel and FICON tools. o To keep pace with improvements and new functionality being added to storage and servers and to boost efficiency networks will need to do more than provide more bandwidth at a lower cost. This will require faster processors, more interoperability and functionality f as well as technology maturity. More intelligence is moving into the network and chips, such as deep frame and packet inspection accelerations, to support network and I/O QoS, traffic shaping and routing, security including encryption compression and de-duplication encryption, de duplication among others. others

o o o o Fibre Channel & iSCSI deliver pipes to virtual environments. Poll: Networking Convergence, Ethernet, InfiniBand or both? I/O Virtualization (IOV) Revisited Will 6Gb SAS kill Fibre Channel? http://fedtechmagazine.com/article.asp?item_id=525 http://storageioblog.com/?p=1024 http://storageioblog com/?p=729 http://storageioblog.com/?p=729 http://storageioblog.com/?p=122
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Part IV
Applying what you have learned Chapter 10 Putting Together a Green and Virtual Data Center Its not what you know, its how you use it Chapter 11 Summary and Wrap Wrap-up up Call to Action Benefits can not be realized until acted upon Its Time to Take action!
Chapter a Green and Virtual Data Center p 10: Putting g Together g

Its not what you know; its how you use it What you will learn in this chapter
Not all data lifecycle and data access scenarios are the same How to compare and measure IT resources for different usage modes The importance of using capacity planning and data management How energy efficiency can be used to save cost or sustain growth
Putting a Virtual Data Center g Together g

Rising Costs, Complexities and PCFE Challenges
An important idea is managing more data and more IT resources in the same, or even smaller, footprint in terms of less energy usage for powering equipment, less floor space and lower management costs. For example, a continued increase the numbers of f servers, storage t and d networks t k and d the th associated i t d increase i i data in d t footprint, f t i t energy consumption and costs will continue to rise as will total IRM costs.
IRM Costs = People, p , Software Tools, , and Services IT Resources = Total Servers, Storage, and Networks IRM Costs Poor Energy Efficiency
Time

Shifting to an Efficient and Productive Information Factory
An However, by changing how data and resources are managed, achieving improved efficiencies and storing data into denser footprints without compromising performance or availability while improving how data, application and IT resources managed, IRM and d energy costs t on a IT serviced i d delivery d li b i decline, basis d li enabling bli more work k to t be b done and data to be stored in the same or reduced footprint.
IRM Costs = People, p , Software Tools, , and Services IT Resources = Total Servers, Storage, and Networks IRM Costs Improved Energy Efficiency
Time

Action Items & Opportunities to Address PCFE/Green Issues
Activity Financial Incentives Description Opportunity Rebates, low cost loans, grants, energy Offset energy expenses and technology affiance certificates upgrade costs with rebates or leave potential money on the table Metrics and Total energy usage and resulting Provide insight and enable comparison of f Measurements footprint along with how much work is productivity and energy efficiency to gauge being done or data being stored per unit improvement and success and of energy being consumed environmental impact Infrastructure Leverage best practices, protect and Reduce IRM complexity and costs, boost Resource secure data and applications while productivity doing more with less while Management, maximizing productivity and resource enhancing IT service delivery including usage using i various i t technologies. h l i performance f and d availability. il bilit Utilize carbon offset credits to comply with Mask or move Outsource, use managed service ETS when needed, leverage lower cost problems providers, SaaS or Cloud based , buy y carbon offsets to meet ETS services when applicable pp without services, requirements as needed. compromising IT service delivery

Activity Description Consolidation Leverage virtualization in the form of aggregation of servers, storage and networks. Consolidate facilities, applications, workload and data. Tiered Various types of servers, storage and Resources networking components sized and optimized to specific application service requirements. Reduce data Archive, compression, de-duplication, footprint space saving snapshots, thin provisioning i i i and dd data t deletion d l ti Energy Powering down resources when not inavoidance use using MAID 2.0, IPM, AVS, DBS and gy saving g modes other energy Opportunity Reduce physical footprint to support applications and data conducive to consolidation balancing savings with quality of f IT service delivery Align technology to specific task for optimum productivity and energy efficiency. Balance performance, availability, capacity and energy Eliminate un-needed data, move dormant data off-line, compress active data, maximize i i d density it For applications and IT resources conducive to being powered down, turn off when not in use, , including g workstations and monitors.

Activity Boost energy efficiency Opportunity Maximize productivity and amount of work done or data stored per watt of energy in a given footprint, configuration and cost point. Reduce the amount of energy needed to Facilities tune- Leverage precision cooling, review up energy usage and assess thermal and cool IT equipment doing the same or more CRAC performance. Eliminate halon and work and watch your energy bill and usage other EHS un-friendly items. drop! EHS Recycle, re-use, reduce, elimination of e- Comply with current and emerging waste or hazardous substances. regulations including RoHS. Description Upgrade to newer, faster, denser more energy efficient technologies. Leverage tiered servers, storage and networks.

A Synopsis of Approaches to Mask or Move PCFE Issues
Buy carbon off-set credits
o o o o o o o o Enables compliance for energy trading schemes Buys time until efficiency (ecological and economic) are achieved Adds cost to business when not part of regulatory compliance Does not address energy efficiency, rather a deferral Move problems M bl and d iissues elsewhere l h Take advantage of lower cost services or available PCFE resources Supplement existing environments using lower cost services Full or partial out-source out source of some applications and services
Leverage managed service, SaaS, cloud and hosting services providers
Build new facilities, expand or remodel existing facilities

o Expensive and time consuming, strategic vs. tactical o Part of solution when combined with other techniques o Look for sites with abundant power generation and transmission capabilities

Leveraging Virtualization to Enable HA, BC and DR
Traditional BC/DR One to One Resource Allocation One-to-One or Selective Recovery PMs PMs PMs PMs PMs PMs Data Protection Management Virtualized BC/DR Initially Oversubscribed Add Physical Resources as Needed VMs VMs VMs PMs PMs PMs VMs VMs VMs PM
Network Production Primary Site 32 Physical Servers
Network BC/DR Site 8 Physical Servers 32 VMs 4:1 VM to PM Remote Shared St Storage
BC/DR Site 32 Physical Servers
Production Primary Site 32 Physical Servers 32 VMs 1:1 VM to PM Local Shared St Storage
Snapshots and Local Remote Shared Replication Shared p St Storage St Storage PM = Physical Machine VM = Virtual Machine The Green and Virtual Data Center (CRC) Instructor Companion Guide
Snapshots and p Replication

Leveraging Virtualization to Enable Provisioning
Production Deployment OS = Operating System VM = Virtual Machine PM = Physical Machine Development Quality Assurance Testing Application Application Application Application Guest OS Guest OS Guest OS Guest OS VM VM VM VM PM Vol-A Vol-B Vol-C Vol-D
Application Application Application Application Guest OS Guest OS Guest OS Guest OS VM VM VM VM PM PM PM PM
Vol-B Vol-A V lC Vol-C Vol-D Snapshots and R li ti Replication


Proliferation of I/O and Networking Adapters and Cabling
Servers or Blade servers
Fibre Channel Legacy Storage Area Network FC Storage Legacy Local Area Network iSCSI NAS Storage Storage
Ethernet

Consolidated I/O and Networking Connectivity
The Many Faces of Virtualization Consolidation - Aggregation Consolidation Emulation - Interoperability Abstraction Management
PCIe IOV Enclosure Servers or Blade servers
PCIe Expander Connectivity
Legacy Storage Area Network (SAN) FC Storage FCoE Storage Converged Data Center Network NAS iSCSI Storage Storage
PCIe Adapters Legacy Local Area Network (LAN) iSCSI NAS Storage Storage
www.storageio.com
IOV = I/O Virtualization WAN


Common challenges and issues Old vs. New Rules!
Legacy and Transactional Data Data D t Created C t d Ac ctivity Data Dormant D t Goes G D t Ac ctivity Web 2.0 and Online Data Data D t Created C t d Continued C ti d Access A
Time Profile: Data is created, worked with, and then goes dormant after some period of time, with a probability of little to no future access or use Examples: Database, email, transactional, general file serving, project-oriented data Solution: Ideal candidate for archiving off of primary or online storage to offline and removable media or MAID-based storage combined with purging or deletion of data no longer g needed
Time Profile: Data is created, worked with, and then may go idle briefly, then accessed, then idle, then active, then idle, then active Examples: Web, reference and lookup, fixed content, Web 2.0 and social networking, media and entertainment, some email, search, seasonal or event and research-based data Solution: Online storage with variable performance to meet changing workload demands, , bulk and clustered storage, g , MAID 2.0 and IPM-enabled storage, caching

Boost Energy Efficiency Techniques and Approaches
Do more work while using same amount of power
o Leverage faster processors / controllers using same power o Consolidate two slower storage systems to a faster system o Faster disk drives with capacity boost and less power draw o Look beyond space or capacity utilization
Do same amount of work while using less power

o No change in performance, f lower power consumption o Lower power consuming components (Adaptive Voltage Scaling) o Not to be confused with space or capacity consolidation
Do more work while using less power

o Faster processors/controllers/storage drawing less power o Enable consolidation to boost utilization and performance o Lowers the economic and ecological impact per work done!!!

Consolidation Data Centers, Servers and Storage
Consolidating Data Centers and Remote offices
o Avoid simply moving problems and data management Leverage tools for remote access and file management gg g existing g data center crowding g o Watch out for aggravating
Consolidating Servers
o Virtualization using software or hardware based solutions o Establish utilization thresholds for adequate service levels o Leverage proxy based backups for data protection
Consolidating Storage
o Multiple fast disks to fewer, slower, high capacity disks o Multiple slower storage systems to fewer faster systems o Virtualization, RAID levels, Thin provisioning to boost utilization o Avoid performance train wreck on track to high utilization!!!

Its know; its It not t what h t you k it how h you use it. it With that in mind, keep in perspective all of the different techniques, technologies and best practices discussed in this book that can be applied in various combinations to address PCFE or green issues. The take away for this chapter is to understand what the different facets of being green along with the technologies and techniques that can be used for different situations.

Action A ti and d take t k away points: i t
o Data and storage access and lifecycle models are changing o Metrics and measurements are important p for insight g into resource efficiency y o Virtualization can be used to enhance productivity and IT agility o Capacity planning should cover servers, storage, network and facilities o A green and d virtual it ld data t center t can reduce d costs, t reduce d energy and d emissions i i o A green and virtual data center can also enable growth and maximize IT budgets

www.storageio.com and www.storageioblog.com Various videos, webcasts, podcasts, articles, presentations, tips and comments pertaining to material covered in this chapter
o o o o o Green IT and Virtual Data Centers Should Everything Be Virtualized? The vPad Virtualization: Life beyond y consolidation Clouds and Common sense Data Protection (CDP) http://storageioblog.com/?p=850 http://storageioblog.com/?p=719 http://thevpad.com/ http://storageioblog.com/?p=426 p g g p http://storageioblog.com//?p=704
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Chapter p 11: Summary y and Wrap-up p p Call to Action

General trends and technology improvements expected include:
o o o o o o o o o o o o o o
Benefits can not be realized until acted upon Its Time to Take action!
Faster processors that consume less power to do more work in a smaller footprint Increased usage of SSD devices taking pressure off of disk drives Shift of focus for magnetic g disk drives to take p pressure off of magnetic g tape p Magnetic tape shifts storing densely compressed data for long term, low cost archiving Expanding focus from data center to offices including remote office and home offices Converged I/O and networking to support converged servers and storage Continued focus on desktop, laptop and workstation virtualization Energy Star for data centers, servers, storage and networks Printer and copier environmentally friendly inks and recyclable paper M awareness around More d th the many f faces or f facets t of fb being i green Thermal management including intelligent, precision and dynamic or smart cooling Changing data access patterns and lifecycle requiring more data to be accessible Metrics reflect active work and data being stored along with idle energy saving moves Align metrics to application and business value and level of service being delivered
www.storageio.com
General Comments
PCFE, PACE, and Green Topics Are Here To Stay!
General tips to improve the efficiency and productivity of IT data centers include:
o o o o o o o o o o o o o o Where practical and possible, power down equipment or enable power saving modes Adopt tiered data protection across applications, servers, storage and networks Eliminate heat as close to the source as efficiently y and safely y as p possible Leverage virtualization aggregation, emulation and abstraction capabilities Reduce data footprint impacts by gaining control and managing data and storage Align tiered servers, storage, networks and facilities to specific service level needs Avoid performance and availability bottlenecks from over consolidating resources Use energy efficient technologies that do more work or store more data per kWh Review facilities and IT equipment power usage and cooling efficiency E l iintelligent, Explore t lli t smart t and d precision i i cooling li and d th thermall management tt technology h l Measure, monitor and manage resource usage to business productivity and activity Coordinate capacity planning across servers, storage, networks and facilities Assess suppliers and partners as part of a green ecosystem and supply chain Redeem energy rebates, discounts and other financial incentives
www.storageio.com
General Comments
PCFE, PACE, and Green Topics Are Here To Stay!
Density brings benefits (footprint) & issues (energy)
o Datacenters use a small amount of total national power o However very dense and reliant upon available energy o Same with dense servers, servers storage and network devices
There is a cost to go green and using software

o Software S f requires i hardware, h d hardware h d has h a PCFE impact! i ! o Moving data requires energy (IOPS or Bandwidth per kW) o Virtualization improves utilization not performance
Understand energy efficiency vs. effectiveness

o How much energy used vs. how much work can be done
General Comments
Basic Premises and Themes This is Not Rocket Science!
You Y Cant C t Go G Forward F d if You Y Cant C t Go G Back! B k! You Cant Delete What You Have Not Preserved o Assuming your data has some value value, preserve before delete You Cant Preserve What You Cant Move o Automated or Manual Data Movement/Migration Tools You Cant Move What You Dont Manage o Rules and Polices Needed To Manage Migration Process You Cant Manage What You Dont Know About o Identify What Data, Files and Objects you have = Insight o Database vs. Unstructured data = Welcome to the new world!
The Many y Faces of Green IT

PCFE, PACE, EHS and Green Storage and Related Topics
Complementary Industry Trends and Perspectives Reports SSD for Energy Efficiency Data Footprint Reduction
Meet MAID 2.0
Many Faces of MAID
Analysis of EPA Report to Congress
See www.storageio.com/reports and www.storageioblog.com for more information

Book Summary y and Notes

Where to learn more Additional suggested reading/learning sites include:
o California Center for Sustainable Energy (CCSE) o Closing the Green Gap o Determining Computer or Server Energy Use o Closing the Green Gap: WSRADIO Internet Radio Interview o EPA Energy Star for Data Center Storage Update o EPA Server and Storage Workshop Feb 2, 2010 o Examples of Green Metrics o Green IT Confusion Continues, Opportunities Missed! o Green IT, Green Gap, Tiered Energy and Green Myths o Green IT, Power, Energy and Related Tools or Calculators o Green IT and Virtual Data Centers o Should Everything Be Virtualized? o The vPad o Virtualization: Life beyond consolidation o Clouds and Common sense Data Protection (CDP) o Data Protection Options for Virtual Servers http://storageioblog.com/?p=1073 http://storageioblog.com/?p=70 http://storageioblog.com/?p=539 http://storageioblog.com/?p=519 http://storageioblog.com/?p=925 http://storageioblog.com/?p=1051 http://thegreenandvirtualdatacenter.com/greenmetrics.html http://storageioblog.com/?p=598 http://storageioblog.com/?p=1107 http://thegreenandvirtualdatacenter.com/calculator.html http://storageioblog.com/?p=850 http://storageioblog.com/?p=719 http://thevpad.com/ http://storageioblog.com/?p=426 http://storageioblog.com//?p=704 http://storageio.com/Reports/StorageIO_WP_DataProtect_Aug20_2009.pdf

o Long Term Data Protection and Preservation o Business Benefits of Policy Based Dedupe o Data Protection Management (DPM) o Green Power and Cooling Tools and Calculators o Green Storage is Alive and Well o Is MAID Storage Dead? I Dont Think So! o Justifying Green IT Hardware Upgrades with EnergyStar o Metrics and measurement for management insight o Optimize Data Storage for Performance & Capacity Efficiency o Performance = Availability o PUE, Are you Managing Power, Energy or Productivity? o Saving Money with Green Data Storage Technology o Time To Invest In Information Factories o Server and Storage Virtualization Life beyond Consolidation o Shifting from energy avoidance to energy efficiency o SPC and Storage Benchmarking Games http://storageio.com/Reports/IndustryPerspective_LongTermTape_Mar18_2009.pdf http://storageio.com/Reports/IndustryPerspective_PolicyDepe_Oct29_2008.pdf http://storageio.com/Reports/StorageIO_WP_092706.pdf http://storageioblog.com/?p=338 http://storageioblog.com/?p=580 http://storageioblog.com/?p=872 http://storageioblog.com/?p=827 http:// searchstorage.bitpipe.com/detail/RES/1261065376_927.html http://storageioblog.com/?p=749 http://storageioblog.com/?p=640 http://storageioblog.com/?p=711 http:// www.enterprisestorageforum.com/management/features/article.php/3830996 http://storageioblog.com/?p=767 http://storageioblog.com/?p=426 http://storageioblog.com/?p=562 http://storageioblog.com/?p=582

o SSD and Storage System Performance o Storage Efficiency and Optimization: The Other Green o Storage Efficiency and Optimization: Balancing Time &Space o The Changing Dynamic of the Data Center o The other Green Storage: Efficiency and Optimization o Formula for calculating the power consumption of computers? conjumption-of-computersis-there-any-formulae/ o Power Play o Beyond PUE efficiency/?cs=41827 o More Questions About PUE o FCoE Infrastructure Coming g Together g o 2010 and 2011 Trends, Perspectives and Predictions o SNWSpotlight: 8G FC and FCoE, Solid State Storage o NetApp and Cisco roll out vSphere compatible FCoE solutions solutions o Fibre Channel over Ethernet FAQs http://storageioblog.com/?p=862 http://storageioblog.com/?p=644 http://storageioblog.com/?p=510 http://ipip.intel.com/go/7219/the-changing-dynamic-of-the-data-center/ http://storageioblog.com/?p=847 http://itknowledgeexchange.techtarget.com/itanswers/how-can-i-calculate-the-powerhttp://edtechmag tmg dev net/k12/events/updates/power play html http://edtechmag.tmg-dev.net/k12/events/updates/power-play.html http://www.itbusinessedge.com/cm/blogs/cole/beyond-pue-the-bigger-picture-of-data-centerhttp://www.itbusinessedge.com/cm/blogs/cole/more-questions-about-pue/?cs=40345 http://itknowledgeexchange.techtarget.com/storage-soup/fcoe-infrastructure-coming-together/ p g g g g p g g http://storageioblog.com/?p=1060 http://www.podtech.net/home/5087/snwspotlight-8-gigabit-fibre-channel-solid-state-storage http://storage.networksasia.net/content/netapp-and-cisco-roll-out-vsphere-compatible-fcoehttp://searchstorage.techtarget.com.au/news/2240021703/Fibre-Channel-over-Ethernet-FAQs

o Fibre Channel & iSCSI deliver pipes to virtual environments. o Poll: Networking Convergence, Ethernet, InfiniBand or both? o I/O Virtualization (IOV) Revisited o Will 6Gb SAS kill Fibre Channel? o Experts Corner: Q&A with Greg Schulz at StorageIO o Networking Convergence, Ethernet, InfiniBand or both? o Vendors hail Fibre Channel over Ethernet spec o Cisco, NetApp and VMware 'end-to-end' FCoE storage http://fedtechmagazine.com/article.asp?item_id=525 http://storageioblog.com/?p=1024 http://storageioblog.com/?p=729 http://storageioblog.com/?p=122 http://blogs.i365.com/?p=244 http://virtualization.sys-con.com/node/1246918 http://www.networkworld.com/news/2007/040507-fibre-channel-ethernet-spec.html http://searchstorage.techtarget.com/news/article/0,289142,sid5_gci1517506,00.html
o FCoE: The great convergence, or not? http://www.infostor.com/index/articles/display/9640182167/articles/infostor/volume13/Issue_4/Departments/Editorial/FCoE__The_great_convergence__or_not_.html o How I/O virtualization and FCoE differ o Gregs Server and StorageIO News Letter http://searchstorage.techtarget.com/generic/0,295582,sid5_gci1378073,00.html http://storageio com/newsletter/August2010 html http://storageio.com/newsletter/August2010.html
Closing g Comments
Where to learn more, next steps
Expanding your opportunities with virtualization
In addition to a focus on consolidating to be efficient Look at how to boost productivity and profitability Understand how and where agility boosts effectiveness Transition from energy avoidance to energy efficiency Tiered servers, storage, networks, hypervisors and data protection Time to re-architect and modernize data protection p Balance the old with the new, dont be afraid, look before you leap!
ISBN: 978 978-1-555583113 1 555583113
Newsletter
Twitter @storageio
Books
ISBN: 978-1-4200-8666-9
www.storageio.com
Thank You
Industry Trends and Perspectives:

Challenges and Opportunities!
Greg Schulz, Founder & Sr. Analyst -The Server and StorageIO Group Email: Greg@storageio.com Greg@storageio com Blog: storageioblog storageioblog.com com or twitter @storageio Author The Green and Virtual Data Center (CRC) And Resilient Storage Networks (Elsevier)
Copyright 2010 StorageIO Group All rights reserved. www.storageio.com

SIO IndustryTrends TGAVDC Book InstructorCompaSIO IndustryTrends TGAVDC Book InstructorCompanion Sep13 2010nion Sep13 2010

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

SIO IndustryTrends TGAVDC Book InstructorCompaSIO IndustryTrends TGAVDC Book InstructorCompanion Sep13 2010nion Sep13 2010

Uploaded by

Copyright:

Available Formats

The Green and Virtual Data Center (CRC)

By Greg Schulz - www.storageio.com

The Green and Virtual Data Center (CRC)

The Green and Virtual Data Center

Industry Trends and Perspectives:

Some Background Material g

ISBN: 978 978-1-555583113 1 555583113

The Green and Virtual Data Center

Chapter p 1: IT Data Center Business Economic and Ecological Sustainment

What y you are about to see/hear is real

Today you can leverage different techniques

What Are Different Shades of Green?

Consolidation for energy efficiency to avoid waste

Performance enhancement for energy effectiveness

HVAC HVAC & cooling li optimizations ti i ti Optimize O ti i what h t you h have

Some IT Data Center Issues and Trends

Focus on optimization p and efficiency y

See Data Center I/O Performance Issues and Impacts at www.storageio.com/reports

Some IT Data Center Issues and Trends

Green Gap: vs. Economic p Ecological g

Emissions Electrical Power Primary, Standby Backup

Cooling g and Floor Space

Environmental Health and Safety

Green Gap: vs. Economic p Ecological g

The Green Gap

Environmental Health and Safety

Balancing Act See report Analysis of EPA report to Congress at www.storageio.com/reports

Copyright 2010 Server and StorageIO Group All rights reserved.

Economic and Business Drivers

Power, Cooling, Floor space, Environmental (PCFE) Constraints

Cooling/Distribution Servers Storage

PCFE Capacity Threshold Ceiling Available IT Resources/Demand

Economic and Ecological Sustainment g

Cooling/Distribution Servers Storage

PCFE Capacity Threshold Ceiling Available IT Resources/Demand

Green IT Related Myths and Realties y

Myth: Powering off devices is the silver bullet

Myth: CO2 emissions is prime focus of energy efficiency

Green IT Related Myths and Realties y

Myth: y HW costs more to power p than to buy y

Areas of Focus and Opportunity pp y

Consolidation Reduce Data Footprint

Energy Tiered Avoidance Servers Storage

Developing your issues p g a Strategy: gy What are y

Useful Work Power Used Time Poor Efficiency Gap

Improved p ( (Better) ) Efficiency and Economic Gap

Very Good Efficiency Gap

Developing your issues p g a Strategy: gy What are y

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

Chapter p 1 Summary y and Notes

ISBN: 978 978-1-555583113 1 555583113

Chapter p 2: Energy Efficient and Ecological Friendly IT Data Centers

Closing g the Green Gap p

Economic and Business Drivers

Demand Exceeding Supply Cost and Availability of Electrical Power

Source: U.S. EPA

Green Gap: p Green Stories vs. IT Issues

Storage (Disk & Tape)

North American Electrical Power Grid