Data Center Transformation

Hernan Vukovic hvukovic@cisco.com Systems Engineer Calafate Argentina Sep/2007

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

Where we are Today

Environmental sustainability is a major global trend for the 21st century

Corporations are adopting standards and implementing initiatives to improve the environmental performance of their operations Green DC and CCRE can provide Environmental benefits to owners and operators of Corporate Data Centers and Commercial real state, that also reduces cost and risk
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Government Policy and Regulation

Government intervention to promote environmental sustainability is increasing around the world: International Agreements National Policies Regulatory Mandates & Standards Government Purchasing

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

Power Consumption Mitigation

What does Green Mean to You?
Political
Blue State, Red State Green Party Regulatory Compliance? Trader Joes Whole Foods Walmart

Health

Social

Hybrids Bottled Water

Technology

Blades Scalable UPS Fuel Cells

Economics

Cost Centers Selective Accounting

YOU?
Presentation_ID

Control Influence
2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

 meanwhile .

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

Data Center Challenges are Everywhere

IT runs the business downtime is not an option I want to see more business value out of IT Our applications are the face of our business Its all about keeping the application available As long as my servers are up Im OK We have too many underutilized servers

CxO Apps

Server SecOps Storage

6

Our information is our business. We need to protect our data everywhere in transit and at rest

I cant keep up with the amount of storage that needs to be backed up, replicated and archived

I need to provide lots of bandwidth between data centers, and make sure users can get to the apps
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Network

BRANCH / WAN
Customer Hits Buy Confirm Shipment Billing Notification Order Complete Notify Sales Rep

Todays Business Processes Are Complex

Business Process
Process Order Check Credit Ship Order Bill Customer Update Cust Svce

DATA CENTER

Customer CRM
Premium Customer? Update Records

ERP
Update Contracts Credit Approved Update Call Center Update Call Center

Remote Users

WAN

Enter Order Check Inventory Update Inventory

SCM
Check Availability Initiate Billing

Trading Partners
Logistics
Deliver Order

Intranet

Accts
Check Account Balance Check Credit Credit Override Required

ebXML

Warehouse
Pack & Ship Order

EDI

Cust Master

Extranet

Check Customer DB

Credit
Check Credit History
Presentation_ID

SOAP

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

EXTENDED ENTERPRISE

Purchasing
Procure Material
7

The Issue is Complexity of IT Infrastructure

Web/Application IBM Mainframe Server Farm with OSA

Blade Servers

Departmental Servers

Email, File & Print

Storage & Backup

Point Appliances

Silod applications, departments, information, devices dont collaborate Complex, heterogeneous infrastructure driving cost, efficiency, agility New developments driving additional demands on infrastructure
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Data Center Transformation

Mainframe Client Server Web / n-Tier ServiceOriented Web2.0

IT Relevance and Control

XML SLB / App Front Ends Network Based Security LAN Switching IP Routing Application Architecture Evolution

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

Network Value

Where the Network is Going Today

Everything over IP

All Services Virtualized

Everything on Ethernet
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

All Devices Networked

10

Cisco Data Center Strategy & Evolution

Consolidation Virtualization Virtualization Automation

Regain IT Asset Control Lower Operational Expenses Protect and Control Investments

Capital Asset Utilization Improvement Power Savings Overall Systems Abstraction

Simplified and Policy Based Provisioning Reproduceable Processes Manage Business Processes and Templates

Unified Network Fabric Integrated Provisioning

Session Number Presentation_ID Presentation_ID

Innovation and Integration

Data Center Class Platform Integrated Services

11

2005 Cisco Systems, Inc. All rights reserved. 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

11

The Network Consolidation Effect

Server Bus Speed

Presentation_ID

Peripheral
Cisco Confidential

Network

Networked Resource
12

2006 Cisco Systems, Inc. All rights reserved.

The network design and the Data Center physical infrastructure planning must be done together, since day 1. HOW ?
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

13

Losses in power generate heat Where the power go ?

Each watt consumed by IT infrastructure carries a burden factor of 1.8 to 2.5 for power consumption associated with cooling, conversion/distribution and lighting*
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Sources: EYP Mission Critical Facilities, Cisco IT, Network World, Customer Interviews, APC

14

Cooling Supply or Distribution?

Current designs being specified to cool up to 30kW per rack

Supply?

Distribution?

Cisco Partner tested at 30KW and were able to cool in a normal server rack Tested different configurations and had very different cooling airflow results Targeted cooling utilizing modular hot/cold segregation essential to future-proof designs
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

15

Cooling Strategies by Rack Density

25

Infrastructure Examples
20

Cooling Options
Consider In- row cooling or liquid-cooled racks

Power per Rack (kW)

15 Fully ducted exhaust into hot aisle to prevent recirculation 10 More than 2 tiles needed per rack. Consider Spot Cooling 5 Vent rack exhausts, install closed cabinets and blanks to prevent recirculation 0

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

16

Enabling Hot Aisle/Cold Aisle Designs with High Density 6509 and 9513 Chassis
Example: Panduit Cabinet
45RU (32W x 40D x 84H) Up to 20kW/cabinet heat rejection capability 3 6509s or 3 9513s per Rack Front to back airflow into Hot Aisles Integrated Cable Management Modular design to support future air handlers or spot cooling Part # CN4-1 and CN4-2 for MDS 9513 and # CN4-3 for the Catalyst 6509E

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

17

Affording the Next-Gen Data Center

Legacy Server Power per Server Power per Floor Space Cooling Needschilled airflow 2-3 kW per rack 30-40 W/ft 200-300 cfm High-Density Server > 20 kW per rack 700-800 W/ft 3,000 cfm
Source: Gartner 2006

20,000 ft

Annual Operating Expense = $800k Legacy DC designed to accommodate 2-3kW per Rack Annual Operating Expense = $4.6M*
Introducing 1/3 high-density infrastructure into a legacy facility is cost prohibitive
*Peripheral DC costs considered
Cisco Confidential

800kW
+33%

100-200 Racks
Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

18

Data Center Zoning

Allows for a mixed environment of high density/low density Allows for targeted availability, service levels, cooling and UPS run-time Aligns well to virtualized environments

Power & Cooling 20kW Per Rack

Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Power & Cooling 5kW Per Rack

19

Where Cisco has Impact

Components & Solutions

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

20

Ciscos Positive Impact on DC Efficiency

Component Efficiency
Cisco Will Continue to Reduce Power Per Work Unit Performed Port Per Service

Catalyst 6500 Power Supply Efficiency has improved from 70%-80% since introduction in 1999. High end power supplies are better than 90% efficient.
Catalyst 6500 10GbE w/ DFC
150 20

Catalyst 6500 GbE w/ DFC

Pwr Per port
15 10 5 0

Pwr per port

100

50 0

6502

67041st Qtr6708 Catalyst 6500 SLB

6816

6516a

6724- 6748SFP SFP MDS9500

150 100 50 0

14 12 10 8 6 4 2 0

CSM
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved.

ACE
Cisco Confidential

Pwr per FC Port

Pwr per Gbps

9016

9124

9148
21

Cisco ACE with FWSM Reduces Power by 85%

Component/Conversion Point Reduction

Design Efficiency Performance Requirement

10 Gbps load balancing 20 Gbps Firewall 10 Virtual Contexts High availability

Incremental Power Required (W)

13,300 11,400 11,300

1,820

85% power reduction with virtualized, integrated modules ~ 11kW Rack space saved by using virtualized, integrated modules ~30RU Additional savings from reduced cabling, port consumption and support costs
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

22

Reduce Power Consumption

Through Service Density
Design Efficiency

Support for 200 contexts

Example: 10 Servers per SLB/FW Context ACE Module = 220W Incremental for SSL Termination + SLB FWSModule = 172W Incremental for FireWalling

ACE + FWSM Handle 200 SLB/FW Contexts 392W Incremental Total

Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

Catalyst 6500
23

Appliance Model Deployed in Redundant Config Repeats itself 1400Watts at a time

Example: 10 Servers per SLB/FW Context/Group

Design Efficiency Design Inefficiency

Redundant Configuration
800 Watts Incremental One Time Supports 200 Server Groups
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

1400 Watts Incremental with EACH new Server Group (x N)

24

Reduce Power Consumption

Through Service Density
Design Efficiency

Reduce complexity
Support for 200 contexts

Increase manageability Reduce latency Eliminate single points of failure The ACE and FWSM deployed in a Catalyst 6500 provide these services within the network fabric, eliminating the appliances and their associated load

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

25

MDS SAN Fabric Virtualization the More Power and Cabling Efficient SAN

Cisco MDS Solution

VSAN 1

Tape Library

VSAN 2

VSAN 3

MDS 9513 VSANs with Inter-VSAN Routing

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

26

Ciscos SAN Virtualization Solutions

Industry Leading Results
Design Efficiency

Common Physical Fabric

Step1: Build a network solution using Virtual Fabrics Step2 :Storage Virtualization

MS Marketing SAN Sales SAN MS

Increase disk utilization to ~70% Consolidate usable space in the actual Storage devices

MS HR SAN

Tape SAN

Greater power savings and reduced footprint Taking a tape subsystem offline can save $3,800 in power and cooling per year
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

27

Power & Cooling Mitigation

Use Case Analysis
Savings w/MDS Use Case 1 67% Use Case 2 70%
11,300

11,400

Use Case 3 41%

MDS Configurations:
vSANs + RBAC IVR FCIP

Use Case Profiles

1. 2. 3. Isolated storage traffic for 3 BUs sharing a common backup

Storage Services Module

Combined Mainframe and Open Systems storage network connectivity in the same data center Extended storage for remote replication and tape vaulting between data centers

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

28

3rd Party Validation

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

29

 in summary

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

30

Growth Projections
what are the experts saying?
2008, 50% of todays data centers will have insufficient power and cooling capacity to meet the demands of high-density equipment Through 2009, energy costs will emerge as the second-highest operating cost (behind labor) in 70% of DC facilities WW 2011, power demand for high-density equipment will level off or decline 2011, in-rack and in-row cooling will be the predominant cooling strategy for highdensity equipment 2011, in chasis cooling technologies will be adopted in 15% the servers
Source: Gartner; Meeting the DC power and cooling challenge
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

31

Transforming your Customers Data Center

10GbE/Cu will happen in a 2008-2009 timeframe at reasonable densities Cable distances may need to be less than 30m, intra-rack is ideal Fiber could inflect Copper at 10GbE to the host, especially in latency sensitive deployments, i.e. HPC Power and Cooling challenges remain top-of-mind Networks will Unify and Consolidate

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

32

Data Center Evolution

Consolidation
Reduce Operating Expense Can Strain Power Grids, HVAC Systems, and Control Planes Also an Opportunity to Audit Power and Cooling Design

Best Practices
Choose Efficient Components (Systems) Balance Density/Space Assess new Technology Targeted, Incremental Changes for Efficiency Virtualize to Increase Utilization Share Practices

Power & Cooling

Reduce Component Count Increases Density Assessment Needed to Determine OPEX for site Assessment may be Needed to Audit Existing CPI

Evolving to Green
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

33

Common Questions
what are the variables?
Name Plate or Average Operating Consumption? DC versus AC Power? Best cabling fiber or UTP ? How to calculate data center efficiency? How to measure at the systems level? Why should IT care? Cooling supply versus air distribution What is the networks role and where is it going? Where to learn more?

Source: Gartner; Meeting the DC power and cooling challenge

Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

34

In Closing

Ciscos virtualization solutions slow the growth of power demand through increased utilization while reducing component count Ciscos next-generation products and solutions will further reduce power consumption at the systems level Cisco is focused on environmental concerns from executive direction to individual product design Ciscos CA group provides services for Power and Cooling auditing as a Network Readiness Assessment to assist with facilities support planning
Presentation_ID 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential

35

Presentation_ID

2006 Cisco Systems, Inc. All rights reserved.

Cisco Confidential

36