You are on page 1of 50

ANSI/BICSI 002, Data Center Design

and Implementation Best Practices


Rick Ciordia, PE, RCDD, DCDC, RTPM, CT
ETTG, PSC.
CALA District Chair - BICSI

BICSI International
Standards Program
Develop standards within all facets of
Information & Communications Technology
(ICT) infrastructure design and installation
Details:
Over 450 member worldwide
Accredited by ANSI
Develops international open to use/royalty free
standards and best practices

BICSI Standards Within ICT


IEEE
Defines the message
and transmission
characteristics

ISO/IEC
& TIA
Defines the transmission
media and system
specifications

BICSI
Defines how to design
solutions using transmission
media and systems

Standards Development Cycle


Industry Needs
Technology Trends
Designers
Suppliers
Clients

Idea to
Consensus
Body

Use

Draft

Consensus
Ballot

Review of
Results

BICSI Published Standards


Building/Facilities
K12 / Primary Education
Facilities (001)
Data Centers (002)**
Healthcare Facilities (004)

Systems
ESS (005)*
DAS (006)**

Installation
Cable Installation
(NECA/BICSI 568)
ICT Bonding and
Grounding
(NECA/BICSI 607)*

Other
BIM for ICT (003)

* Available in Spanish
** Translation into Spanish planned or in progress

Current Activities
New Standards
DAS Design
Moving to publication

ICT Systems for Intelligent


Buildings
OSP Installation and
Construction
General Principles
Aerial Pathway

Revision Activities
Revision to BICSI 005, ESS
IP Fire Alarm

Revision to BICSI 001,


Educational Facilities
Expanded scope to include
secondary, graduate,
post-graduate facilities

About ANSI
(American National Standards Institute)
Promotes standards use within United States
Accreditation body
Standards Development
Credentialing Bodies (ISO 17024)
Testing Laboratories (ISO 17025)

Ensures open and unbiased standards


development processes
Does not create standards

Reach of BICSI Standards

ANSI/BICSI 002-2014
Data Center Design and
Implementation Best Practices

Data Center Standards


ISO/IEC 24764 (2010)

ANSI/TIA-942-A (2012)

Information technology Generic cabling


systems for data centres

Telecommunications Infrastructure Standard


for Data Centers

44 pages

118 pages

CENELEC EN 50173-5:2007 /
A2:2012

ANSI/BICSI 002-2014

Information technology Generic cabling


systems - Part 5: Data centres

48 pages

Data Center Design and Implementation


Best Practices

534 pages

CENELEC EN 50600 (2012-)

ASHRAE TC9.9 (2012)

Information technology Data centre


facilities and infrastructures

Thermal Guidelines for Data Processing


Environments, 3rd edition

Multiple Documents

150 pages

Comparing the Data Center Standards


Data Center Design
BICSI 002, CENELEC 50600

Computer Room and Cabling Infrastructure


TIA 942-A

Cabling Infrastructure
ISO/IEC 24764, CENELEC EN 50173-5

Environmental Conditions
ASHRAE TC 9.9

Others
Local / Country
Certifications

Design Standard - CENELEC 50600

EN 50600-1 (2012)
General Concepts
32 Pages

EN 50600-2-1 (2014)
Building Construction
36 Pages
EN 50600-2-2 (2014)
Power Distribution
40 Pages
EN 50600-2-3 (2014)
Environmental Control
32 Pages
EN 50600-2-4
Telecommunications
Cabling Infrastructure
EN 50600-2-5
Security Systems
EN 50600-2-6
Management and
Operational Information

BICSI 002, Data Center Design and


Implementation Best Practices
More than just cabling
Expands requirements
from other standards
Covers additional
topics not within other
standards

BICSI 002-2014 Breakdown


Security
14%

Other
7%

Cabling /
Networks
22%

Site /
Building
18%

Electrical
26%
HVAC /
Mechanical
13%

Represents 408 pages of normative content across 13 sections

Content Revision and Expansions

Availability Classes
Modular Data Centers*
Hot/Cold Aisles
Mechanical Systems*
DCIM*
Circuit Maps and DC
Power
Cabinet Airflow and
Cabling Capacity
Green / Efficiency*

Building Structure
Site Hazards
Data Center Services
Outsourcing Model*
Bonding & Grounding
Commissioning
Network Security*
Telecommunications
Cabling
(And More )

* Indicates all new content to this edition

BICSI Design Classes and


Selection Methodology

Finding the Right Design


Methodologies include:
Loss prevention vs. initial build cost
Total Cost of Ownership (TCO)
Desired availability level

All provide a starting point for design


requirements

BICSI Design Class Determination


Based on three questions
1. How much downtime per year will be allowed
for maintenance?
2. During scheduled operation, what is the
maximum allowed downtime?
3. What is downtimes impact to operations?

Answers will indicate design class for starting


point of requirements

Interaction of Answers
Define
Operational
Requirements

Define
Operational
Availability
Requirements

Identify Required
Availability Class

Define Impact
of Downtime

BICSI DC Design Classes


Class 0: Single path, and fails to meet one or
more criteria of Class 1
Class 1: Single path
Class 2: Single path with redundant
components
Class 3: Concurrently maintainable & operable

Class 4: Fault tolerant

Availability Class Prefixes


Class Fx: Facility (Electrical & Mechanical)
Class Cx: Cable Plant
Class Nx: Network Infrastructure
Class Sx: Data Processing and Storage Systems
Class Ax: Applications

Class F1 Electrical Example


Utility

Transfer
Switchgear

Alternate
Power
Source

Electrical Distribution

UPS

Maintenance
Bypass

Static
Bypass

Mechanical
Switchgear

PDU

Critical
Loads

Non-Critical
Loads

Mechanical
Loads

Class F2 Electrical Example


Utility

Transfer
Switchgear

Alternate
Power Source

Alternate
Power Source

+1

Electrical Distribution

Static
Bypass

UPS

UPS

+1

Mechanical
Switchgear

Maintenance Bypass

PDU

Critical
Loads

Non-Critical
Loads

Mechanical
Loads

Electrical Class F3
Alternate
Power Source

Alternate
Power Source

Transfer
Switchgear

Utility

+1

Electrical Distribution

Electrical Distribution

Static
Bypass

UPS

UPS

+1

Mechanical
Switchgear

Mechanical
Switchgear
Mechanical
Loads

Maintenance
Bypass

Mechanical
Loads

Output Distribution Switchboard

Alternate Switchboard

Critical Mechanical
Switchgear

PDU

Non-Critical
Loads

Critical Mechanical
Switchgear

Critical
Fans/Pumps

Critical
Loads

PDU

Non-Critical
Loads

Electrical Class F4
Alternate
Power Source

Transfer
Switchgear

Alternate
+1
Power Source

Utility

Static
Bypass

UPS

+1

Mechanical
Switchgear

Maintenance
Bypass

Mechanical
Switchgear

Mechanical
Loads

UPS

UPS

+1

Static
Bypass

Maintenance
Bypass

Output Distribution Switchboard

Output Distribution Switchboard


Critical Mechanical
Switchgear

PDU

Alternate
+1
Power Source

Electrical Distribution

Electrical Distribution

UPS

Alternate
N
Power Source

Transfer
Switchgear

Critical Mechanical
Switchgear

Critical
Fans/Pumps

Non-Critical
Loads

PDU
Non-Critical
Loads

Critical
Loads

Class F4 Electrical Catcher


Utility

Utility

High Voltage
Receiving 2

High Voltage
Receiving 3

High to Medium Voltage


Transformer 2

Switchgear

High Voltage
Receiving 1

High to Medium Voltage


Transformer 1

+
Alternate
Power Source 1

Alternate
N
Power Source

Medium Voltage
Distribution 2

Medium Voltage
Distribution 1

Normal
UPS

Standby
UPS

Normal
UPS

+1

Stand-by

Overlap Switch
(Manual)

Main

To Mechanical Systems
See Section 10 for configuration
of mechanical systems

PDU-A
Non-Critical
Loads

Source 2

Source
2

Source 1

Source
1

Source 2

Source
2

Source 1

Source 2

Source 1

Main

+1

Source
1

Static Bypass Input

Standby
UPS

Medium Voltage Electrical Distribution 2

Static Bypass Input

Normal
UPS

Static Bypass Input

Source 1

Source 2

Medium Voltage Electrical Distribution 1

Standby
UPS
+1

Stand-by

Overlap Switch
(Manual)
PDU-B

Critical
Loads

Non-Critical
Loads

Telecommunication Classes
Service
Provider

Service
Provider

Service
Provider

Service
Provider

Class C4
C2
C1
C3
Maintenance
Hole

Maintenance
Hole

Entrance Room

Entrance Room

Offices,
Operations Center,
Support Rooms

Computer
Room

Telecomunicaciones
Room

Main Dist Area

Horiz Dist
Area

Main Dist Area

Horiz Dist
Area

Zone Dist Zone Dist


Area
Area

Horiz Dist
Area

Horiz Dist
Area

Zone Dist
Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

Equip
Dist Area

ITE

ITE

ITE

ITE

ITE

ITE

ITE

ITE

Only required for large computer rooms due to port


counts or distance limitations

Air-Cooled
Condenser
(Dry-Cooler)
Chiller

Air-Cooled
Condensers
(Dry-Coolers)

Chiller

Chiller
CRAH
CRAH

Mechanical Class
F1
F2
No
Redundant
redundancy
critical
present
components
All power feeds from
common upstream
distribution
Only
No ability
redundant
to be
maintained under
components
able to
load
be
maintained under
load

Air-Cooled Condensers (Dry-Coolers)


Air-Cooled
Condensers
(Dry-Coolers)

Chiller
Chiller

Mechanical Class
F3
F4

Chiller
Chiller Chiller

CRAH
CRAH

Redundant equipment
Redundancy
in all areasand
piping
for maintenance
Equipment
and controls
with redundant
Power
feed so that
systems
cooling
fed
from different
capacity
does not
electrical
drop
distribution
below
"N" when
or
maintaining
Maintainablemechanical
when actions
upstream
electrical
do not reduce
cooling
distribution
capacity below "N+1"
Maintainable when actions
do not decrease cooling
capacity below "N"

Class N0/N1 and N4 Network

Class S4 System and A4 Application

Availability and
Multi-Site Data Centers
Prior to virtualization, subclasses aligned through
data center
Today, a single data center may not have
alignment
Availability class methodology can in discussions
about using multiple data centers to achieve
availability target

Example: Class 3 Availability Using


Three Class 2 Data Centers

Modular Data Center Design


Modular may describe:
How a data center is segmented
Method of construction/implementation

Both can assist in allowing for different


availability needs for one site

Modular/Containerized Data Center


Space Adjacencies
F4
F3
F2

Modular Design Planning Aides

BICSI-002, 2014 Supplement

Are BICSI & Uptime Similar?


ANSI/BICSI 002-2014
This standard provides a reference of common
terminology and design practice a framework for
the process to determine facility criticality and to
develop optimum design & implementation solutions

Uptime Tiers
Only data center benchmarking system developed by and
for data center owners
Performance-based on fundamental concepts
Not a checklist, design menu, or cookbook
Source: Uptime Institute: Tier Classification System & Operational Sustainability presented by
Dana Smith, Director of Development, Uptime Institute at BICSI Andino 2012

Standards

BICSI

Colombia
o NTC-6064 - Tecnologa de la Informacin. Cableado
Genrico para instalaciones de clientes.
Especifica el cableado genrico para uso dentro de
instalaciones que pueden comprender una o varias
edificaciones en un predio (campus).
Comprende el cableado balanceado y el cableado de fibra
ptica.
Referencia: ISO/IEC 11801

Colombia (Cont.)
o RITEL - Reglamento Tcnico para Redes Internas de
Telecomunicaciones
Establece las medidas relacionadas con el diseo/
construccin y puesta en servicio de las redes internas de
telecomunicaciones.
Referencia: ISO/IEC 11801

Costa Rica
o Colegio Federado de Ingenieros y Arquitectos
Todos los planos de instalaciones electricas y de
telecomunicaciones, de voz y datos deberan cumplir
donde corresponda con:
El NEC Codigo Electrico Nacional (NFPA 70) en su ultima version en
espanol.
NFPA 70 E Norma para la seguridad electrica de los empleados en
los lugares de trabajo, en su ultima version en espanol.

Las ultimas revisiones y adenda aprobados de las normas


ANSI/EIA/TIA 568, 569, 570, 606, 607.

Mexico
o NMX-I-108-NYCE-2006, Telecomunicaciones Cableado Cableado
estructurado Puesta a tierra en sistemas de telecomunicaciones
o NMX-I-132-NYCE-2006, Telecomunicaciones Cableado Cableado
estructurado Especificaciones de las pruebas de cableado balanceado
Parte 01: Cableado instalado
o NMX-I-154-NYCE-2008, Telecomunicaciones Cableado Cableado
estructurado Cableado genrico residencial
o NMX-I-248-NYCE-2008, Telecomunicaciones Cableado Cableado
estructurado Cableado de Telecomunicaciones para edificios comerciales
Especificaciones y mtodos de prueba
o NMX-I-279-NYCE-2009, Telecomunicaciones - Cableado - Cableado
estructurado - Canalizaciones y espacios para cableado de
telecomunicaciones en edificios comerciales

Mexico (Cont.)
o NMX-I-14763-1-NYCE-2010, Telecomunicaciones Cableado Cableado
estructurado Implementacin y operacin de cableado en edificios
comerciales Parte 1: Administracin
o NMX-I-24764-NYCE-2013, Tecnologa de la informacin Sistema de
cableado genrico para centros de datos
o NMX-J-364/I-ANCE-2011, Instalaciones elctricas Parte 1: Principios
fundamentales, planeacin de caractersticas generales, definiciones
o NMX-J-C-I-489-ANCE-ONNCCE-NYCE-2014, Centros de datos de alto
desempeo sustentable y energtico Requisitos y mtodos de
comprobacin
o NOM-001-SEDE-2012, Instalaciones Elctricas (Utilizacin)
ANCE
- Asociacin Nacional de Normalizacin y Certificacin del Sector Elctrico
NMX
- Norma Mexicana
NOM
- Norma Oficial Mexicana
NYCE
- Normalizacin y Certificacin Electrnica
ONNCCE - Organismo Nacional de Normalizacin y Certificacin de la Construccin y Edificacin

Standards In Use
Country
Chile
Colombia
Costa Rica
El Salvador
Guatemala
Honduras
Mexico
Panama
Peru
Puerto Rico
Republica
Dominicana
Uruguay
Venezuela
Notes:

NEC

TIA

RL
RLN

X
R
X
X
X
X
X

RN

ISO
X
R
X
X
X
X
X
X

BICSI
X
X
X
X
X
X
X
X
X
X

Uptime

ICREA

National

RN

RN

X
R

Other

X
RL

X
R

X = Being Used Not Required


R = Required by law, regulation, etc.
RLN = NEC version adopted as national

X
R

RN = National Version
RL = National Version based on NEC

DC Standards
Organization

BICSI

TIA

Standard

BICSI 002
(2014)

TIA 942A
(2012)

Areas Covered

Recognition

ISO

ISO 24764 EN 50173-5


(2010)
/ EN 50600

US /Canada
Worldwide
Worldwide
(Intl)

Electrical

Yes

Mechanical

Yes

Telecom

Yes

Yes

Environment

Yes

Yes

Site

Yes

Security

Yes

CENELEC

EU
(Intl)

ASHRAE

ICREA

ASHRAE
TC9.9

ICREA-Std131-2013

US/Canada
(Intl)

Intl
(21
Countries)

Yes

Yes
Yes

Yes

Draft
Yes

Draft

Yes
Yes

Yes

Yes

Planned Interoperability

(BICSI 002-2014)

Data Center

Government Regulations
Electrical Code
Building Code

Fire Code
Electrical Standards
Cabling Standards
Cabling Spaces Standards
Environmental Conditions
Building System Standards
Security Standards

Industry
Government
Canada,
Government
FCC, OSHA
Labour
Regulations
Program

(BICSI 002-2014)

Rica
Costa
States
United
Colombia
Canada

Interoperability Demonstrated
CSA
Electrical
NFPA
C22.1
70 (NEC)
Code
(CEC)
National
Building
CodeCode
of Canada
(NBC)
International
Building
Government
Building
Code (IBC)

National
FireFire
Code
of Canada
Government,
NFPA
1,Code
NFPA
NFPA
72 (NFC)

Electrical
IEEE,
IEEE,
CSA,
NFPA,
Standards
NFPA
IEEE
NECA
Cabling
RITEL,
TIAStandards
568
ISO
Cabling Spaces
TIAISO
942Standards
Environmental
ASHRAE
Conditions
Building
TIA 862,
System
ISO
AHSRAE
Standards
13
NFPA,
RCMP,
Security
Government,
Government
ASIS,
Government,
Standards
Government
ISOISO

Why BICSI 002?

If you fail to plan,


you are planning to fail!
Si fallas en planificar,
estas planificando fallar!
- Benjamin Franklin

Thank You!
Rick Ciordia, PE, RCDD, DCDC, RTPM, CT
ETTG, PSC.
rciordia@ettgpr.com

You might also like