You are on page 1of 32

Computational Fluid Dynamic (C.F.D.

)
Modeling of Containment Solutions

Design

Model

Deploy

What is C.F.D
CFD or computational fluid dynamic modeling is a
program designed to simulate how fluids, like air
act and react in an environment, from determining
flow patterns to heat absorption. Recently CFD
tools have been designed specifically for the data
center or IT environment. Great Lakes has begun
to offer CFD modeling to its customers in order to
help address issues, plan capacity increases in
current operating data centers, or to test a data
center design or room design before ever starting
the build.

CFD Model of Cooling Solutions


An evaluation of containment solutions for datacenters using CFD modeling. A base
line datacenter was used to provide a comparison of different containment
solutions. The following slides outline the datacenter facility and IT specifications.

Physical Space

Dimensions: 40 Wide by 60 Long


Raised floor height: 24
Ceiling height from raised floor: 14
2403 sq. ft traditional raised floor data center

IT Specifications
7.2 kW per enclosure
Total IT Load = 459kW
64 Racks at 44 RMU (1408 servers @ 2U) 2240 Ports (servers * 2 ports)

Room Conditions
CRAC unit exhaust 75 degrees Fahrenheit
False Ceiling used with chimneys
Aisle contains 16, 40% perforated floor grilles

Power
3 Phase 480V 1000A service
500 kVA Generator x 1
500kVA UPS system x 2
In Room PDU for 480 to 220V step down
Power run under floor (Rack PDUs hardwired to
BusWay)
30AMP 3Phase Rack PDU with 208V output x 2
per enclosure

Cooling
150 Ton Centrifugal Chiller Unit
40 Ton CRAC units with plenum x 4
Traditional Hot Aisle/Cold Aisle configuration
500 floor tiles (388 solid, 112 perf when needed)

47
48

STATUS

STATUS

STATUS

STATUS

STATUS

ID

N7K-M148GS-11L

ID

N7K-M148GS-11L

ID

1 2 3
ID
N7K-M148GS-11L

N7K-M148GS-11L
1 2 3
ID

1 2 3
ID
N7K-M148GS-11L

48

STATUS

47

46

45

44

43

11

10

11

12

12

13
14

13
14

13
14

12

11

11
12

10

11
12

10

12

11

11
12

10

13
14

12

11
10 12
11

12

13
14

13
14

11

12

13
14

10

11
12

11

11
12

10

11
12

42
37
38

41

40

24

24

24

24

23

23

23

23

22

22

22

22

21

21

21

21

20

20

20

20

19

19

19

19

18

18

18

18

17

17

17

17

16

16

16

16

15

15

15

15

14

14

14

14

13

13

24

23

22

21

20

19

18

17

16

15

14

13

13

24

23

22

21

20

19

18

17

16

15

14

13

13

24

23

22

21

20

19

18

17

16

15

14

13

25
26

25
26

25
26

25
26

25
26

25
26

25
26

25
26

25
26

23
24

23
24

23
24

23
24

23
24

23
24

23
24

23
24

23
24

36

36

36

36

35

35

35

35

34

34

34

34

33

33

33

33

32

32

32

32

31

31

31

31

30

30

30

30

29

29

29

29

28

28

28

28

27

27

27

27

26

26

26

25

36

35

34

33

32

31

30

29

28

27

26

25

26

36

35

34

33

32

31

30

29

28

27

26

25

25

36

35

34

33

32

31

30

29

28

27

26

25

25

36

35

34

33

32

31

30

29

28

27

26

25

25

36

35

34

33

32

31

30

29

28

27

26

25

46

46

46

45

45

45

44

44

44

43

43

43

42

42

42

41

41

41

40

40

40

39

39

37

37

38

46

45

44

43

42

41

40

39

47

48

48

48

48

46

45

44

43

42

41

40

37
38

47

47

47

46

46

45

45

44

44

43

43

42

42

41

41

40

40

39

37
38

38

48

48

48

48

48

39

37
38

38

47

47

47

47

47

39

38

37

35
36

35
36

37

46

45

44

43

42

41

40

37
38 3839

37

35
36

35
36

46

45

44

43

42

41

40

39

38

37
38

38

37
38

38

37
38

39

37
38

38

37
38

37

37

37

37

35
36

35
36

35
36

35
36

35
36

47
48

47
48

47
48

47
48

47
48

47
48

47
48

47
48

47
48

35
36

39

38

ID

37

N7K-M148GS-11L

36

N7K-M148GS-11L

35

STATUS

34

33

24

23

22

21

20

19

18

17

16

15

14

13

32

24

23

22

21

20

19

18

17

16

15

14

13

31

13
14

30

13
14

29

12

28

12

27

11

26

11

25
25
26

11
12

24
23
24

11
12

23

10

22

10

21

20

19

18

17

16

15

14

13

12

11

10

13
14

11
12

ID

ID

N7K-M148GS-11L

N7K-M148GS-11L

STATUS

3
FAB

ID

STATUS

2
SUP

N7K-M148GT-11L

STATUS

1
FAN

PSU

Enclosure Configurations
Server Enclosure (63 enclosures)

IOM

GL840ES-3042
20 x Dell R710 2 RMU servers @ 400W

Cisco Nexus 7000 Series

10

Network Enclosure (1 enclosure)

GL840ES-3048
1 x Cisco Nexus 7010
Remaining RMU on each rack to be populated with Filler
Panels. Sides of enclosures to have Brush Grommet kits
installed.

Configurations

Enclosure Level Containment


With Air Managers and Chimneys

Standard Cold Aisle Containment

Cold Aisle Containment With


Horizontal Polargy Panels

Standard Hot Aisle Cold Aisle

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Server Enclosure Configuration
GL840ES-3042LC
Frame: 8401ES-3042 84H x 30W x 42D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Solid - 8403E-29
Air Manager: GL-AMES
Chimney: GL-EC-42-3246
BGRK30 Side rail grommet kit
Network Enclosure Configuration
GL840ES-3048LC
Frame: 8401ES-3048 84H x 30W x 48D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Solid - 8403E-29
Air Manager: GL-AMES
Chimney: GL-EC-48-3246
BGRK30 Side rail grommet kit
Containment Components:
1.75-FPTL19 Tool-less filler panels for
unused RMU
Additional Notes:
5 floor tiles per cold aisle

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Performance
Air Handler Supply: 75
Air Handler Return: 98.2
Room Temp. Change: 6.7

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Temperature, cabinet bottom height

Cold aisle
temperatures are
very consistent with
no air recirculation.

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Temperature, halfway cabinet height

Use of chimneys
eliminates the hot
aisle maintaining
a consistent
temp. throughout
the data center.

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Temperature, cabinet top height

Temperatures in
the cold aisle at
the top of the
enclosures are
within range of
the air handler
set-points due to
the elimination of
the hot aisle. The
overall temp in
the data center is
consistent.

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)
Temperature, 12 above cabinet

Exhaust air from


the chimneys is
directed into the
drop ceiling
where the air
handlers with
baffles installed
into the ceiling
draw the hot air
in to be
conditioned.

Enclosure Level Containment


With Air Manager and Chimneys
(5 floor tiles per aisle)

cross section

Overall the system is highly efficient in segregating hot air


from the room providing a high return temperature to the
CRAC unit. However a plenum ceiling or plenum ducting is
needed to return to the CRAC unit.

Equipment
intake
temperatures
are consistent
from top to
bottom. Hot air
is ducted into
the plenum
where hot air is
returned to the
CRAC unit.

Standard Cold Aisle Containment


With Horizontal Polargy Panels
Server Enclosure Configuration
GL840ES-3042MS
Frame: 8401ES-3042 84H x 30W x 42D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit

Network Enclosure Configuration


GL840ES-3048MS
Frame: 8401ES-2448 84H x 30W x 48D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit
Containment Components:
ACD840ES Aisle Containment Doors
PPLEX-HPNL24 Horizontal Polargy
Containment Panels
1.75-FPTL19 Tool-less filler panels for
unused RMU

Standard Cold Aisle Containment


With Horizontal Polargy Panels
Performance
Air Handler Supply: 75F
Air Handler Return: 98.2F
Room Temp. Change: 19.2F

Standard Cold Aisle Containment


With Horizontal Polargy Panels
Temperature, cabinet bottom height

End of row
containment
creates a
consistent cold
aisle temperature

Standard Cold Aisle Containment


With Horizontal Polargy Panels
Temperature, halfway cabinet height

Standard Cold Aisle Containment


With Horizontal Polargy Panels
Temperature, cabinet top height

Overhead
containment panels
reduce
recirculation in the
top of enclosures
creating very
consistent temps in
the aisles of the data
center.

Standard Cold Aisle Containment


With Horizontal Polargy Panels
(cross section view)

Equipment
intake
temperatures
are consistent
from top to
bottom

Overall the system is efficient in segregating hot air from the


room providing a high return temperature to the CRAC unit.
However end of row doors and overhead panels add
additional infrastructure and safety considerations.

Standard Cold Aisle Containment


Server Enclosure Configuration
GL840ES-3042MS
Frame: 8401ES-3042 84H x 30W x 42D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit
Network Enclosure Configuration
GL840ES-3048MS
Frame: 8401ES-3048 84H x 30W x 48D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit
Containment Components:
ACD840ES Aisle Containment Doors
1.75-FPTL19 Tool-less filler panels for
unused RMU

Standard Cold Aisle Containment


Performance
Air Handler Supply: 75F
Air Handler Return: 98.1F
Room Temp. Change: 22.1F

Standard Cold Aisle Containment


Temperature, cabinet bottom height

Cold Aisle
containment reduces
recirculation creating
more consistent
temperatures in the
hot and cold aisles

Standard Cold Aisle Containment


Temperature, halfway cabinet height

Standard Cold Aisle Containment


Temperature, cabinet top height

Recirculation still
occurs at the tops of
the enclosures creating
higher exhaust temps
and less even
temperatures in the
data center.

Standard Cold Aisle Containment


(cross section view)

Equipment
intake
temperatures
fluctuate at the
ends of rows
and tops of
enclosures due
to re-circulation.
Overall the system is efficient in segregating hot air from the room
providing a high return temperature to the CRAC unit. However end of
row doors add additional infrastructure and safety considerations and
cold air can by-pass the cold aisle resulting in losses in efficiency as well
as hot air re-circulation.

Standard (Hot Aisle/Cold Aisle)


Server Enclosure Configuration
GL840ES-3042MS
Frame: 8401ES-3042 84H x 30W x 42D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit

Network Enclosure Configuration


GL840ES-3048MS
Frame: 8401ES-3048 84H x 30W x 48D
Top Panel: Solid Top - TPES-S
Front door: Mesh Contour 8402E-MC29
Rear Door: Mesh Contour 8402E-MC29
BGRK30 Side rail grommet kit
Additional Accessories
1.75-FPTL19 Tool-less filler panels for
unused RMU

Standard (Hot Aisle/Cold Aisle)


Performance
Air Handler Supply: 75F
Air Handler Return: 98.6F
Room Temp. Change: 21.5F

Standard (Hot Aisle/Cold Aisle)


Temperature, cabinet bottom height

Recirculation in
the cold aisle
raises equipment
inlet temperature

Standard (Hot Aisle/Cold Aisle)


Temperature, halfway cabinet height

Standard (Hot Aisle/Cold Aisle)


Temperature, cabinet top height

Recirculation in the
cold aisle raises
equipment inlet
temperature which
creates a higher
exhaust temperature

Standard (Hot Aisle/Cold Aisle)


(cross section view)
Recirculation from
around the aisle and
over the top of the
enclosures creates
high equipment
intakes in the cold
aisle.

Overall the system segregates hot air from the cold aisle.
However, hot air recirculation can occur in the top third RMU
of the equipment causing early equipment mortality and
thermal shutdowns.

You might also like