FAS2600 SE Presentation

FAS2600 SE presentation
Version 1.1
Chris Lueth
Principal TME
September 2016
1 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Topics covered in order
1) FAS2600 overview of architecture, positioning, and performance

2) FAS2600 limits
3) FAS2600 deep dive
Details about ports, motherboard, field-replaceable parts, and NVMEM
architecture
4) Detailed I/O information

Including supported and best practice configurations
5) FAS2600 software
6) Environmentals
Power consumption, cooling, dimensions, and weight
Introducing two FAS2600 models
Next-generation midrange platform
FAS2620
2U 12-disk enclosure
SSD and SATA
FAS2620A
Replaces FAS2554
FAS2650
2U 24-disk enclosure
SSD and SAS
FAS2650A
Replaces FAS2552
FAS2600: next-generation midrange platform
Two models: FAS2620 and FAS2650

Both use the same controller module
Leverages new converged shelf architecture

DS212C and DS224C
Based on latest Intel Broadwell-DE six-core processor

Uses NVMe M.2 connection for onboard Flash Cache
Significant performance increase over FAS2500
Enhanced I/O capabilities with more configuration flexibility
Full 12Gb SAS connectivity to internal and external drives
Introducing the FAS2600
HA pairs
Whats New Compared to FAS2500
3x performance improvement
12 CPU cores: 3x more physical cores
64GB memory: ~2x more memory
8GB NVMEM: 2x more NVMEM
Onboard NVMe M.2 Flash Cache

Persistent write log
FAS2600
Enhanced I/O layout
2 mini-SAS3 ports for external storage
2 10GbE cluster interconnect ports
4 UTA2 16Gb FC or 10GbE ports, also
supports GbE
USB port that works!
New USB-based console port, 115K baud
Next-generation controller performance
HA pairs
Next-Generation FAS Performance

File System Workload (NFS)
600000
500000
400000
IOPS
300000
200000
100000
0
FAS2552 FAS2600 FAS8040 FAS8200 FAS8080 EX FAS9000
HA pairs

OLTP Workload (FC)
300000
250000
200000
IOPS
150000
100000
50000
0
HA pairs

Large Sequential Reads
20
18
16
14
12
GBps
10 NFS
FC
8
0
HA pairs

Large Sequential Writes
7
4
GBps
NFS
FC
3
0
Next-generation FAS systems at a glance
HA pairs
Form factor 2U 6U 3U 12U 8U
CPU cores 4 (8 with HT) 12 16 32 40 72
Physical memory 36GB 64GB 64GB 256GB 256GB 1024GB
NVMEM 4GB 8GB 16GB 32GB 64GB
Flash-based cache 16TiB 24TiB 16TiB 48TiB 144TiB

96 SSDs1
Max drive count 720 480 1440
144 HDDs
Onboard 10GbE - 4 8 4 8 -
Onboard UTA2 8 8 8 8 8 -
Onboard 10GbE Base-T - - - 4 - -
Onboard GbE 4 - 8 - 8 -
Onboard SAS 4 (6Gb) 4 (12Gb) 8 (6Gb) 8 (12Gb) 8 (6Gb) -
Slots - - 8 4 24 24
ONTAP ONTAP 8.2.2 + ONTAP

Data ONTAP support 8.2.1 + 8.2.1 +
9.1RC1 9.1RC21 9.1RC1
1. FAS2620 only supports hybrid Flash Pool and not all SSD configurations, with 8 internal SATA max SSDs is 88.
FAS2600 ONTAP 9 node limits
NAS SAN
Homogeneous Clusters Max Cluster Max Cluster
Nodes Nodes
FAS2600 8 8
NAS SAN
Heterogeneous (Mixed) Clusters1 Max Cluster Max Cluster
Nodes Nodes
AFF A300
FAS8200
FAS2552, FAS2554 8 8
FAS/V3220, FAS/V3250, FAS/V3270
AFF8020, FAS8020
FAS22xx, FAS2520 4 4
1. See Hardware Universe for more details about platform mixing rules.
Flash limits
HA pairs
FAS2600
Minimum/maximum onboard flash

1024GiB
(512GiB per node)
Maximum onboard flash + Flash Pool cache
24TiB
(HA and standalone)
FAS2600 aggregate and volume sizes
FAS2600
Maximum number of volumes 1,000
Maximum aggregate size 400TB
Maximum volume size 100TB
Minimum root volume size 350GB
Supported back-end storage
Shelf Module
DS224C IOM12
DS212C IOM12
IOM6
DS2246
IOM12
IOM6
DS4246
IOM12
In-band SAS management
Starting in ONTAP 9, SAS management is now in band over the

SAS paths
Supported on all platforms running ONTAP 9
Separate ACP cabling not needed anymore with in-band
management in ONTAP 9
But can be left in place on upgrades to ONTAP 9
FAS2600 and other new controllers no longer have the locked

wrench port for private out-of-band ACP cables
FAS2600 HA configuration
Take a closer look
FAS2600 controller close-up
Take a closer look
FAS2600 controller I/O
Take a closer look
Micro USB RJ45

Mini SAS3 Ports (2)
Serial Console Port Serial Console Port
10GbE Cluster UTA2 Ports e0M

USB Port
Interconnect Ports (2) (4) Management
Port
FAS2600 motherboard image
Take a closer look
NVMEM Battery
FAS2600 FRU map
Take a closer look
FAS2600 block diagram
Take a closer look
FAS2600 NVMEM architecture
In the event of a dirty shutdown, the NVMEM battery keeps DIMM

slot powered so write data in memory is protected during reboot
In the event of unexpected loss of power:
NVMEM battery keeps motherboard temporarily powered up
NVMEM contents destaged to flash on boot device
Motherboard powers down after NVMEM data is destaged to flash
Offers persistent write cache for write data not committed to drives:
No need to worry about minimum 72-hour battery life to protect NVMEM data
Previously only midrange and high-end FAS systems had this ability
Data stored in flash is encrypted for added security

Normally charged battery capable of about 25 destage events
22 2015 NetApp, Inc. All rights reserved. NetApp Confidential -- Limited Use
FAS2600 NVMEM destage/restage
Destaging: NVMEM battery keeps controller powered up during event:
***********************************
* Pending cached data is detected *
* Starting the process to save to *
* media... *
***********************************
Destage is in progress, please wait
.....................
Destage is completed successfully
Powering off from the backup power source
Restaging: NVlog replayed from flash to recover writes if needed:

******************************* .
Mon Jul 25 17:24:10 2016 [nv2flash.restage.progress:NOTICE]: ReStage is going to restore
non-volatile data from flash in approximately 21 second
FAS2600 hot-swappable FRUs
Denoted by terracotta (orange) cam lever or thumbscrew

Controllers
Do not turn off PSUs to remove a controller in dual-controller chassis
PSUs
One PSU can run entire system
Two-minute shutdown rule if one PSU removed
See slide 39 for more details
Unified Target Adapter 2 (UTA2) ports
Overview
UTA2 ASICs are dual port

Two ports on ASIC are call port pair
Port pair must be set the same: FC or Ethernet

Two steps needed to set port personality in the field:
Pick from FC or CNA personalities for ASIC
ONTAP 9 set port command: system node hardware unified-connect
Install appropriate SFP+ or twinax cable when using CNA Ethernet personality
When set to FC, either port on ASIC can be target or initiator

When set to CNA, GbE and 10GbE SFPs can be used on same
ASIC
Reboot required to change personality or target/initiator mode
UTA2 port: tips for using ucadmin
FCP
Overview administrative
fas2650> ucadmin status and not
port operational
The following commands are available; for more status. When
information using FC, add
type "ucadmin help <command>" license and
start fcp to bring
help modify show online.
fas2554> ucadmin show
Current Current Pending Pending
Adapter Mode Type Mode Type Status
------- ------- --------- ------- --------- -------
0c cna target - - offline
0d cna target - - offline
Adapter port will Mode options are FC and FC supports target Pending changes
always show the FC CNA. Use CNA for 1GbE or types. require reboot to
label name, even in 10GbE mode for NAS, iSCSI, CNA supports target take effect.
1GbE or 10GbE and FCoE. type.
mode. Note: Port pairs must have
the same mode.
UTA2 transceivers
GbE SFP part number
X6567-R6: SFP optical 1GB shortwave multimode
X6568-R6: SFP copper 1GB RJ-45
NFS, CIFS, iSCSI supported; FCoE not supported
Not supported for cluster interconnects
Same ASIC set to Ethernet can have GbE and 10GbE SFP+ installed
GbE and 10GbE SFPs can be used on same ASIC
10GbE
X6589-R6: XCVR, SFP+, optical, 10GbE, shortwave
GbE and 10GbE SFPs can be used on same ASIC
16GB FC
X6596-R6: XCVR, SFP+, optical, 16Gb, FC, shortwave
Autoranges between 4Gb, 8Gb, and 16Gb
16Gb FC long-reach (LR) part number X65403

FAS2600 UTA2 port best practice update
You do not have to disable FCoE driver if not using the protocol
FCoE network chatter fixed in ONTAP 9
FAS2600 cluster interconnects
Switch CN1610 for most use cases with more than two nodes in cluster
Default cluster interconnects are 10GbE ports e0a and e0b
Can use UTA2 ports for cluster interconnects with 10GbE SFP+
Recommend e0e and e0f
29 2015 NetApp, Inc. All rights reserved. NetApp Proprietary Limited Use Only
Supported I/O cables on FAS2600
For the latest information about supported I/O cables on FAS2600,

refer to Hardware Universe
Using the onboard USB boot port
USB 2.0 port now enabled in ONTAP on FAS2600

USB port can be used to
Boot ONTAP if the onboard boot media has failed
To install a particular release of ONTAP or install a firmware service image.
The external USB port is only enabled during these activities, and
its activation is based on specific commands
Requires USB devices have FAT32 formatting
USB port use cases
Scenario Prerequisites Command
USB 2.0 device formatted to FAT32

with correct ONTAP netboot.tgz and boot_recovery using the netboot
Perform boot device recovery from loader image.tgz image image at the loader prompt
prompt Not hot pluggable, need to boot to Select appropriate ONTAP
loader prompt after USB device is image at the boot menu
inserted into external USB port
system node image update/get

USB 2.0 device formatted to FAT32 Command has an additional
Fetch ONTAP software for installation
with correct ONTAP image option to fetch ONTAP from USB
device
system node firmware download

USB 2.0 device formatted to FAT32 Command has an additional
Fetch service image for firmware update
with correct service image option to fetch ONTAP from USB
device
FAS2600 software and firmware levels
ONTAP 9.1 RC1

Service processor firmware level 5.0
BIOS level 11.0
Service processor
Enhances manageability and RASM
SP available through Ethernet or serial console

Shares management wrench port with e0M for Ethernet
Toggle from serial console into SP with Ctrl-G
Toggle back to serial console with Ctrl-D
Actively manages some hardware

Fans
FRU tracking
Advanced sensor management
SP used to create cores, no NMI button present

SP also used on all platforms since 2010
System-level diagnostics
SLDIAG
SLDIAG replaces SYSDIAG

Both perform system-level diagnostics
Major differences in SLDIAG are:

SLDIAG runs from maintenance mode
SYSDIAG booted with a separate binary
SLDIAG has a CLI interface
SYSDIAG used menu tables
SLDIAG also used on FAS2200 and FAS/V3200

And on new platforms going forward
Review the SLDIAG TOI if you do diagnostics
FAS2600 cooling architecture
PSU blowers provide cooling for power supplies, controllers, and disks
Air flows in through disks, then splits between power supplies and PCMs
Standalone controllers must have a blank installed in PCM bay to make sure of
proper cooling
Fan speed regulated by service processor

PCM processor subsystem forces higher fan speed if needed to provide
adequate cooling or if SP is offline
One failed fan allowed per chassis

Controller will run indefinitely with single failed fan
2-minute shutdown rule applies if second fan fails
Data ONTAP initiates the shutdown
FAS2600 power architecture
FAS2600 has two PSUs

One failed power supply (PSU) allowed per chassis
Controller will run indefinitely with single failed PSU per chassis
FAS2600 will work with one failed PSU
Fans or blowers must be operational
Blowers powered using backplane and will continue to run if PSU fails
Leave failed PSU in place until replacement arrives
FAS2600 will shut down if a PSU is removed for more than 2 minutes
Data ONTAP initiates the shutdown
FAS2600 environmental details
Power, thermals, weight, dimensions
For the latest and most complete environmental information across

various FAS2600 configurations, refer to:
Hardware Universe
(https://hwu.netapp.com)
FAS2600 dimensions and weight
Metric English
Height 2U
Height (measured) 8.5cm 3.3
Width 44.7cm 17.6 (fits 19 rack)
Chassis depth 48.3cm 19
With cable management 61.3cm 24.1
FAS2620 standalone is and HA is TBD
FAS2650 standalone is 55.56 pounds (25.2kg), and HA is 60.85 pounds (27.6kg)
FAS2600 acoustics
Declared sound power (LwAd) per ISO 9296: TBD Bel

FAS2620
Sound pressure (LpAm) (bystander positions): TBD dB
Declared sound power (LwAd) per ISO 9296: 6.9 Bel

FAS2650
Sound pressure (LpAm) (bystander positions): 51 dB
FAS2600 certification information1
Type Country Test Standards Notes
Safety US 60950-1
CAN CAN/CSA-22-2 NO.60950-1 Equivalent to UL 60950
EU EN 60950-1
Emission US FCC part 15, Subpart B, Class A FCC Class A minimum
CAN ICES-003
EU EN 55022, Class A Emission of ITE
CISPR22
EN 61000-3-2 AC Line Harmonic
EN 61000-3-3 AC Line Flicker
Immunity US N/A
CAN N/A
EU EN 55024 Immunity of ITE
EN 61000-4-2 ESD
EN 61000-4-3 RF
EN 61000-4-4 Fast Transient
EN 61000-4-5 Surge
EN 61000-4-6 Conducted
EN 61000-4-11 Line Dip/ Interrupt
1) Information about EMI certifications.
Thank you

FAS2600 SE Presentation - v1.1

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

FAS2600 SE Presentation - v1.1

Uploaded by

Copyright:

Available Formats

1) FAS2600 overview of architecture, positioning, and performance

4) Detailed I/O information

Two models: FAS2620 and FAS2650

Leverages new converged shelf architecture

Based on latest Intel Broadwell-DE six-core processor

Onboard NVMe M.2 Flash Cache

Next-Generation FAS Performance

Next-Generation FAS Performance

Next-Generation FAS Performance

Next-Generation FAS Performance

Physical memory 36GB 64GB 64GB 256GB 256GB 1024GB

NVMEM 4GB 8GB 16GB 32GB 64GB

Flash-based cache 16TiB 24TiB 16TiB 48TiB 144TiB

ONTAP ONTAP 8.2.2 + ONTAP

Minimum/maximum onboard flash

Maximum number of volumes 1,000

Maximum aggregate size 400TB

Maximum volume size 100TB

Minimum root volume size 350GB

Starting in ONTAP 9, SAS management is now in band over the

FAS2600 and other new controllers no longer have the locked

Micro USB RJ45

10GbE Cluster UTA2 Ports e0M

In the event of a dirty shutdown, the NVMEM battery keeps DIMM

Data stored in flash is encrypted for added security

Destaging: NVMEM battery keeps controller powered up during event:

Restaging: NVlog replayed from flash to recover writes if needed:

Denoted by terracotta (orange) cam lever or thumbscrew

UTA2 ASICs are dual port

Port pair must be set the same: FC or Ethernet

When set to FC, either port on ASIC can be target or initiator

16Gb FC long-reach (LR) part number X65403

Default cluster interconnects are 10GbE ports e0a and e0b

For the latest information about supported I/O cables on FAS2600,

USB 2.0 port now enabled in ONTAP on FAS2600

Scenario Prerequisites Command

USB 2.0 device formatted to FAT32

system node image update/get

system node firmware download

ONTAP 9.1 RC1

SP available through Ethernet or serial console

Actively manages some hardware

SP used to create cores, no NMI button present

SLDIAG replaces SYSDIAG

Major differences in SLDIAG are:

SLDIAG also used on FAS2200 and FAS/V3200

Review the SLDIAG TOI if you do diagnostics

Fan speed regulated by service processor

One failed fan allowed per chassis

FAS2600 has two PSUs

For the latest and most complete environmental information across

Height (measured) 8.5cm 3.3

Width 44.7cm 17.6 (fits 19 rack)

Chassis depth 48.3cm 19

With cable management 61.3cm 24.1

FAS2620 standalone is and HA is TBD

FAS2650 standalone is 55.56 pounds (25.2kg), and HA is 60.85 pounds (27.6kg)

Declared sound power (LwAd) per ISO 9296: TBD Bel

Declared sound power (LwAd) per ISO 9296: 6.9 Bel

You might also like