Professional Documents
Culture Documents
TCC2640
Hitachi Data Systems Corporation 2015. All rights reserved. HITACHI is a trademark or registered trademark of Hitachi, Ltd. Innovate With Information is a trademark or
registered trademark of Hitachi Data Systems Corporation. All other trademarks, service marks, and company names are properties of their respective owners.
ii
Contents
Introduction ................................................................................................................1
Welcome and Introductions ....................................................................................................................... 1
Course Description ................................................................................................................................... 2
Course Objectives .................................................................................................................................... 3
Course Topics .......................................................................................................................................... 4
Learning Paths ......................................................................................................................................... 5
Resources: Product Documents ................................................................................................................. 6
Collaborate and Share .............................................................................................................................. 7
Social Networking Academys Twitter Site ............................................................................................... 8
iii
Contents
Enterprise Components Names and Abbreviations ............................................................................. 1-13
VSP G1000 Overview .................................................................................................................. 1-13
VSP G1000 Logic Box (DKC-0) ..................................................................................................... 1-14
VSP G1000 Specifications ............................................................................................................ 1-14
VSP G1000 Memory .................................................................................................................... 1-15
Distributed Shared DKC-Resources............................................................................................... 1-15
Memory Structure on Cache Section............................................................................................. 1-16
Other Memory Locations ............................................................................................................. 1-17
Data Saved to BKM for Shutdown ................................................................................................ 1-17
VSP G1000 Back-End ........................................................................................................................... 1-18
Racks and DKUs ......................................................................................................................... 1-18
DKU Boxes ................................................................................................................................ 1-19
DB Types I ................................................................................................................................ 1-19
SAS Switches SSWs ................................................................................................................. 1-20
DKU Overview SBX ..................................................................................................................... 1-20
Outline of SSW for SBX/UBX ........................................................................................................ 1-21
Drive Box Remarks ..................................................................................................................... 1-21
Back-End Cabling for SBX/UBX .................................................................................................... 1-22
High Performance Back-End Cabling for SBX/UBX.......................................................................... 1-23
Conceptual and Specifications Comparisons ........................................................................................... 1-24
Concept Differences ................................................................................................................... 1-24
Comparison: VSP Midrange Family to VSP G1000 .......................................................................... 1-24
Comparison: VSP Midrange to HUS 100 Family.............................................................................. 1-25
SVOS Storage Virtualization Operating System ....................................................................................... 1-26
SVOS VSP Midrange Family ......................................................................................................... 1-26
SVOS VSP G1000 ....................................................................................................................... 1-27
Software Packaging for SVOS and Other Features ......................................................................... 1-28
SVOS Packaging for Open Systems .............................................................................................. 1-28
Module Summary ................................................................................................................................ 1-29
iv
Contents
Review: Modular Storage Architecture and Terms ........................................................................... 2-4
VSP Midrange and Enterprise Storage Architecture and Terms .......................................................... 2-4
Mainframe Storage Device Architecture: A Storage History Lesson .................................................... 2-5
Components of the LDEV ID .......................................................................................................... 2-5
What is an LDEV? ......................................................................................................................... 2-6
How to Use LDEV Types Basic and External .................................................................................... 2-7
How to Use LDEV Type DP ............................................................................................................ 2-8
How to Use LDEV Type Snapshot................................................................................................... 2-8
LDEV Uses by LDEV Type .............................................................................................................. 2-9
LDEV List View HUS VM Block Element Manager Example ............................................................. 2-9
LDEV List View From an HUS VM System ...................................................................................... 2-10
LDEV Ownership ................................................................................................................................. 2-11
LDEV Ownership in VSP Midrange and Enterprise .......................................................................... 2-11
LDEV Ownership on VSP G200 G800 ......................................................................................... 2-12
LDEV Virtualization .............................................................................................................................. 2-13
Types of Virtual LDEVs................................................................................................................ 2-13
Hitachi Dynamic Provisioning ....................................................................................................... 2-13
Dynamic Provisioning Pool Structure ............................................................................................ 2-14
LDEV Virtualization ..................................................................................................................... 2-15
Hitachi Dynamic Tiering .............................................................................................................. 2-16
Create Pool HUS VM Example ................................................................................................... 2-16
Volume Mapping ................................................................................................................................. 2-17
Host Group ................................................................................................................................ 2-17
LDEV Mapping ........................................................................................................................... 2-18
Volume Mapping Task Flow ...................................................................................................... 2-19
Volume Mapping Task Flow 1 ................................................................................................... 2-19
Volume Mapping Task Flow 2 ................................................................................................... 2-20
Volume Mapping Task Flow 3 ................................................................................................... 2-20
Volume Mapping Task Flow 3 continued .................................................................................... 2-21
Host Mode Options ..................................................................................................................... 2-21
Host Group HUS VM Example ................................................................................................... 2-22
Multipathing Support Hitachi Dynamic Link Manager ................................................................... 2-23
Module Summary ................................................................................................................................ 2-24
v
Contents
Software Tools for Configuring Storage .......................................................................................... 3-2
Web Console/SVP Application (VSP G1000)..................................................................................... 3-3
BEM/MPC/Maintenance Utility (VSP G200 - G800) ........................................................................... 3-4
Maintenance Interfaces ................................................................................................................. 3-5
Maintenance Access ..................................................................................................................... 3-6
Hitachi Storage Management Tools ......................................................................................................... 3-8
Management Interfaces ................................................................................................................ 3-8
Hitachi Storage Navigator/BEM ...................................................................................................... 3-9
Command Line Interface (CLI/RAIDCOM) ..................................................................................... 3-10
Hitachi Command Suite Overview ......................................................................................................... 3-11
Hitachi Command Suite v8.X ....................................................................................................... 3-11
Hitachi Command Suite - Unified Management .............................................................................. 3-13
Hitachi Device Manager (HDvM) .................................................................................................. 3-15
Hitachi Device Manager - Functionality ......................................................................................... 3-16
Hitachi Tiered Storage Manager (HTSM) ....................................................................................... 3-17
Hitachi Tiered Storage Manager Overview .................................................................................... 3-18
Benefits of Tiered Storage Manager ............................................................................................. 3-19
Hitachi Replication Manager (HRpM) ............................................................................................ 3-20
Centralized Replication Management ............................................................................................ 3-21
Hitachi Performance Monitoring and Reporting Products ................................................................ 3-22
Product Positioning ..................................................................................................................... 3-23
Hitachi Tuning Manager .............................................................................................................. 3-24
Hitachi Tuning Manager Overview ................................................................................................ 3-25
Hitachi Dynamic Link Manager (HDLM) Advanced ......................................................................... 3-27
Hitachi Command Director - Central HCS Reporting and Operations ................................................ 3-27
Hitachi Command Director .......................................................................................................... 3-28
Hitachi Command Director Overview ............................................................................................ 3-29
Hitachi Command Director (HCD)................................................................................................. 3-31
Hitachi Command Director - Addresses the Following Challenges .................................................... 3-32
Hitachi Compute Systems Manager (HCSM) .................................................................................. 3-33
Hitachi Infrastructure Director .............................................................................................................. 3-34
Hitachi Infrastructure Director (HID) ............................................................................................ 3-34
Hitachi Infrastructure Director ..................................................................................................... 3-35
Hitachi Infrastructure Director GUI and Command Interfaces ...................................................... 3-36
HCS and HID Coexistence ........................................................................................................... 3-37
HCS and HID Feature-Function Matrix .......................................................................................... 3-38
Hi-Track Remote Monitoring System ..................................................................................................... 3-39
vi
Contents
Hi-Track Overview ...................................................................................................................... 3-39
Hi-Track View Example ............................................................................................................... 3-40
Hi-Track Overview: Hi-Track Monitor Agent - Mobile App ............................................................... 3-41
Module Summary ................................................................................................................................ 3-42
vii
Contents
Tools Used For Setting Up Replication - more ................................................................................. 5-9
Requirements For All Replication Products .................................................................................... 5-10
Replication Status Flow ............................................................................................................... 5-11
Thin Provisioning Awareness..................................................................................................... 5-13
Hitachi ShadowImage Replication ................................................................................................ 5-14
Hitachi ShadowImage Replication Overview .................................................................................. 5-14
Hitachi ShadowImage Replication RAID-Protected Clones .............................................................. 5-15
Applications for ShadowImage In-System Replication .................................................................... 5-16
ShadowImage Replication Consistency Groups .............................................................................. 5-17
Internal ShadowImage Asynchronous Operation ........................................................................... 5-17
Pair Status Over Time ................................................................................................................. 5-18
Hitachi Thin Image .............................................................................................................................. 5-19
What is Hitachi Thin Image?........................................................................................................ 5-19
Hitachi Thin Image Technical Details ............................................................................................ 5-20
Hitachi Thin Image Components .................................................................................................. 5-21
Operations Flow Copy-on-Write Snapshot .................................................................................. 5-22
Operations Flow Copy-After-Write ............................................................................................. 5-23
Thin Image Copy-After-Write or Copy-on-Write Mode .................................................................... 5-24
Hitachi ShadowImage Replication Clones vs. Hitachi Thin Image Snapshots .................................... 5-25
Applications: Hitachi ShadowImage Clones vs. Hitachi Thin Image Snapshots .................................. 5-26
Hitachi TrueCopy Remote Replication .................................................................................................... 5-27
Hitachi TrueCopy Overview ......................................................................................................... 5-27
Basic Hitachi TrueCopy Replication Operation ............................................................................... 5-28
Hitachi TrueCopy Remote Replication (Synchronous) ..................................................................... 5-30
Hitachi Universal Replicator (Asynchronous)........................................................................................... 5-31
Hitachi Universal Replicator Overview ........................................................................................... 5-31
Hitachi Universal Replicator Benefits ............................................................................................ 5-31
Hitachi Universal Replicator Functions .......................................................................................... 5-32
Three-Data-Center Cascade Replication ........................................................................................ 5-32
Three-Data-Center Multi-Target Replication .................................................................................. 5-33
Four-Data-Center Multi-Target Replication .................................................................................... 5-33
Module Summary ................................................................................................................................ 5-34
Additional Training offerings from HDS .................................................................................................. 5-34
viii
Introduction
Welcome and Introductions
Student Introductions
Name
Position
Experience
Your expectations
Page 1
Introduction
Course Description
Course Description
Page 2
Introduction
Course Objectives
Course Objectives
Page 3
Introduction
Course Topics
Course Topics
Modules
5. Replication
Page 4
Introduction
Learning Paths
Learning Paths
Available on:
HDS.com (for customers)
Partner Xchange (for partners)
theLoop (for employees)
Customers
Partners
https://portal.hds.com/index.php?option=com_hdspartner&task=displayWebPage&menu
Name=PX_PT_PARTNER_EDUCATION&WT.ac=px_rm_ptedu
Employees
http://loop.hds.com/community/hds_academy
Please contact your local training administrator if you have any questions regarding
Learning Paths or visit your applicable website.
Page 5
Introduction
Resources: Product Documents
Resource Library
http://www.hds.com/corporate/resources/?WT.ac=us_inside_rm_reslib
Google Search
Document name
Any key words about the product you are looking for
o If the key words are covered in the product documents, Google will find it the
resource
For example, if you search Google for System Modes Options for VSP
G1000, it is covered in the user guide so the document will come up on
Google
Page 6
Introduction
Collaborate and Share
https://community.hds.com/welcome
http://loop.hds.com/community/hds_academy?view=overview
Page 7
Introduction
Social Networking Academys Twitter Site
Twitter site
Site URL: http://www.twitter.com/HDSAcademy
http://www.twitter.com/HDSAcademy
Page 8
1. HDS Storage Architecture
Module Objectives
Page 1-1
HDS Storage Architecture
Module Topics
Module Topics
Page 1-2
HDS Storage Architecture
Overview
Overview
4100
4080
Performance
4060
Functionality/Scalability
Page 1-3
HDS Storage Architecture
VSP Midrange Family Architecture
Blades
CHB - Channel Blade
DKB - Disk Blade
Memory (M)
CM - Cache Memory
LM - Local Memory
PM - Package Memory
SM - Shared Memory (control memory)
CFM - Cache Flash Memory (SSD for CM/SM-Backup)
Trays
CB - Controller Box
DB - Drive Box
HDU - Hard Disk Unit (DB logical name)
ENC - Enclosure Controller
Product Parts
Height Remark
Name Name
VSP G200 HM800S 2U ---------
Upgradable to VSP G600 by expanding drives,
VSP G400 HM800M2 4U
cache, performance scalability
VSP G600 HM800M3 4U ---------
VSP G800 HM800H 4U ---------
Page 1-4
HDS Storage Architecture
Foundation for VSP Midrange Family
Block Model
SSD SFF
Fibre Channel 12 x LFF
8/16 Gb/s
NL-SAS LFF
SAS 6/12 Gb/s
iSCSI (SFP)
10Gb/s
60 x SFF/LFF SSD SFF*
iSCSI (10Base-T)
1/10 Gb/s SAS SFF*
2U DBF
12 x FMD
FMD
Page 1-5
HDS Storage Architecture
VSP G400, G600, G800 DKC (CTL1 and CTL2)
CFM
Fan
VSP G400, VSP G600,
VSP G800
865mm Battery Height 4U
2 CPU/CTL
CPU
8 DIMM sockets/CTL
DIMM
CPU
8 Slots for FE/BE/CTL
DIMM 2 LAN ports/CTL
Public port
CTL
Maintenance port
175mm CFM for backup
NiMH batteries for backup
12V power supplies units
446.3mm
Logicbox
CTL2
Drive Box (DB0)
VSP G200
CTL1
Height 2U
1 CPU/CTL
2 DIMM sockets/CTL
2 Slots for FE/CTL
CPU 1 embedded BE port/CTL
CPU 2 LAN ports/CTL
Battery
Public port
Fan Maintenance port
CFM for backup
NiMH batteries for backup
12V Power supplies units
PSU
12 HDD slots 3.5 (CBSL)
24 HDD slots 2.5 (CBSL)
Logicbox
Page 1-6
HDS Storage Architecture
VSP Midrange Family Physical Specifications
*Diskless configuration
Page 1-7
HDS Storage Architecture
DIMM Configurations
DIMM Configurations
1 VSP G800 8GB, 16GB, 32GB 8 slot/CTL (CMG0, CMG1) 4 DIMM 256 GB
2 VSP G600 8GB, 16GB 8 slot/CTL (CMG0, CMG1) 4 DIMM 128 GB
3 VSP G400 4 slot/CTL (CMG0) 4 DIMM 64 GB
4 VSP G200 8GB, 16GB 2 slot/CTL (CMG0) 2 DIMM 32 GB
Memory Content
LM LM Local Memory
PM RAM for cores
PM Package Memory
DXBF
RAM for MPU (ownership
Mirrored
SM
information, bitmaps)
DXBF Data Transfer Buffer
Buffers I/Os for transfer
SM Shared Memory
DIMMs
Config
R1 WP 1 Control Units
CM DMT (HDP/HDT)
Bitmaps
WP 1 R2 Queues
Cache Directory
Size depends on features
CM Cache Memory
Write pendings (duplicated)
Reads (no copy)
CTL1 CTL2
Page 1-8
HDS Storage Architecture
Data Protection
Data Protection
Page 1-9
HDS Storage Architecture
VSP Midrange Family Back-End
DB Types I
DB Types II
Rear
Front
Slide the DB60 drive box forward out of
the rack to provide access to the
installed HDDs
Page 1-10
HDS Storage Architecture
Drive Box Remarks
Therefore these drive boxes are only suitable for VSP midrange
family
Page 1-11
HDS Storage Architecture
Back-End Example for VSP G400 / VSP G600
CTL1 CTL2
Page 1-12
HDS Storage Architecture
VSP G1000 Architecture
1 or 2 DKC
Max. 6 racks
Max. 16 x 8-core intel CPU
Max. 2 TB RAM
Max. 32 x 6 Gb SAS
LFF/SFF Drive
Chassis
LFF/SFF Drive
Chassis
LFF/SFF Drive
Chassis
LFF/SFF Drive
Chassis
LFF/SFF Drive
Chassis
LFF/SFF Drive
Chassis back-end
8/16Gb Fibre Channel
front-end
8Gb FICON front-end
10Gb FCoE front-end
Flash Module
Drive Chassis
Flash Module
Drive Chassis
FMD, SSD, SAS, NL-SAS
drives (max. 2048)
LFF/SFF Drive LFF/SFF Drive LFF/SFF Drive LFF/SFF Drive
Chassis Chassis Chassis Chassis
Page 1-13
HDS Storage Architecture
VSP G1000 Logic Box (DKC-0)
BKM PSU
Front Rear
CM
SVP
MPB
CHA
CHB CHB
MPB DKB
CTL2 CTL1 CTL1 CTL2
Page 1-14
HDS Storage Architecture
VSP G1000 Memory
CL1 CL2
MPB
All MPBs share whole RAM of R800 system (CL1 and CL2)
All CHAs/DKAs are connected to the same internal PCIe-network
Page 1-15
HDS Storage Architecture
Memory Structure on Cache Section
Cache directory:
Contains cache directory Information for CM
section on same board and GRPP of PK
Size of Cache DIR/PK depends on the number
of installed CMGs
Example:
128GB CACHE per PK with 32GB installed (4 DIMMS, 1 DIMM for each CMG)
Page 1-16
HDS Storage Architecture
Other Memory Locations
LM Local Memory
Located in DIMMs on MPB (2x8 GB total capacity)
RAM for cores and housekeeping
PM Package Memory
Located in DIMMs on MPB
1GB per MPB
Hierarchical memory (bitmaps for replication)
Page 1-17
HDS Storage Architecture
VSP G1000 Back-End
600
DKUBOX DKUBOX
-13 -03 605
DKUBOX DKUBOX
-12 -02
DKUBOX DKUBOX
-11 -01 2006
DKU-Box Types
DKUBOX DKUBOX
-10 -00
SBX 192 x 2.5 SFF HDD
UBX 96 x 3.5 LFF HDD
DKC 1 DKC 0 FBX 48 x FMD
Page 1-18
HDS Storage Architecture
DKU Boxes
DKU Boxes
8 Trays
SBX 8HDU
16U
(Small Box) 192 SFF
Height:16U
8 Trays
UBX
16U 8 HDU
(Universal
96 LFF
Box)
Height:16U
10U
4 Trays
FBX 8 HDU
(Flash Box) 48 FMD
Height: 8U
DB Types I
Page 1-19
HDS Storage Architecture
SAS Switches SSWs
DKU-xy x : DKC No (0 or 1)
HDU-xy3 y : DKU No (0 5)
S
HDU-xy2 P
2
HDU-xy1
7D+1P 14D+2P
3D+1P 2D+2P (starts at
(6D+2P)
S
HDU-xy0 P even slot)
1
0 23
Front View
Page 1-20
HDS Storage Architecture
Outline of SSW for SBX/UBX
D E F G
C LED (Red) Shutdown LED (ALARM) Indicates that replacement is possible while the device is blocked
D LED (Green) SSW Path (IN) Indicates that the IN side links up
SSW Path (OUT0) Indicates that the OUT0 side links up
E LED (Green)
F LED (Green) SSW Path (OUT1) Indicates that the OUT1 side links up
G DIP SW DIP Switch Set the SAS Address of SSW (next Page)
Enclosure chassis are the same as in the HUS 100 family, HUS
VM and the VSP midrange family
Therefore, these DBs are only suitable for VSP midrange family
Page 1-21
HDS Storage Architecture
Back-End Cabling for SBX/UBX
HDU002 HDU052
HDU003 HDU053
HDU004 HDU054
HDU005 HDU055
HDU006 HDU056
HDU007 HDU057
From OUT0 TO IN
DKU-00 DKU-01..04 DKU-05
Notes:
New Cabling structure guarantees higher reliability in comparison to HUS and HUS VM.
For example, a powerless HDU causes the maximum loss of 1 HDD (14D+2P:2) per RAID group
in the daisy chain. Therefore, all RAID groups will sustain this situation.
Page 1-22
HDS Storage Architecture
High Performance Back-End Cabling for SBX/UBX
For a high performance configuration, remove the cables between OUT0- and IN-ports and
connect ports of the 2nd DKA-feature to the clear IN-ports during installation process.
Page 1-23
HDS Storage Architecture
Conceptual and Specifications Comparisons
Concept Differences
Maximum numbers
*Diskless configuration
Page 1-24
HDS Storage Architecture
Comparison: VSP Midrange to HUS 100 Family
CPU-Cores/System 32 4
RAM/System 512GB 32GB
Fibre Channel ports/System 48/64* 16
FICON ports/System ----- -----
iSCSI ports 24/32* 8
FCoE ports ----- -----
Back-end links/System 64 32
BE bandwidth 12 Gb/sec 6 Gb/sec
DBS (24 x 2.5 drives) 48 40
DBL (12 x 3.5 drives) 48 80
FBX (48 x 3.5 drives) ----- 20
DB60 (60 x 3.5) 24 -----
Drives/System 1440 960
Volumes/System 16K 4K
*Diskless configuration
Page 1-25
HDS Storage Architecture
SVOS Storage Virtualization Operating System
Page 1-26
HDS Storage Architecture
SVOS VSP G1000
Base capacity is the initially purchased amount; capacity upgrades for later extension
Page 1-27
HDS Storage Architecture
Software Packaging for SVOS and Other Features
Nondisruptive Global-Active
Migration Device Bundle
Page 1-28
HDS Storage Architecture
Module Summary
Module Summary
Page 1-29
HDS Storage Architecture
Module Summary
Page 1-30
2. Disks, Volumes and Provisioning
Module Objectives
Page 2-1
Disks, Volumes and Provisioning
Supported RAID Structures and Sparing Behavior
Spare Drives
To ensure continued operation of the storage system in the case of a failed disk
drive, the system must be configured with available spares
When usable spare HDDs are available, the system will take the necessary
actions to move (copy) or rebuild the data from the failed/failing drive to the
spare
Page 2-2
Disks, Volumes and Provisioning
Sparing Behaviors
Sparing Behaviors
In both cases, full redundancy will be maintained after a disk error threshhold or
failure
Page 2-3
Disks, Volumes and Provisioning
Logical Devices and Addressing
Page 2-4
Disks, Volumes and Provisioning
Mainframe Storage Device Architecture: A Storage History Lesson
01
FE
FF
Physical device
Physical device
Page 2-5
Disks, Volumes and Provisioning
What is an LDEV?
What is an LDEV?
Is assigned ownership to an MPU (microprocessor unit) for all of its I/O processing
Page 2-6
Disks, Volumes and Provisioning
How to Use LDEV Types Basic and External
Each LDEV
Page 2-7
Disks, Volumes and Provisioning
How to Use LDEV Type DP
Thin Image LDEV types can only be used as the target (S-VOL) in a
Thin Image replication pair
Page 2-8
Disks, Volumes and Provisioning
LDEV Uses by LDEV Type
BEM Block
Element Manager
Called Hitachi
Device Manager
in newer systems
Page 2-9
Disks, Volumes and Provisioning
LDEV List View From an HUS VM System
Page 2-10
Disks, Volumes and Provisioning
LDEV Ownership
LDEV Ownership
This section provides an overview about enterprise system internals.
Page 2-11
Disks, Volumes and Provisioning
LDEV Ownership on VSP G200 G800
CTL1 CTL2
MPU MPU MPU MPU 8Core/CPU x 4
8Core/MPU
Page 2-12
Disks, Volumes and Provisioning
LDEV Virtualization
LDEV Virtualization
This section provides an overview about enterprise system internals.
DP LDEV types are defined against the available capacity from the DP pool
A DP volume is a set of pointers
DP volumes have an LDEV ID and are mapped as LUNs to the storage consumers,
hosts and servers
Physical storage capacity from the pool is only consumed when data is written to the
DP volume
The host thinks it has the full allocated LDEV capacity available but the storage
system conserves physical capacity
Page 2-13
Disks, Volumes and Provisioning
Dynamic Provisioning Pool Structure
Enterprise Array
Multiple RAID groups
with their basic LDEVs
provide the pool with its
physical space LDEV (HDP-Volume)
Leading practice is to
use RAID-6 parity
groups for the pool
volumes
Page 2-14
Disks, Volumes and Provisioning
LDEV Virtualization
LDEV Virtualization
Enterprise Array
Disk space on pool
volumes is organized in
pages of 42MB
LDEV (HDP-Volume)
Data written to the
HDPVolume gets evenly
distributed to the pages on
all pool volumes
DMT constantly keeps
The owning MPU keeps
track of changes
track in a list, dynamic
mapping table (DMT),
which saves data from the
server in which page on
which volume in the pool
Enterprise Array
In the case of dynamic
provisioning, the pool High Performance Middle Performance
consists of similar
resources (same disk Tier1 Tier2
rpm, type, size and
RAID level)
If different classes
should be implemented,
another pool has to be
created and
HDPVolumes must be
mapped to the servers
SSD SAS 10krpm
accordingly
Page 2-15
Disks, Volumes and Provisioning
Hitachi Dynamic Tiering
Enterprise Array
Introduced with VSP,
dynamic tiering Multi-Tier Pool
implements different
disk performance LDEV (DP Volume in an HDT Pool)
classes in one pool
Page 2-16
Disks, Volumes and Provisioning
Volume Mapping
Volume Mapping
This section provides an overview about enterprise system internals.
VSP enterprise family supports Fibre Channel (FC) Fibre Channel over
Ethernet (FCoE) and Mainframe protocols
Each of these three options require the corresponding type of channel host
(frontend) board (CHB)
Host Group
Host groups are defined within a storage array front-end CHA port
Multiple hosts in the same host group must be the same type
Operating system
Must share the same Host Mode Settings
One CHA port can support multiple host groups of different OS and Host
Mode settings
Page 2-17
Disks, Volumes and Provisioning
LDEV Mapping
LDEV Mapping
or VMware datastores
HCS or HID cause the Host
Group to be created
The storage administrator
can create the Host Group
using the BEM LDEVs (Basic/DP/DT)
Port security means the port can distinguish whether incoming traffic is from Server A or
Server B and forward it to the proper host group, also called a virtual port.
Page 2-18
Disks, Volumes and Provisioning
Volume Mapping Task Flow
5. Add server HBA World Wide Port Name (WWPN) to host group
Logical
Devices
Page 2-19
Disks, Volumes and Provisioning
Volume Mapping Task Flow 2
Port
Topology
Create Host
Group
Page 2-20
Disks, Volumes and Provisioning
Volume Mapping Task Flow 3 continued
1. Create Host
Group
2. Name it
3. Choose Host
Mode
4. Choose host
(WWPN) to add or
create new one
5. Choose port
where to add
group
6. Repeat for
additional groups
on other ports
Page 2-21
Disks, Volumes and Provisioning
Host Group HUS VM Example
Page 2-22
Disks, Volumes and Provisioning
Multipathing Support Hitachi Dynamic Link Manager
To get this fixed, software has to be installed on the host to create 1 emulated disk out
of the 2 physical ones.
The HDS product that fixes this is called Hitachi Dynamic Link Manager (HDLM); many
OS vendors include their own software.
Multipathing asks both disks for their ID, which consists of the Storage Arrays Type,
SerialNo and LDEV ID.
This ID is unique worldwide, and the multipathing sfotware shows 1 emulated disk to
the OS and manages the traffic to the array over the multiple paths.
Page 2-23
Disks, Volumes and Provisioning
Module Summary
Module Summary
Page 2-24
3. Storage Management Tools
Module Objectives
Page 3-1
Storage Management Tools
Hitachi Storage Maintenance Tools
Web Console/SVP
for VSP G1000
Storage Administators
Maintenance Engineers
VSP midrange
MPC = maintenance PC
Page 3-2
Storage Management Tools
Web Console/SVP Application (VSP G1000)
Web Console/SVP Application for VSP, VSP G1000 and HUS VM for Hardware Maintenance
The SVP application is used by the engineers for hardware and software maintenance. The
application is launched by accessing the Web console application.
Page 3-3
Storage Management Tools
BEM/MPC/Maintenance Utility (VSP G200 - G800)
Block Element Manager, Maintenance PC and Maintenance Utility for VSP G200
G800 for Hardware Maintenance
On the new arrays VSP G200 G800 maintenance happens mainly on the Maintenance Utility,
accessible from customer engineers working environment and from user management GUIs
(Hitachi Command Suite and Hitachi Infrastructure Director).
Page 3-4
Storage Management Tools
Maintenance Interfaces
Maintenance Interfaces
Page 3-5
Storage Management Tools
Maintenance Access
Maintenance Access
Management
End-user Server
Management LAN
SVP
SVP SVP
Web Console
running on
MPC/SVP
The customer engineer (CE) connects the laptop to the SVPs console interface or management
LAN and connects to the SVP with remote desktop session.
Installation, configuration and maintenance happen only here with the Web console (software
adjustments like licenses or software configuration settings) and SVP program (hardware
maintenance).
The CE connects the maintenance PC (MPC) to the maintenance LAN port of the VSP G200
G800 controller.
Hardware maintenance happens in the Maintenance Utility. Sophisticated settings like System
Option Modes (SOM) or Online Read Margin (ORM) happen in MPC software running exclusively
on MPC.
Software adjustments or configuration settings are done in Block Element Manager (BEM).
Page 3-6
Storage Management Tools
Maintenance Access
User maintenance
The user works in HCS or HID. From there is the possibility to invoke the Maintenance Utility to
do maintenance.
It allows the customer engineer, who has either no access to HCS/HID, or HCS/HID is not yet
installed, to do administration tasks like configure and provision volumes or adjust port settings.
The Web console, BEM or Storage Navigator is not visible to the end user; HCS/HID must be
used.
Page 3-7
Storage Management Tools
Hitachi Storage Management Tools
Management Interfaces
Page 3-8
Storage Management Tools
Hitachi Storage Navigator/BEM
Hitachi Storage Navigator on VSP G1000 and Block Element Manager on VSP G200 G800 look
nearly identical.
Certain tasks are possible only on individual platforms like RAID Group creation, but just on VSP
G200 G800.
Page 3-9
Storage Management Tools
Command Line Interface (CLI/RAIDCOM)
In band (FC)
Out of band
(TCP/IP)
The CLI supports all storage provisioning and configuration operations that can be
performed through Storage Navigator.
The example on this page shows the raidcom command that retrieves the configuration
information about an LDEV.
For in-band CCI operations, the command device is used. The command device is a
user-selected and dedicated logical volume on the storage system that functions as the
interface to the storage system for the UNIX/PC host.
o The dedicated logical volume is called command device and accepts commands
that are executed by the storage system.
o The virtual command device is defined by specifying the IP address for the SVP.
o CCI commands are issued from the host and transferred through the LAN to the
virtual command device (SVP). The requested operations are then performed by
the storage system.
Page 3-10
Storage Management Tools
Hitachi Command Suite Overview
Multi-array management, all block models, all other hardware (Hitachi NAS Platform, Hitachi
Content Platform, Hitachi Compute Blade)
The customer should use the Hitachi Device Manager component of the Hitachi Command Suite
v8.0 storage management software products to view and administer the storage system, as well
as any other HDS storage system. Legacy Storage Navigator will be in-context launch pop-out.
Page 3-11
Storage Management Tools
Hitachi Command Suite v8.X
VSP G200-G800
VSP G200-G800
From Command Suite there are additional applications accessible all of them require
HCS/HDvM as a foundation:
Hitachi Tiered Storage Manager for mobility, moving host volumes to different hardware
resources and definition of storage classes
Hitachi Replication Manager to manage every kind of replication, in-system and remote;
complete setup, management and deletion
Page 3-12
Storage Management Tools
Hitachi Command Suite - Unified Management
Hitachi Command Suite (HCS) is designed to deliver a comprehensive unified way of managing
IT resources. It employs a 3D management approach to efficiently manage all data types to
lower costs for the Agile Data Center with the following 3 management dimensions:
o Manage Out with a unified management framework that has the breadth to
manage storage, servers and the IT infrastructure, incorporating both virtualized
storage and servers
o Manage Deep with Hitachi Command Suite integration for the highest levels of
operational efficiency that includes common management of multivendor storage
assets
Page 3-13
Storage Management Tools
Hitachi Command Suite - Unified Management
Page 3-14
Storage Management Tools
Hitachi Device Manager (HDvM)
External Virtualized
Volume
External Virtualized
Volume
External Virtualized
Volume
Hitachi Device Manager forms the base of the Hitachi Command Suite while being presented in
the GUI as Hitachi Command Suite. Device Manager provides common storage management
and administration for multiple Hitachi storage systems from which the advanced management
capabilities are built upon.
Using the single unified GUI, customers can manage all of their HDS storage products. Users
can use Device Manager to centrally manage, configure, provision, allocate and report on
storage for Hitachi platforms, including virtualized tiered storage for both virtual and physical
environments. HCS uses consumer-based management. In other words, resources are grouped
by business application and host, so it is tailored to a customers specific environment. Not only
does it manage block-level data, it also manages the file-level data as well.
Hitachi Device Manager provides a single platform for centrally managing, configuring, and
monitoring Hitachi storage systems. By significantly boosting the volume of storage that each
administrator can manage, the single-point-of-control design of Device Manager can help raise
storage management efficiency in these environments, as well as reduce costs. Easy-to-use
Device Manager logically views storage resources, while maintaining independent physical
management capabilities. By offering a continuously available view of actual storage usage and
configuration, Device Manager allows administrators to precisely control all managed storage
systems. This results in a highly efficient use of administrative time and storage assets. When
combined with other Hitachi Command Suite products, Device Manager helps automate entire
storage environments.
Page 3-15
Storage Management Tools
Hitachi Device Manager - Functionality
Storage operations
Allocating volumes (Add LUN mapping)
Unallocating volumes (Delete LUN path)
Creating volumes (Create LDEV)
Virtualizing storage systems (virtualize volumes)
Virtualizing storage capacity (HDP pools)
User management
Security settings
Page 3-16
Storage Management Tools
Hitachi Tiered Storage Manager (HTSM)
Data Mobility
Storage
Tiers
Virtualized Arrays
Another product of the Hitachi Command Suite framework is Hitachi Tiered Storage Manager.
Hitachi Tiered Storage Manager offers integrated data mobility capabilities for efficient
storage tier management and nondisruptive volume migration between storage tiers.
Combined with Hitachi Dynamic Tiering and Hitachi Dynamic Provisioning, these
products comprise the Hitachi Data Mobility product offering.
Page 3-17
Storage Management Tools
Hitachi Tiered Storage Manager Overview
Manages data mobility across the data center, not just volumes or
pages within a storage ecosystem (when all arrays are virtualized
behind one central array)
Data mobility is the critical key enabling factor in getting data when and where it is
needed.
HTSM (HCS Data Mobility) provides customers with the unique ability to move data non-
disruptively across pools, volumes and storage arrays.
HTSM and Hitachi Dynamic Tiering (HDT) together provide an efficient solution for
optimizing macro and micro optimization of data in and across storage pools and
volumes.
With all the data mobility features, HTSM is an essential component in managing and
optimizing todays green data centers.
Page 3-18
Storage Management Tools
Benefits of Tiered Storage Manager
Replaces storage system and storage semantics with higher-level application data
quality of service (QoS) metrics and customer-definable storage tiers (custom tiers)
By transparently and interactively migrating data between heterogeneous, custom storage tiers,
Hitachi Tiered Storage Manager enables IT administrators to match application quality of service
requirements to storage system attributes.
Page 3-19
Storage Management Tools
Hitachi Replication Manager (HRpM)
Universal
Replicate Backup
Archive Snap
Data Protection
Software and
Management
Hitachi TrueCopy
Hitachi Universal Replicator
Next we have Hitachi Replication Manager, also part of Command Suite. This product
centralizes and simplifies replication management by integrating replication capabilities to
configure, monitor and manage Hitachi replication products for in-system or distance replication
across both open systems and mainframe environments.
The synchronous and asynchronous long-distance replication products, as well as the in-
system replication products, were discussed earlier in this course. How do customers
manage all of these copy and replication operations? Replication Manager gives
customers a unified and centralized management GUI to help them manage all of these
operations.
This solution builds on existing Hitachi technology by leveraging the powerful replication
capabilities of the arrays and by combining robust reporting, mirroring and features
previously available in separate offerings. It decreases management complexity while
increasing staff productivity and providing greater control than previously available
solutions through a single, consistent user interface.
Page 3-20
Storage Management Tools
Centralized Replication Management
Business
Copy-On-Write
Universal
Thin Image ShadowImage TrueCopy Continuity
Replicator
Manager
Primary Secondary
Provisioning Provisioning
CCI HORCM
For customers who leverage in-system or distance replication capabilities of their storage arrays,
Hitachi Replication Manager is the software tool that configures, monitors and manages Hitachi
storage array-based replication products for both open systems and mainframe environments in
a way that simplifies and optimizes the:
Configuration
Operations
Page 3-21
Storage Management Tools
Hitachi Performance Monitoring and Reporting Products
Parity Group
MP/MPU
FC/SCSI Port
Cache
Disk
App HBA/Host Switch Storage System
This is a visualization of how these products work, and what they cover.
o It provides the ability to monitor the round trip response time for troubleshooting
and proactive service level error condition alerting results in improved application
performance. On the Hitachi Enterprise Storage products, this ability includes
and extends to round trip response to/from external storage.
Page 3-22
Storage Management Tools
Product Positioning
Product Positioning
Name Description
Hitachi Tuning Manager Advanced reporting, analysis and troubleshooting application for
Hitachi Data Systems storage systems and services
Application-to-spindle visibility and correlation in near-time and
historical
Full storage path awareness and deep knowledge of Hitachi Data
Systems storage systems
Its strength is its ability to view performance from the application through the network
and within the storage system.
It provides basic reporting and monitoring within a storage system, but only within the
storage system. It has no knowledge of applications.
Page 3-23
Storage Management Tools
Hitachi Tuning Manager
Alerts
Hitachi Tuning Manager, another piece of the Command Suite framework, performs
integrated storage performance management for monitoring, reporting and analyzing
end-to-end storage performance and capacity for business applications, in addition to
detailed component performance metrics for Hitachi storage systems. It is a SAN-aware
product in that it monitors and provides performance metrics for servers, applications,
switches and Hitachi storage. This software correlates and analyzes storage resources
with servers and applications to improve overall system performance. It continuously
monitors comprehensive storage performance metrics to reduce delay or downtime
caused by performance issues. It facilitates root cause analysis to enable administrators
to efficiently identify and isolate performance bottlenecks. It allows users to configure
alerts for early notification when performance or capacity thresholds have been
exceeded. In addition, it provides the necessary performance information for customers
to do trending analysis, and forecasts future storage capacity and performance
requirements to minimize unnecessary infrastructure purchases.
What am I going to need to buy? What type of drives? How much capacity am I going
to need? These are the sort of questions that Tuning Manager can help to answer.
This software also provides customizable storage performance reports and alerts for
different audiences and reporting needs.
Page 3-24
Storage Management Tools
Hitachi Tuning Manager Overview
HTnM provides:
o Reporting of Hitachi Dynamic Tiering and Hitachi Dynamic Provisioning pools for
usage analysis and optimization
o Customizable storage performance reports and alerts for different audiences and
reporting needs
Page 3-25
Storage Management Tools
Hitachi Tuning Manager Overview
Page 3-26
Storage Management Tools
Hitachi Dynamic Link Manager (HDLM) Advanced
VMware Solaris
Windows Linux UNIX UNIX
ESXi Windows
HAM pair
PVol SVol
AMS
Alerts view enables quick path
USP V/VM USP V/VM VSP/VSP G1000 HUS 100 HUS VM
VSP VSP failure detection and actions
Command Director introduces a new common data reporting model across Hitachi Command
Suite. Using a common data reporting model, Command Director consolidates management
statistics from Device Manager (Hitachi Base Operating System), Tuning Manager and Tiered
Storage Manager for centralized storage management operations.
Page 3-27
Storage Management Tools
Hitachi Command Director
Page 3-28
Storage Management Tools
Hitachi Command Director Overview
o Organize and view storage assets based on business applications and functions
Easily align Hitachi storage assets with the business applications that rely
on them
o Global dashboard for storage system health and application performance tracking
Page 3-29
Storage Management Tools
Hitachi Command Director Overview
o Properly analyzes key statistics aggregated from multiple Hitachi Command Suite
products
By leveraging data from Hitachi Device Manager, Hitachi Tuning Manager, and Hitachi
Tiered Storage Manager, Command Director provides the following business use cases:
o Correlate host and storage side capacity utilization trends for capacity planning
Page 3-30
Storage Management Tools
Hitachi Command Director (HCD)
One of the big challenges in any environment is to get a business intelligence view of the
storage environment to ensure that storage service level objectives (SLOs) for mission-critical
business applications are being met. IT organizations spend a considerable amount of time and
effort developing tracking processes to correlate and analyze storage resources back to the
respective business applications that rely on them. Without accurate and detailed storage
reporting, there are no assurances that application service levels are being met, and
effectiveness of storage management practices is limited.
Command Director consolidates business intelligence analysis for Hitachi Command Suite by
monitoring and ensuring storage service levels for business applications and storage system
health across a data center. Command Director facilitates customized dashboards for real-time
monitoring of key storage performance and capacity indicators by business application, such as
response times, IOPS (or input and output per second), data transfer rates, cache reads, writes
pending and utilized capacity. By verifying application-specific storage SLOs are being met,
administrators can implement policies to enable the rapid modification of the storage
environment for changing business requirements.
For their key applications, customers want to be able to monitor the Service Level Agreements
(SLAs) that they promised their consumers. If applications are meeting their SLAs, then that is
fine. If not, they need to know that through alerts, so they can begin their analysis of the
causes. Command Director allows them to set up a dashboard that is fine-tuned for their
environment, where they can get information on the state of their applications. By having this
ability they can be more proactive versus waiting for users to complain about performance.
Page 3-31
Storage Management Tools
Hitachi Command Director - Addresses the Following Challenges
Global Dashboard
Storage Status Summary Application Service Level
Quickly check storage status for my data
Management
center and monitor any service level Assign service level objectives for my
violations applications and investigate any service
Review global dashboard or overall storage level violations
utilization summary report Define service level objectives per
Near real time application status and application
service level monitoring Business Views Enforce application service levels and
Global reporting of defined thresholds and storage tier policies
Create
C Business Operations
Business Applications Busin
a G F Biz. Biz. App B
ess
p e u A Applic
t o n p ations
u p
G G
Ug
Sc eogr eography (UK) and
r t
S ar assign
e C i aph A F
A C la y unction pre-
r o
r Up
e (US (Marketing, defined
e n
K e sh A) Sales) Busin
B a
a Jy
M F ess
u t
Business Ops.
B a t a B B B Operat
s e unct
Grouping
when they have been exceeded
p e y r y y ions y
ion
Business Views
m r K
y n
n z n z
A
a p o z A
U . U M .
p
t i u . B p
KF TK aO p
i n p i
p
u A h rn A
o g i A z B
S n B e kl p
p p .
A A
Capacity Management
n c a p n n i ey ip
g p z
t l z t
A .B
B i e A M G . i
A p
os i ae n
p p
n z ro A g
M . U p p
k B
a p
e K
r A B
B t
k p B B
i
e ip i
n
t z z
g
i .B .
n
g A
B B
Page 3-32
Storage Management Tools
Hitachi Compute Systems Manager (HCSM)
Hitachi Compute Systems Manager (HCSM) is a systems management tool which allows
seamless integration into Hitachi Command Suite to provide a single management view
of servers and storage.
Page 3-33
Storage Management Tools
Hitachi Infrastructure Director
Multi-array management, all new midrange block models (VSP G200 G800)
Page 3-34
Storage Management Tools
Hitachi Infrastructure Director
Reduces Complexity
Smart/Intelligent-based
management
Object driven design
Abstract complexities
Auto build array groups
Suggested pool configs
Auto-zoning
Smart provisioning based on
application templates
Page 3-35
Storage Management Tools
Hitachi Infrastructure Director GUI and Command Interfaces
User Access to HID with GUI, CLI and REST-API for further automation and retrieval of
performance data
Page 3-36
Storage Management Tools
HCS and HID Coexistence
Both HID and Hitachi Command Suite (HCS) can be used for
management of Hitachis next-generation midrange storage platform
Page 3-37
Storage Management Tools
HCS and HID Feature-Function Matrix
Page 3-38
Storage Management Tools
Hi-Track Remote Monitoring System
Hi-Track Overview
Transport to the Hi-Track center can be through either HTTPS or FTP (SSL or
standard) through the public Internet or through dialup modem
Hi-Track can send email alerts to customers (user definable destinations) and
offers remote access to SVP for HDS support
The Hi-Track Monitor agent monitors the operation of the storage at all times, collects
hardware status and error data and transmits this data through a modem to the Hitachi
Data Systems Support Center
o The Support Center analyzes the data and implements corrective action as
needed
o In the unlikely event of a component failure, Hi-Track Monitor service calls the
Hitachi Data Systems Support Center immediately to report the failure, without
requiring any action on the part of the user
o Hi-Track tool enables most problems to be identified and fixed prior to the actual
failure
Page 3-39
Storage Management Tools
Hi-Track View Example
Hi-Track Monitor agent enables error analysis, case creation and error/information data
browsing functions
o When Hi-Track Monitor agent is installed and the storage system is configured to
allow it, Hitachi support staff can remotely connect to the storage system
o This feature provides a remote SVP mode for the large RAID systems that
enables the specialist to operate the SVP as if they were at the site
Note: Hi-Track Monitor agent does not have access to any user data stored on the storage
Page 3-40
Storage Management Tools
Hi-Track Overview: Hi-Track Monitor Agent - Mobile App
Page 3-41
Storage Management Tools
Module Summary
Module Summary
In this module, you reviewed the following Hitachi storage management software products:
Hitachi Storage Navigator (legacy products)
Hitachi Command Suite (HCS)
Hitachi Device Manager (HDvM)
Hitachi Tiered Storage Manager (HTSM)
Hitachi Replication Manager (HRpM)
Hitachi Tuning Manager (HTnM)
Hitachi Compute Systems Manager (HCSM server management)
Page 3-42
4. Storage Virtualization
Module Objectives
Page 4-1
Storage Virtualization
Hitachi Universal Volume Manager
External storage
Page 4-2
Storage Virtualization
Virtualization of External Volumes (Example)
T T VSP G1000
E T HUS110
SW1
Creating Volume in HUS 110
Map it via the two target
ports to the WWPN of
E T External port in VSP G1000
Virtualize it in VSP G1000
SW2
Present it to a server
Page 4-3
Storage Virtualization
Virtual Storage Machine
Page 4-4
Storage Virtualization
Adding Resources to Virtual Storage Machines
Resources Description
Storage Specifying a physical storage system from any 1 of the VSP G1000 systems discovered in
Systems HCS. Virtual Storage Machine will be created on the specified storage system.
Parity Groups Specifying existing parity group on the selected storage system. This is same purpose for
adding parity groups in resource group for access control.
The user who manages this virtual storage machine can create new volumes from the parity
group.
LDEV IDs Specifying LDEVs can be used in the virtual storage machine.
You can specify LDEVs already created in the storage system or you can also reserve LDEV
IDs (physical LDEV IDs) to be used by the virtual storage machine.
Storage Ports Specifying existing ports on the selected storage system. This is same purpose for adding
storage ports in resource group for access control.
The user who manages this virtual storage machine can use the port when allocating volume.
Host Group Specifying host groups can be used in the virtual storage machine.
Numbers You can specify unused host groups already created in the storage system or you can also
specifying number of host groups will be used by the virtual storage machine per ports.
Page 4-5
Storage Virtualization
Use Cases for Virtual Storage Machine
Nondisruptive migration
Global-active device
Scalability
Page 4-6
Storage Virtualization
Nondisruptive Migration
Nondisruptive Migration
11:11 T E 44:44
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
CMD Command Device, a low level I/F for controlling functions via CCI-commands
RSG Resource Group is a kind of virtual partition containing Ports, Host Groups and so
on
Page 4-7
Storage Virtualization
Nondisruptive Use Case Migration
VSP G1000
T T
VSP T T SN 67890
SN 12345
CMD CMD X11:11
11:11 T E 44:44
I/O through
Do not use cache
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
VSP G1000
T T
VSP T T SN 67890
SN 12345
CMD CMD X11:11
11:11 T E 44:44
Use Cache
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
Page 4-8
Storage Virtualization
Nondisruptive Use Case Migration
VSP G1000
T T
VSP T T SN 67890
SN 12345
CMD CMD X11:11
11:11 T E 44:44
99:99
Use Cache
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
VSP G1000
T T
VSP T T SN 67890
SN 12345
CMD CMD X11:11
11:11 T E 44:44
99:99
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
Page 4-9
Storage Virtualization
Supported Cache Modes
VSP G1000
T T
VSP T T SN 67890
SN 12345
CMD CMD X11:11
11:11 T E 44:44
99:99
RSG#0 RSG#1
VSM #0 VSM #1
VSP G1000 SN 67890 VSP SN 12345
Page 4-10
Storage Virtualization
Global-Active Device
Global-Active Device
Volumes to be replicated
Page 4-11
Storage Virtualization
Global-Active Device
Global-Active Device
GAD
VSM #1 VSM #0
VSP G1000 SN 12345 VSP G1000 SN 67890
E E
HUS
UVM T T UVM
Q Data path
Virtualization path
Replication path
Page 4-12
Storage Virtualization
Differences Between VSP G1000 Global-Active Device and VSP High Availability Manager
High Availability
Function Global-Active Device
Manager
Multipath I/O Active-Active Active-Passive
Multipath Software HDLM, Native OS Multipath HDLM
PP Combination(*1) YES(*2) NO
Operation I/F HCS, Raid Manager Raid Manager
Reserve SCSI-2, SCSI-3, ATS SCSI-2, ATS
Page 4-13
Storage Virtualization
Module Summary
Module Summary
Page 4-14
5. Replication
Module Objectives
Page 5-1
Replication
Hitachi Replication Products
Local Replication
In-System Replication Solutions Remote Replication Solutions
Remote Replication
Solutions Solutions
Hitachi ShadowImage Replication Hitachi TrueCopy
For full volume clones of business data Synchronous, consistent clones at remote
with consistency location up to 300km (~180 miles)
Hitachi Thin Image Hitachi Universal Replicator (HUR)
Point-in-time virtual volumes of data Heterogeneous, asynchronous, journal vs.
with consistency cache-based, pull vs. push, resilient at any
distance
Page 5-2
Replication
Hitachi ShadowImage Replication
Features
Full physical copy of a volume
Multiple copies at the same time
Up to 9 copies of the source volume
Immediately available for concurrent use by
Production Copy of
other applications (after split)
Volume Production
No dependence on operating system, file Volume
system or database Normal Point-in-
processing time copy
Benefits continues for parallel
unaffected processing
Protects data availability
Supports disaster recovery testing
Eliminates the backup window
Page 5-3
Replication
Hitachi Thin Image
Benefits Features
Reduce recovery time from data corruption or human Up to 1024 point-in-time snapshot copies
errors while minimizing the amount of storage capacity
needed for backups Only changed data blocks stored in pool
Achieve frequent and nondisruptive data backup Version tracking of backups enables easy restores of just
operations while critical applications run unaffected the data you need
An essential component of data backup and protection solutions is the ability to quickly and
easily copy data. Thin Image snapshot provides logical, change-based, point-in-time data
replication within Hitachi storage systems for immediate business use. Business usage can
include data backup and rapid recovery operations, as well as decision support, information
processing and software testing and development.
Maximum capacity of 2.1PB enables larger data sets or more virtual machines to be
protected
Maximum snapshots increased to 1024 for greater snapshot frequency and/or longer
retention periods
Page 5-4
Replication
Hitachi TrueCopy Remote Replication
Hitachi TrueCopy Remote Replication bundle is ideal for the most mission-critical data situations
when replication and backup of saved data are extremely important. TrueCopy, for Hitachi
storage families, addresses these challenges with immediate real-time and robust replication
capabilities.
Page 5-5
Replication
Hitachi Universal Replicator
Features Benefits
Asynchronous replication Resource optimization
Performance-optimized disk-based journaling Mitigation of network problems and
Resource-optimized processes significantly reduced network costs
WRT
Application Application
JNL JNL
Volume Volume
The following describes the basic technology behind the disk-optimized journals:
I/O is initiated by the application and sent to the Universal Storage Platform.
It is captured in cache and sent to the disk journal, at which point it is written to disk.
The remote system pulls the data and writes it to its own journals and then to the
replicated application volumes.
Hitachi Universal Replicator sorts the I/Os at the remote site by sequence and time stamp
(mainframe) and guaranteed data integrity.
Note that Hitachi Universal Replicator offers full support for consistency groups through the
journal mechanism (journal groups).
Page 5-6
Replication
Hitachi Replication Manager
Page 5-7
Replication
Tools Used For Setting Up Replication
Use interface tools to manage replication. Interface tools can include the following:
Page 5-8
Replication
Tools Used For Setting Up Replication - more
o CCI represents the command line interface for performing replication operations
o HORCM files contain the configuration for volumes to be replicated and used by
the commands available through CCI
Page 5-9
Replication
Requirements For All Replication Products
Page 5-10
Replication
Replication Status Flow
Split pair
Paired
The S-VOL is made identical to the P-VOL P-VOL S-VOL
Delete pair
Delete
Pairs are deleted and returned to simplex (unpaired) (Simplex)
status
Pair Operations
Create Pair:
o This establishes the initial copy using two logical units that you specify
o The P-VOL remains available to the host for read and write throughout the
operation
o Writes to the P-VOL are duplicated to the S-VOL Local Replication asynchron,
TrueCopy synchronously)
o The pair status changes to Paired when the initial copy is complete
Page 5-11
Replication
Replication Status Flow
Split:
o The S-VOL is made identical to the P-VOL and then copying from the P-VOL
stops
o While the pair is split, the array keeps track of changes to the P-VOL and S-VOL
in track maps
Resynchronize pair:
o When a pair is resynchronized, changes in the P-VOL since the split is copied to
the S-VOL, making the S-VOL identical to the P-VOL again
o During a resync operation, the S-VOL is inaccessible to hosts for write operations;
the P-VOL remains accessible for read/write
o If a pair was suspended by the system because of a pair failure, the entire P-VOL
is copied to the S-VOL during a resync
Swap pair:
Delete pair:
Page 5-12
Replication
Thin Provisioning Awareness
Pair create
instruction
P-VOL S-VOL POOL
Delete allocated page
(Write 0 and restore it
Usage 0%
to POOL)
Saves bandwidth and reduces initial copy time: In thin-to-thin replication pairings,
only data pages actually consumed (allocated) from the Hitachi Dynamic Provisioning
(HDP) pool need to be copied during initial copy
Reduce license costs: You only have to provision license capacity for capacity actually
consumed (allocated) from the HDP pool
Thin provisioning awareness: applies to all HDS replication products (including HUR)!
Page 5-13
Replication
Hitachi ShadowImage Replication
outage occurs
Allows disaster recovery testing without
impacting production
ShadowImage Replication is the in-system copy facility for the Hitachi storage systems. It
enables server-free backups, which allows customers to exceed service level agreements (SLAs).
It fulfills 2 primary functions:
ShadowImage Replication allows the pair to be split and use the secondary volume for system
backups, testing and data mining applications while the customers business using the primary
disk continues to run. It uses either graphical or command line interfaces to create a copy and
then control data replication and fast resynchronization of logical volumes within the system.
Page 5-14
Replication
Hitachi ShadowImage Replication RAID-Protected Clones
P-Vol
Page 5-15
Replication
Applications for ShadowImage In-System Replication
Application development
Hitachi ShadowImage Replication is replication, backup and restore software that delivers the
copy flexibility customers need for meeting todays unpredictable business challenges.
Execute logical backups at faster speeds and with less effort than previously possible
Page 5-16
Replication
ShadowImage Replication Consistency Groups
Page 5-17
Replication
Pair Status Over Time
Time
A A A B A B A A
Online Offline Online Online Online Offline Offline Offline
Pair Create
Split Suspend Resync Resume Reverse Sync
Copy status
Active Pair Pair Suspend Pair Resynchronization Reverse Synch/Restore
Pair status Split status
paircreate
pairsplit
pairresync
Page 5-18
Replication
Hitachi Thin Image
Virtual Volumes
Subsequent writes to the same block for the same snapshot do not have to be moved
Single instance of data stored in Hitachi Dynamic Provisioning Snap Pool regardless
of number of snaps
Page 5-19
Replication
Hitachi Thin Image Technical Details
License
Part of the In-System Replication license
Requires a Hitachi Dynamic Provisioning license
Pool
Uses a special Thin Image pool, which is created similarly to an HDP pool
Cannot be shared with a regular HDP pool
Shared Memory
Does not use shared memory except for difference tables
Uses a cache management device, which is stored in the Thin Image pool
V-VOLs
Uses virtual volumes (V-VOL), a transparent view on the P-Vol at snapshot creation time
Maximum 1,024 snapshots
Management
Managed via RAIDCOM CLI (up to 1,024 generations) or CCI (up to 64 generations) or
Hitachi Replication Manager
Copy Mechanism
Employs a copy-after-write instead of copy-on-write mechanism whenever possible
Advanced Configuration
Can be combined with Hitachi ShadowImage Replication, Hitachi Universal Replicator
and Hitachi TrueCopy
Page 5-20
Replication
Hitachi Thin Image Components
Host can
access
S-VOL
P-VOL
TI Pool
Page 5-21
Replication
Operations Flow Copy-on-Write Snapshot
The write completion status is returned to the host after the snapshot data is stored.
Page 5-22
Replication
Operations Flow Copy-After-Write
2. The write completion status is returned to the host before the snapshot data is stored.
Page 5-23
Replication
Thin Image Copy-After-Write or Copy-on-Write Mode
Note: If the cache write pending rate is 60% or more, Thin Image shifts to copy-on-write mode to slow host writes
Page 5-24
Replication
Hitachi ShadowImage Replication Clones vs. Hitachi Thin Image Snapshots
S-VOL
Virtual Volumes
P-VOL P-VOL
The P-VOL and the S-VOL have exactly the same size in ShadowImage Replication
In Thin Image snapshot software, less disk space is required for building a V-VOL image
since only part of the V-VOL is on the pool and the rest is still on the primary volume
Pair configuration
Restore
A primary volume can only be restored from the corresponding secondary volume in
ShadowImage Replication
With Thin Image snapshot software the primary volume can be restored from any
snapshot image (V-VOL)
Page 5-25
Replication
Applications: Hitachi ShadowImage Clones vs. Hitachi Thin Image Snapshots
Simple positioning
Clones should be positioned for data repurposing and data protection (for example, DR testing)
where performance is a primary concern
Snapshots should be positioned for data protection (for example, backup) only where space saving
is the primary concern
ShadowImage Snapshot
P-VOL = S-VOL P-VOL V-VOL
1:9 1:1024
Pair Configuration P-VOL
P-VOL S-VOL
V-VOL V-VOL V-VOL V-VOL
Restore P-VOL
P-VOL S-VOL
V-VOL V-VOL .. V-VOL V-VOL
Clones should be positioned for data repurposing and data protection (for example, DR
testing) where performance is a primary concern
Snapshots should be positioned for data protection (for example, backup) only where
space saving is the primary concern
Page 5-26
Replication
Hitachi TrueCopy Remote Replication
TrueCopy can remotely copy data to a second data center located up to 200 miles/320
km away (Distance limit is variable, but typically around 5060 km for HUS)
TrueCopy uses synchronous data transfers, which means data from the host server
requires a write acknowledgment from the remote local, as an indication of a successful
data copy, before the server host can proceed to the next data write I/O sequence
In addition to disaster recovery, use case examples for TrueCopy also include test and
development, data warehousing and mining, as well as data migration purposes
Page 5-27
Replication
Basic Hitachi TrueCopy Replication Operation
Data in a TrueCopy backup stays synchronized with the data in the local array
o This happens when data is written from the host to the local array then to the
remote system, through Fibre Channel or iSCSI link
o The host holds subsequent output until acknowledgement is received from the
remote array for the previous output
When a synchronized pair is split, writes to the primary volume are no longer copied to
the secondary side
Output to the local array is cached until the primary and secondary volumes are
resynchronized
When resynchronization takes place, only the changed data is transferred, rather than
the entire primary volume, which reduces copy time
Page 5-28
Replication
Basic Hitachi TrueCopy Replication Operation
o These in-system copy tools allow restoration from one or more additional copies
of critical data
Besides disaster recovery, TrueCopy backup copies can be used for test and
development, data warehousing and mining, or migration applications
Recovery objectives
o Recovery point objective (RPO): Point in time to which data must be restored to
successfully resume processing
Page 5-29
Replication
Hitachi TrueCopy Remote Replication (Synchronous)
P-VOL S-VOL
o Remote I/O is not posted complete to the application server until it is written to
the remote system
data: writes to P-VOL will be refused when replication to remote site is not possible
status: writes to P-VOL allowed if S-VOL can be changed to error status (PSUE)
never: writes to P-VOL are always allowed (default for asynchron replications)
Page 5-30
Replication
Hitachi Universal Replicator (Asynchronous)
TrueCopy Synchronous software and HUR can be combined together to allow advanced 3Data
Center (3DC) configurations for optimal data protection
Page 5-31
Replication
Hitachi Universal Replicator Functions
Host I/O process completes immediately after storing write data to the cache
memory of primary storage system Master Control Unit (MCU)
3. Asynchronous
1. Write I/O remote copy
P-VOL JNL-VOL
JNL-VOL
Primary host 2. Write complete 4. Remote copy complete S-VOL
Page 5-32
Replication
Three-Data-Center Multi-Target Replication
S-VOL
JNL-
S-VOL
TrueCopy (Sync) JNL-
VOL
or HUR* VOL
JNL-
JNL-
VOL JNL Group
P-VOL
VOL
There might be limitations/guidelines related to what storage systems can be set up in this
configuration. Refer to the product documentation for latest information.
3DC
Multi-target TrueCopy (Sync) JNL-
JNL- S-VOL
VOL
VOL
JNL Group
JNL-
S-VOL
Journal Group JNL-
VOL
VOL
HUR
JNL Group
Page 5-33
Replication
Module Summary
Module Summary
Learn more:
CSI0147 Hitachi Enterprise In-System and TrueCopy Remote
Replications
TSI0150 Hitachi Universal Replicator Open Systems
TSI1635 Replication Solutions v7.x
Page 5-34
Training Course Glossary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
ACC Action Code. A SIM (System Information AL-PA Arbitrated Loop Physical Address.
Message). AMS Adaptable Modular Storage.
ACE Access Control Entry. Stores access rights APAR Authorized Program Analysis Reports.
for a single user or group within the APF Authorized Program Facility. In IBM z/OS
Windows security model. and OS/390 environments, a facility that
ACL Access Control List. Stores a set of ACEs permits the identification of programs that
so that it describes the complete set of access are authorized to use restricted functions.
rights for a file system object within the API Application Programming Interface.
Microsoft Windows security model.
APID Application Identification. An ID to
ACP Array Control Processor. Microprocessor identify a command device.
mounted on the disk adapter circuit board
(DKA) that controls the drives in a specific Application Management The processes that
disk array. Considered part of the back end; manage the capacity and performance of
it controls data transfer between cache and applications.
the hard drives. ARB Arbitration or request.
ACP Domain Also Array Domain. All of the ARM Automated Restart Manager.
array-groups controlled by the same pair of Array Domain Also ACP Domain. All
DKA boards, or the HDDs managed by 1 functions, paths and disk drives controlled
ACP PAIR (also called BED). by a single ACP pair. An array domain can
ACP PAIR Physical disk access control logic. contain a variety of LVI or LU
Each ACP consists of 2 DKA PCBs to configurations.
provide 8 loop paths to the real HDDs. Array Group Also called a parity group. A
Actuator (arm) Read/write heads are attached group of hard disk drives (HDDs) that form
to a single head actuator, or actuator arm, the basic unit of storage in a subsystem. All
that moves the heads around the platters. HDDs in a parity group must have the same
AD Active Directory. physical capacity.
ADC Accelerated Data Copy. Array Unit A group of hard disk drives in 1
RAID structure. Same as parity group.
Address A location of data, usually in main
memory or on a disk. A name or token that ASIC Application specific integrated circuit.
identifies a network component. In local area ASSY Assembly.
networks (LANs), for example, every node Asymmetric virtualization See Out-of-Band
has a unique address. virtualization.
ADP Adapter. Asynchronous An I/O operation whose
ADS Active Directory Service. initiator does not await its completion before
CLPR Cache Logical Partition. Cache can be Cloud Fundamental A core requirement to the
deployment of cloud computing. Cloud
divided into multiple virtual cache
memories to lessen I/O contention. fundamentals include:
K LM Local Memory.
RPC Remote procedure call. SAN Storage Area Network. A network linking
computing devices to disk or tape arrays and
RPO Recovery Point Objective. The point in other devices over Fibre Channel. It handles
time that recovered data should match. data at the block level.
RPSFAN Rear Power Supply Fan Assembly. SAP (1) System Assist Processor (for I/O
RRDS Relative Record Data Set. processing), or (2) a German software
RS CON RS232C/RS422 Interface Connector. company.
RSD RAID Storage Division (of Hitachi). SAP HANA High Performance Analytic
Appliance, a database appliance technology
R-SIM Remote Service Information Message. proprietary to SAP.
RSM Real Storage Manager. SARD System Assurance Registration
RTM Recovery Termination Manager. Document.
RTO Recovery Time Objective. The length of SAS Serial Attached SCSI.
time that can be tolerated between a disaster SATA Serial ATA. Serial Advanced Technology
and recovery of data. Attachment is a new standard for connecting
R-VOL Remote Volume. hard drives into computer systems. SATA is
R/W Read/Write. based on serial signaling technology, unlike
current IDE (Integrated Drive Electronics)
-back to top-
hard drives that use parallel signaling.
S SBM Solutions Business Manager.
SA Storage Administrator. SBOD Switched Bunch of Disks.
SA z/OS System Automation for z/OS. SBSC Smart Business Storage Cloud.
SAA Share Access Authentication. The process SBX Small Box (Small Form Factor).
of restricting a user's rights to a file system
SC (1) Simplex connector. Fibre Channel
object by combining the security descriptors
connector that is larger than a Lucent
from both the file system object itself and the
connector (LC). (2) Single Cabinet.
share to which the user is connected.
SCM Supply Chain Management.
SaaS Software as a Service. A cloud computing
SCP Secure Copy.
business model. SaaS is a software delivery
model in which software and its associated SCSI Small Computer Systems Interface. A
data are hosted centrally in a cloud and are parallel bus architecture and a protocol for
typically accessed by users using a thin transmitting large data blocks up to a
client, such as a web browser via the distance of 15 to 25 meters.
Internet. SaaS has become a common SD Software Division (of Hitachi).
WAN Wide Area Network. A computing XFI Standard interface for connecting a 10Gb
internetwork that covers a broad area or Ethernet MAC device to XFP interface.
region. Contrast with PAN, LAN and MAN.
XFP "X"=10Gb Small Form Factor Pluggable.
WDIR Directory Name Object.
XML eXtensible Markup Language.
WDIR Working Directory.
XRC Extended Remote Copy.
WDS Working Data Set. -back to top-
https://learningcenter.hds.com/Saba/Web/Main
Page E-1
Evaluating This Course
Page E-2