Introduction to the new mainframe

Chapter 2 Hardware systems and LPARs

Copyright
py g IBM Corp.,
p , 2006. All rights
g reserved.
Introduction to the new mainframe

Objectives

In this chapter you will learn:

About S/360 and zSeries hardware design
About processing units and disk hardware
How mainframes differ from PC systems in data encoding
About some typical
yp hardware configurations
g

Copyright IBM Corp., 2006. All rights reserved.

2
Introduction to the new mainframe

Introduction

Here we look at the hardware in a complete system

although the emphasis is on the processor box
T
Terminology
i l is
i nott straightforward
t i htf d
Ever since boxes became multi-engined, the terms system,
processor,
p ocesso , a
and
dCCPU
U have
a e beco
become
e muddled
udd ed

Copyright IBM Corp., 2006. All rights reserved.

3
Introduction to the new mainframe

Terminology:
Individual processors in the
System box from IBM
system
possibly a zSeries
machine
"processors"

Sometimes referenced
as a "processor" "CPUs"

"engines"

"PUs"
Sometimes referenced
as a "CPU"
"CPs"

IFLs, ICFs, zAAPs, IFLs

A few people use "CEC" spares

"system" = CPs running an

Many use "system" p g system
operating y

Copyright IBM Corp., 2006. All rights reserved.

4
Introduction to the new mainframe

Conceptual S/360

Storage Main
Processors Control Storage

Parallel
Channels 1 5 6 A B

3 3
Control Control Control
Unit Unit Unit

3 0 1 0 1 Z
0 Devices Y

1 2 X
C0
communication
Control
Channels 5 3 Unit line

Another
System

Copyright IBM Corp., 2006. All rights reserved.

5
Introduction to the new mainframe

Early system design

System/360 was designed in the early 1960s

The central processor box contains the processors,
processors memory,
memory
control circuits and channel interfaces
o Early systems had up to 16 channels whereas modern systems have
over 1000
Channels connect to control units
Control units connect to devices such as disk drives,
drives tape drives
and communication interfaces

Copyright IBM Corp., 2006. All rights reserved.

6
Introduction to the new mainframe

Device address
address: 1 3 2

channel number control unit number device number

In the early
y design
g the device address was physically
p y y related to the
hardware architecture
Parallel channels had large diameter heavy copper bus and tag
cables

Copyright IBM Corp., 2006. All rights reserved.

7
Introduction to the new mainframe

Current design

Current CEC designs are considerably more complex then

the early S/360 design
Thi new complexity
This l it includes
i l d
I/O connectivity
I/O operation
Partitioning of the system

Copyright IBM Corp., 2006. All rights reserved.

8
Introduction to the new mainframe

I/O Connectivity
CEC box
Partition 1 Partition 2

I/O Processing

Channels 42
(CHPIDs or PCHIDs)
01 02 ... 40 41 ... ... A0 A1 ... ...
O E E E E F F
Other
systems

01
Control ESCON
LAN FICON
Unit Director
switch
(switch)

C0 C1 01 02
Control unit addresses Control Control Control Control
(CUA) Unit Unit Unit Unit

Unit addresses (UA) 0 1

0 1 0 1 0 1

E - ESCON channel
F - FICON channel
O - OSA-Express channel

Copyright IBM Corp., 2006. All rights reserved.

9
Introduction to the new mainframe

I/O Connectivity
ESCON and d FICON channels
h l
Switches to connect peripheral devices to more than one CEC
CHPID addresses are two hex digits
Multiple partitions can share CHPIDs
I/O subsystem layer exists between the operating system and
the CHPIDs

Copyright IBM Corp., 2006. All rights reserved.

10
Introduction to the new mainframe

I/O Connectivity
I/O controll llayer uses a controll fil
file IOCDS that
h translates
l
physical I/O addresses into devices numbers that are used by
z/OS
Device numbers are assigned by the system programmer when
creating the IODF and IOCDS and are arbitrary (but not random!)
On modern machines they are three or four hex digits

Copyright IBM Corp., 2006. All rights reserved.

11
Introduction to the new mainframe

I/O Connectivity
External device label 6830
Four hex digits in range 0000-FFFF 6831
Arbitrarily assigned by sysprog 6832
6833
Used in JCL, commands, messages, EREP
683F
FF00

2000 2008
HSA
2001 2009
LPAR B
2002 200A
Central Storage
FF01 2003 200B
LPAR A
Central Storage 2004 200C
2005 200D
UCB 2006 200E
2001
FF02 2007 200F
UCB
2000
UCB
183F V 200A,ONLINE

C40 IEE302I 200A ONLINE

FF03

V 200B,ONLINE

Copyright IBM Corp., 2006. All rights reserved.

12
Introduction to the new mainframe

System Control and Partitioning

Specialized microprocessors for

internal control functions
Memory
LPAR1 LPAR2 LPAR3

System Control

HMC SE CP CP CP CP Processors

PC Think Pads
System Control

Located in operator area Located inside CEC but

can be used byy operators
p
Ch
Channels
l

CHPID CHPID CHPID

CHPID CHPID CHPID CHPID

Copyright IBM Corp., 2006. All rights reserved.

13
Introduction to the new mainframe

System Control and Partitioning

A
Among the h system controll function
f i is
i the
h ability
bili to partition
i i the
h
system into logical partitions (LPARs)
Initial limit was 15 LPARs but newer machines allow 30 partitions
p
Practical considerations can limit the number to less than this as
each LPAR needs memory, I/O, and processing power

Copyright IBM Corp., 2006. All rights reserved.

14
Introduction to the new mainframe

LPARs

System administrators assign:

Memory
Processors
CHPIDs either dedicated or shared
This is done partly in the IOCDS and partly in a system
profile on the Support Element (SE) in the CEC. This is
normally updated through the HMC.
Changing the system profile and IOCDS will usually require
a power-on reset (POR) but some changes are dynamic

Copyright IBM Corp., 2006. All rights reserved.

15
Introduction to the new mainframe

Characteristics of LPARs
LPAR
LPARs are the
h equivalent
i l off a separate mainframe
i f for
f most
practical purposes
Each LPAR runs its own operating
p g system
y
Devices can be shared across several LPARs
Processors can be dedicated or shared
When shared each LPAR is assigned a number of logical
processors (up to the maximum number of physical processors)
and a weighting
g g
Each LPAR is independent

Copyright IBM Corp., 2006. All rights reserved.

16
Introduction to the new mainframe

Consolidation of mainframes
M
Many iinstallations
ll i usedd to have
h severall boxes
b
A single larger machines running many LPARs is often more
cost effective,, as software licenses for multiple
p small machines
can total more than those for a single large one

Copyright IBM Corp., 2006. All rights reserved.

17
Introduction to the new mainframe

Processing Units
Modern
M d processor offer
ff many specialist
i li t processor types.
t
Most of the additional types are not counted as full processors for
software charging
Central Processor (CP) - A full z/OS processor
System Assistance Processor (SAP) - Used for the I/O subsystem
each machine has at least one
Integrated Facility for Linux (IFL) - Special processor for Linux -
optional
zAAP Used for JAVA code optional
zIIP Used for Dataprocessing code optional
Integrated Coupling Facility (ICF) - For coupling facilities
Spares
SAPs, IFLs, ICFs, zAAPs and zIIPS are not counted in the model
number and or against software costs

Copyright IBM Corp., 2006. All rights reserved.

18
Introduction to the new mainframe

Capacity on Demand

Various forms of Capacity on Demand exist

Additional processing power to meet unexpected growth

or sudden demand peaks

Copyright IBM Corp., 2006. All rights reserved.

19
Introduction to the new mainframe

Disk Devices
IBM 3390 Disk Unit

IBM 3990
channels
Control Unit

Current mainframes use 3390 disk devices

The original configuration was simple with a controller connected to
the processor and strings of devices attached to the back end

Copyright IBM Corp., 2006. All rights reserved.

20
Introduction to the new mainframe

Current 3390 Implementation

Host Adapters (2 channel interfaces per adapter)

HA HA HA HA HA HA HA HA HA HA HA HA HA HA HA HA

Common Interconnect (across clusters)

Cluster Processor Complex Cluster Processor Complex

cache NVS cache NVS

DA DA DA DA DA DA DA DA

RAID array Device Adapters

RAID array

Copyright IBM Corp., 2006. All rights reserved.

21
Introduction to the new mainframe

Modern 3390 devices

Th
The 2105 EEnterprise
i SStorage S
Server jjust shown
h is
i very
sophisticated
It emulates a large
g number of control units and 3390 disks. It can
also be partitioned and connect to UNIX and other systems as
SCSI devices.
There are 11 TB of disk space up to 32 channel interfaces,
interfaces 16GB
cache and 284MB of non-volatile memory

Copyright IBM Corp., 2006. All rights reserved.

22
Introduction to the new mainframe

Modern 3390 Devices

Th
The physical
h i l disks
di k are commoditydi SCSI-
SCSI type units
i
Many configurations are possible but usually it is RAID-5 arrays
with hot spares
p
Almost every part has a fallback or spare and the control units
are emulated by 4 RISC processors in two complexes.

Copyright IBM Corp., 2006. All rights reserved.

23
Introduction to the new mainframe

Modern 3390 Devices

Th
The 2105 offers
ff Fl
FlashCopy,
hC E
Extended
d dR Remote CCopy, CConcurrent
Copy, Parallel Access Volumes, Multiple Allegiance
This is a huge
g extension of the original
g 3390 architecture and
offers a massive performance boost.
To the z/OS operating system these disks just appear as
traditional 3390 devices so maintaining backward compatibility

Copyright IBM Corp., 2006. All rights reserved.

24
Introduction to the new mainframe

EBCDIC
Th
The IBM S/360 through
h h to the
h llatest zSeries
S i machines
hi use the
h
Extended Binary Coded Decimal Interchange character set for
most purposes
This was developed before ASCII and is also an 8 bit character
set
z/OS Web Server stores ASCII data as most browsers run on PCs
which expect ASCII data
UNICODE is used for JAVA on the latest machines

Copyright IBM Corp., 2006. All rights reserved.

25
Introduction to the new mainframe

Clustering

Clustering has been done for many years in several forms

Basic shared DASD
CTC/GRS rings
Basic and Parallel sysplex
Image is used to describe a single z/OS system
system, which
might be standalone or an LPAR on a large box

Copyright IBM Corp., 2006. All rights reserved.

26
Introduction to the new mainframe

Basic shared DASD

zSeries ( or LPAR) zSeries ( or LPAR)

z/OS z/OS
channels channels

Real system would

have many more
control units and
devices

control unit control unit

Limited capability
y
Reserve and release against a whole disk
Limits access to that disk for the duration of the update

Copyright IBM Corp., 2006. All rights reserved.

27
 Introduction to the new mainframe

CTC Ring zSeries ( or LPAR) zSeries ( or LPAR)

z/OS z/OS
channels channels
CTC

CTC

control unit control unit

Can have more systems in the

CTC"ring"

Global Resource
Reso rce Sharing (GRS) used
sed to pass information bet
between
een
systems via the CTC ring
Request ENQueue on a data set, update, the DEQueue
Loosely coupled system
Copyright IBM Corp., 2006. All rights reserved.
28
Introduction to the new mainframe

Parallel Sysplex system or LPAR

Coupling
Facility

CF channels
zSeries ( or LPAR) zSeries ( or LPAR)

z/OS z/OS
channels channels

control unit control unit

This extension of the CTC ring uses a dedicated Coupling Facility to

store ENQ data for GRS
This is much faster
The CF can also be used to share application data such as DB2
tables
C appear as a single
Can i l system
t

Copyright IBM Corp., 2006. All rights reserved.

29
Introduction to the new mainframe

Typical Systems Standard mainframe control units and devices Selected mainframe control units and devices

printer
i t printer
i t

ESCON channels Parallel channels

MP3000 FLEX-ES
System System

SUPPORT
element

LAN
p ( )
adapter(s) LAN
adapter(s)

tn3270 terminals tn3270 terminals

This shows two very small systems

On the left is a Multiprise 3000, which was designed for small
installations with internal disk drives
On the right is a FLEX-ES
FLEX ES emulation system
system, which runs on a PC
running Linux or UNIX
Copyright IBM Corp., 2006. All rights reserved.
30
 Introduction to the new mainframe

Medium Mainframe Configuration

Enterprise
Storage Server1

Printer

Printer
z890
OSA-Express

Tape Router
drives
d i

LAN
Enterprise
Storage Server1

Consoles
This is a completely modern implementation with no older devices
A z890 is featured with two external disk controllers
controllers, tape drives
drives,
printers, LAN attachments and consoles
Copyright IBM Corp., 2006. All rights reserved.
31
Introduction to the new mainframe

Medium Single System

This system could be running several LPARs

A production z/OS with interactive applications
A second production LPAR devoted to batch
A test z/OS LPAR for testing new software
One or more LPARs running g Linux,, perhaps
p p running
g web
applications

Copyright IBM Corp., 2006. All rights reserved.

32
Introduction to the new mainframe

Moderately Large Configuration

Two machines a new z990 and an
older 9672, Parallel Sysplex with CF
coupling facility
Consoles

Multiple ESS and older DASD

connected via a switch 3745
OSA Express
communications controllers for an
SNA network 3490E tape drives LAN z990 9672
retained for compatibility OSA R96 OSA Express
LAN
Express connections to various OSA Express OSA Express
LANs Consoles LAN
LAN

Escon Escon
Director Director

3490E Enterprise Enterprise Older DASD

Storage Server1 Storage Server1 device 3390

Copyright IBM Corp., 2006. All rights reserved.

33
Introduction to the new mainframe

Larger system
Thi
This is
i the
h sort off mixture
i off device
d i generations
i that
h might
i h be
b
found in any enterprise
New devices are broughtg in but older ones are still viable until
they reach the end of their life
z/OS will usually run on older devices until an architectural
change forces their withdrawal
This sort of change is usually well publicized and several years
notice is given of any incompatibility which will usually coincide
with the machine being at end of life

Copyright IBM Corp., 2006. All rights reserved.

34
Introduction to the new mainframe

Summary
T
Terminology
i l is
i important
i
The classic S/360 design is important as all later designs have
enhanced it. The concepts
p are still relevant
New processor types are now available to reduce software costs
EBCDIC character set
Clustering techniques and parallel sysplex

Copyright IBM Corp., 2006. All rights reserved.

35
Introduction to the new mainframe

FSP Bulk FSP Bulk DCA = power +

Power Power control interface
Support
Element Unit Unit

Ethernet

Support
Elementt
El
FSP FSP FSP FSP FSP FSP FSP FSP
HMC
DCA DCA DCA DCA DCA DCA DCA DCA

Connections Connections
MCM MCM ... for up to for up to
28 channel 28 channel
adapter cards adapter cards

Memory Memory

System Processor Processor I/O Cage 2 I/O Cage 3

frame Book 0 Book 1
"B "
"Box"

Copyright IBM Corp., 2006. All rights reserved.

36