You are on page 1of 18

Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS family

Setting up IBM AIX fiber channel


MPIO in Infortrend EonStor DS family

Version: 1.0
Updated: April, 2016

Abstract:
This document describes that how to configure the fiber channel
MPIO in IBM AIX with Infortrend EonStor DS family.

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Infortrend, ESVA, EonStor, EonNAS, and EonPath are trademarks or
registered trademarks of Infortrend. All other marks and names mentioned herein may be trademarks of their respective owners. The
information contained herein is subject to change without notice. Content provided as is, without express or implied warranties of any kind.
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Table of Contents
Environment requirement ......................................................................................................... 3
AIX requirement .................................................................................................................... 3
Storage requirement ............................................................................................................. 3
Steps for setting up the native MPIO........................................................................................ 4
Checking the AIX system status ........................................................................................... 4
Starting the setting ................................................................................................................ 5
Test ..................................................................................................................................... 14
Appendix ................................................................................................................................... 17

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 2 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Environment requirement
AIX requirement

All AIX versions are supported, and the following version has been verified: AIX 6.1 ML4

Storage requirement
All EonStor DS Family models equipped with fiber channel adapters are supported. To use the fiber channel
for MPIO configuration, make sure there are two fiber channel adapters installed in the IBM AIX server. To
verify that the adapters are ready, type command “lsdev -Cc adapter”, and fcs0 and fcs1 should show up with
status “available”.

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 3 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Steps for setting up the native MPIO


Please follow the steps to complete the MPIO configuration, and the commands will be showed

in dark blue and the results will be showed in black or red.

Checking the AIX system status


# uname -a
AIX aix 3 5 000F90AF4C00

# lsdev -Cc adapter


ent0 Available 10-80 IBM 10/100 Mbps Ethernet PCI
Adapter (23100020)
fcs0 Available 20-58 FC Adapter
fcs1 Available 20-59 FC Adapter
fda0 Available 01-D1 Standard I/O Diskette Adapter
lai0 Available 1F-00 GXT135P Graphics Adapter
paud0Available 01-Q2 Ultimedia Integrated Audio
ppa0 Available 01-R1 CHRP IEEE1284 (ECP) Parallel Port
Adapter
sa0 Available 01-S1 Standard I/O Serial Port
sa1 Available 01-S2 Standard I/O Serial Port
scsi0 Available 10-60 Wide/Ultra-2 SCSI I/O Controller
scsi1 Available 10-61 Wide/Ultra-2 SCSI I/O Controller
sioka0 Available 01-K1-00 Keyboard Adapter
siokma0 Available 01-K1 Keyboard/Mouse Adapter
sioma0 Available 01-K1-01 Mouse Adapter
siota0 Available 01-Q1 Tablet Adapter

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 4 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Starting the setting


1. Change the Peripheral Device Type to (7F) No Device Present on
SANWatch/EmbbededRAIDWatch

2. Modify the shell file “aixmpio.sh” as shown in the example text box below.
#!/bin/ksh
odmadd << \! /* one space each after “odmadd” and “<<” */
PdAt:
uniquetype = "disk/fcp/mpioosdisk"
attribute = "mpio_model_map"
deflt = "0808IFT " /* five spaces after “0808IFT */
values = "041480"
width = ""
type = "R"
generic = ""
rep = "s"
nls_index = 0
!
Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 5 / 18
Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

3. Execute the shell file “aixmpio.sh” using command “./aixmpio.sh” or “bash aixmpio.sh”
4. Type command “bosboot –a” after changing the permission of shell file “aixmpio.sh”

# cat aixmpio.sh
#!/bin/ksh
odmadd << \!
PdAt:
uniquetype="disk/fcp/mpioosdisk"
attribute="mpio_model_map"
deflt="0808IFT "
values="041480"
width=""
type="R"
generic=""
rep="s"
nls_index=0
!

# chmod 711 aixmpio.sh


# ./aixmpio.sh
# bosboot -a
bosboot: Boot image is 32802 512 byte blocks.

5. Type the command below to check if the fiber channel configuration for AIX MPIO is being set
successfully.
Command: odmget -q uniquetype=disk/fcp/mpioosdisk PdAt | grep deflt

# odmget -q uniquetype=disk/fcp/mpioosdisk PdAt | grep deflt


deflt = ""
deflt = ""
deflt = ""
deflt = ""
deflt = ""
deflt = "no"
deflt = "none"
deflt =
"0x000000080000000000000200010124020a00000000000000000000070a05000000000000000000080c00
00ffff0000ffffffff00040a06000100000000"
deflt = "0x00000000010700ffff000000ff0202ffff070a00ffff0000000000ffff"
deflt = "4"
deflt = "0"
deflt = "2"
deflt = "1"

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 6 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

deflt = "simple"
deflt = "yes"
deflt = "no"
deflt = "no"
deflt = "30"
deflt = "60"
deflt = "0x40000"
deflt = "120"
deflt = "28800"
deflt = "28800"
deflt = "0x00100000"
deflt = ""
deflt = ""
deflt = "single_path"
deflt = "PCM/friend/fcpother"
deflt = "080EHITACHI OPEN-3/HITACHI OPEN-8/HITACHI OPEN-9/HITACHI OPEN-E/HITACHI
OPEN-K/HITACHI OPEN-L/HITACHI OPEN-M/HITACHI OPEN-V"
deflt = "080EHITACHI 3380-K/HITACHI 3390-3/HITACHI 6586-K/HITACHI 6588-3"
deflt = "0811HITACHI OP-C-3380/HITACHI OP-C-3390/HITACHI OP-C-6586/HITACHI OP-C-6588"
deflt = "0811EMC SYMMETRIX"
deflt = "080CIBM 2105"
deflt = "240C"
deflt = "0"
deflt = "080CIBM 1750"
deflt = "080CIBM 2107"
deflt = "080CIBM 2145"
deflt = "0808DGC ,B102CX/AX"
deflt = "080BNETAPP LUN,6004N370/N330/N360/N520/N530/N550/N560/N760/N770/N780/N790"
deflt = "080BNETAPP
LUN,60062859-A/2862-A/2863-A/2864-A/2865-A/2866-A/2867-A/2868-A/2869-A"
deflt = "080BNETAPP LUN,6006FAS270"
deflt = "080BNETAPP LUN,6007FAS2020/FAS2050/FAS3020/FAS3040"
deflt = "080BNETAPP LUN,6007FAS3050/FAS3070/FAS6030/FAS6040/FAS6070/FAS6080"
deflt = "yes"
deflt = "0808IFT "

6. Type the command below to check if the fiber channels are connectable.
“fcstat fcs0” and “fcstat fcs1”

# fcstat fcs0

FIBER CHANNEL STATISTICS REPORT: fcs0

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 7 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Device Type: FC Adapter (df1000fd)


Serial Number: VM64816748
Option ROM Version: 02C8211A
Firmware Version: B1F2.10A10
World Wide Node Name: 0x20000000C95EA09A
World Wide Port Name: 0x10000000C95EA09A

FC-4 TYPES:
Supported: 0x0000012000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): 4 GBIT
Port Speed (running): 4 GBIT
Port FC ID: 0x000001
Port Type: Private Loop

Seconds Since Last Reset: 0

Transmit Statistics Receive Statistics


------------------- ------------------
Frames: 48 151
Words: 3072 3840

LIP Count: 0
NOS Count: 0
Error Frames: 0
Dumped Frames: 0
Link Failure Count: 61
Loss of Sync Count: 11
Loss of Signal: 6
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 478
Invalid CRC Count: 0

IP over FC Adapter Driver Information


No DMA Resource Count: 0
No Adapter Elements Count: 0

FC SCSI Adapter Driver Information


No DMA Resource Count: 0
No Adapter Elements Count: 0
No Command Resource Count: 0

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 8 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

IP over FC Traffic Statistics


Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

FC SCSI Traffic Statistics


Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

# fcstat fcs1

FIBRE CHANNEL STATISTICS REPORT: fcs1

Device Type: FC Adapter (df1000fd)


Serial Number: VM64816748
Option ROM Version: 02C8211A
Firmware Version: B1F2.10A10
World Wide Node Name: 0x20000000C95EA09B
World Wide Port Name: 0x10000000C95EA09B

FC-4 TYPES:
Supported: 0x0000012000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): 4 GBIT
Port Speed (running): 4 GBIT
Port FC ID: 0x000001
Port Type: Private Loop

Seconds Since Last Reset: 0

Transmit Statistics Receive Statistics


------------------- ------------------
Frames: 46 151
Words: 3072 3840

LIP Count: 0
NOS Count: 0

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 9 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Error Frames: 1
Dumped Frames: 0
Link Failure Count: 82
Loss of Sync Count: 12
Loss of Signal: 6
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 9
Invalid CRC Count: 1

IP over FC Adapter Driver Information


No DMA Resource Count: 0
No Adapter Elements Count: 0

FC SCSI Adapter Driver Information


No DMA Resource Count: 0
No Adapter Elements Count: 0
No Command Resource Count: 0

IP over FC Traffic Statistics


Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

FC SCSI Traffic Statistics


Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

7. Map a partition to AIX server through the two fiber channels.


8. Rescan hardware changes on AIX server.
cfgmgr -v
lsdev -Cc disk # the new disks “hdiskN” should be set to “MPIO other FC scsi disk drive” by now, as shown
in the example below.

# cfgmgr
# lsdev -Cc disk

hdisk0 Available 10-60-00-0,0 Other SCSI Disk Drive


hdisk1 Available 20-58-01 MPIO Other FC SCSI Disk Drive

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 10 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

# lspv
hdisk0 000f90afbee846db rootvg active
hdisk1 000f90af727893c6 ift active

9. Check the disk information


#lscfg -vpl hdisk1

10. Check the disk size


#bootinfo –s hdisk1

11. Configure MPIO parameters


Smitty mpio
modify the two MPIO configurations as shown in the example below:
Reservation Policy=no_reserve
health check interva=60

# smitty mpio

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 11 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

12. Modify the MPIO disk parameters


chdev -l hdiskN -a queue_depth=16
chdev -l hdiskN -a reassign_to=30
chdev -l hdiskN -a rw_timeout=70

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 12 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

# chdev -l hdisk1 -a queue_depth=16


hdisk1 changed
# chdev -l hdisk1 -a reassign_to=30
hdisk1 changed
# chdev -l hdisk1 -a rw_timeout=70
hdisk1 changed

13. If using the HACMP setting


Modify the configuration file under the path: /etc/cluster/disktype.lst
Add one more row: disk/fcp/mpioosdisk FCPARRAY

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 13 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Test
a) Build volume group “smitty vg” using “hdiskN”. Type command: smitty mkvg
# smitty mkvg

b) Build logical volume:smitty lv. Command: smitty mklv


# smitty mklv

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 14 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

c) Create jfs2 file system:smitty fs. Command: smitty crfs


# smitty crfs

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 15 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

d) mkdir /ift && chmod 777 /ift


Command: mkdir /ift
The command isn’t necessary if the path “/ift” already exist;

Command: chmod 777 /ift


Set the permission for the directory according to your needs.

e) Mount the testing logical volume to the directory “ift”. Command: mount /ift
# mount /ift

f) Create data under the directory “ift”, then check which fiber channel it is currently using.
Command:
iostat -a 1 | grep fcs0
iostat -a 1 | grep fcs1

time dd if=/dev/zero of=/ift/testfile bs=131072 count=81920 #create a 10GB data


iostat -a 1 | grep fcs #check the fiber channel traffic

g) Unplug the fiber optic line which is doing the “write” operation. The data transfer will switch to another
line within 20-30 seconds. Re-plug the fiber optic line that you just unplugged and the data transfer
will return to the original fiber channel within 30 seconds

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 16 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Appendix
shutdown –Fr #restart AIX server

lscfg –vpl fcsN # Check corresponding slots of the fiber channel adapters

# lscfg -vpl fcs0


fcs0 P1-I1/Q1 FC Adapter

Part Number....................LP11002-M4
Serial Number.................VM64816748
Network Address.............10000000C95EA09A
ROS Level and ID............02C8211A
Device Specific.(Z0)........1036406D
Device Specific.(Z1)........00000000
Device Specific.(Z2)........00000000
Device Specific.(Z3)........03000909
Device Specific.(Z4)........FFC0115A
Device Specific.(Z5)........02C8211A
Device Specific.(Z6)........06C1211A
Device Specific.(Z7)........07C1211A
Device Specific.(Z8)........20000000C95EA09A
Device Specific.(Z9)........BS2.10A10
Device Specific.(ZA)........B1F2.10A10
Device Specific.(ZB)........B2F2.10A10
Device Specific.(YL)........P1-I1/Q1

PLATFORM SPECIFIC

Name: fibre-channel
Model: LP11002-M4
Node: fibre-channel@b
Device Type: fcp
Physical Location: P1-I1/Q1
# lscfg -vpl fcs1
fcs1 P1-I1/Q2 FC Adapter

Part Number.................LP11002-M4
Serial Number...............VM64816748
Network Address.............10000000C95EA09B
ROS Level and ID............02C8211A

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 17 / 18


Infortrend VMware Solution – Best Practice
Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Device Specific.(Z0)........1036406D
Device Specific.(Z1)........00000000
Device Specific.(Z2)........00000000
Device Specific.(Z3)........03000909
Device Specific.(Z4)........FFC0115A
Device Specific.(Z5)........02C8211A
Device Specific.(Z6)........06C1211A
Device Specific.(Z7)........07C1211A
Device Specific.(Z8)........20000000C95EA09B
Device Specific.(Z9)........BS2.10A10
Device Specific.(ZA)........B1F2.10A10
Device Specific.(ZB)........B2F2.10A10
Device Specific.(YL)........P1-I1/Q2

PLATFORM SPECIFIC

Name: fibre-channel
Model: LP11002-M4
Node: fibre-channel@b,1
Device Type: fcp
Physical Location: P1-I1/Q2

umount /ift #unmount the multi-path device


smitty rmlv #delete logical volume
varyoffvg vgname #stop the volume group
exportvg vgname #delete the volume group
rmdev –dl hdiskname #delete the disk

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Page 18 / 18


Infortrend VMware Solution – Best Practice

You might also like