Login or Register to Ask a Question and Join Our Community


AIX

SAN Disk Appearing double in AIX

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems AIX SAN Disk Appearing double in AIX
# 1  
Old 08-14-2013
SAN Disk Appearing double in AIX
Hello Folks,

I have directly connected my IBM Pseries AIX machine to SAN Storage

I have a dual port Fibre Channel Adapter
Connected both fiber ports to SAN Box IBM DS4500 Controller A & Controller B

Using IBM DS storage manager client 10 -- created one logical disk and assigned to a default group

on my AIX machine

Code:
# oslevel -s
6100-05-00-0000

# lsdev -Cc disk
hdisk8 Available 0A-08-02     MPIO Other DS4K Array Disk
hdisk9 Available 0A-08-02     MPIO Other DS4K Array Disk

# lsdev -Cc adapter

fcs0      Available 0A-08 FC Adapter
fcs1      Available 0A-09 FC Adapter

I see two disks in my AIX machine HDISK8 and HDISK9 is same disk but appearing twice . I have disconnected one cable from the controller , deleted hdisk9 and ran cfgmgr , I don't see hdisk9


Do I need to have SAN Switch inorder for it to appear only once or is there any other configuration which I am missing.... ?

THanks.
# 2  
Old 08-14-2013
Hmmm,
Looking at the output it seems both the disk are seen by fcs0, can you paste the output of
Code:
lspath -H

Check the setting on interface of your fibre adapter.
Code:
lsattr -El fscsiX, where x=0 and 1

Is dynamic tracking set to yes?

Also, I see your AIX OS version is 6.1TL05, you are at basic level of TL05, problem like yours may have been resolved in higher TL or SP levels, I recommend upgrade your OS as well.

Can you paste the output of
Code:
lspv

If none appears in 2nd field, then run
Code:
chdev -l hdisk8 -a pv=yes, and same to hdisk9

Do you see the matching PVID no?
# 3  
Old 08-14-2013
Smilie I am jealous - your own SAN!
# 4  
Old 08-15-2013
Smilie no, i got this test san box for testing oracle applications before deploying rman backup.

ok.

Port 0 = FCS0 of Dual Port Fibre Card connected to Controller A
Port 1 = FCS1 of Dual Port Fibre Card connected to Controller B

DS Storage Client Software, in mappings, I can see only one Default Group to which I assigned one disk.



Code:
# lspath -H
status  name   parent

Enabled hdisk8 fscsi0
Enabled dac0   fscsi0
Enabled hdisk9 fscsi1
Enabled dac1   fscsi1

# lsattr -El fscsi0
attach       al           How this adapter is CONNECTED         False
dyntrk       no           Dynamic Tracking of FC Devices        True
fc_err_recov delayed_fail FC Fabric Event Error RECOVERY Policy True
scsi_id      0x1          Adapter SCSI ID                       False
sw_fc_class  3            FC Class for Fabric                   True

# lsattr -El fscsi1
attach       al           How this adapter is CONNECTED         False
dyntrk       no           Dynamic Tracking of FC Devices        True
fc_err_recov delayed_fail FC Fabric Event Error RECOVERY Policy True
scsi_id      0x1          Adapter SCSI ID                       False
sw_fc_class  3            FC Class for Fabric                   True

# lspv

hdisk8          none                                None
hdisk9          none                                None


# chdev -l hdisk8 -a pv=yes
hdisk8 changed
# chdev -l hdisk9 -a pv=yes
hdisk8 changed

# lspv

hdisk8          00c7780e803680fd                    None
hdisk9          00c7780e803680fd                    None

# lscfg -vl fcs0
  fcs0             U787B.001.DNW3313-P1-C1-T1  FC Adapter

        Part Number.................03N5029
        EC Level....................A
        Serial Number...............1F7050C060
        Manufacturer................001F
        Customer Card ID Number.....5759
        FRU Number.................. 03N5029
        Device Specific.(ZM)........3
        Network Address.............10000000C9612EFA
        ROS Level and ID............02C82774
        Device Specific.(Z0)........1036406D
        Device Specific.(Z1)........00000000
        Device Specific.(Z2)........00000000
        Device Specific.(Z3)........03000909
        Device Specific.(Z4)........FFC01231
        Device Specific.(Z5)........02C82774
        Device Specific.(Z6)........06C12715
        Device Specific.(Z7)........07C12774
        Device Specific.(Z8)........20000000C9612EFA
        Device Specific.(Z9)........BS2.71X4
        Device Specific.(ZA)........B1F2.70A5
        Device Specific.(ZB)........B2F2.71X4
        Device Specific.(ZC)........00000000
        Hardware Location Code......U787B.001.DNW3313-P1-C1-T1


# lscfg -vl fcs1
  fcs1             U787B.001.DNW3313-P1-C1-T2  FC Adapter

        Part Number.................03N5029
        EC Level....................A
        Serial Number...............1F7050C060
        Manufacturer................001F
        Customer Card ID Number.....5759
        FRU Number.................. 03N5029
        Device Specific.(ZM)........3
        Network Address.............10000000C9612EF9
        ROS Level and ID............02C82774
        Device Specific.(Z0)........1036406D
        Device Specific.(Z1)........00000000
        Device Specific.(Z2)........00000000
        Device Specific.(Z3)........03000909
        Device Specific.(Z4)........FFC01231
        Device Specific.(Z5)........02C82774
        Device Specific.(Z6)........06C12715
        Device Specific.(Z7)........07C12774
        Device Specific.(Z8)........20000000C9612EF9
        Device Specific.(Z9)........BS2.71X4
        Device Specific.(ZA)........B1F2.70A5
        Device Specific.(ZB)........B2F2.71X4
        Device Specific.(ZC)........00000000
        Hardware Location Code......U787B.001.DNW3313-P1-C1-T2

# 5  
Old 08-15-2013
What version of AIX are you running? Have you installed the appropriate software to merge the disks together?

We have a 5.1 system that blends together two or more hdisks with the same serial number as a vpath. We use the command lsvpcfg to display what is matched up. We then add the vpath device to the volume group.

Just a snippet:-
Code:
RBATTE1 @ /usr/home/RBATTE1>lsvpcfg
vpath1 (Avail pv db1vg02) 50715182 = hdisk688 (Avail ) hdisk906 (Avail )
vpath2 (Avail pv db1vg02) 50815182 = hdisk689 (Avail ) hdisk907 (Avail )
vpath3 (Avail pv db1vg02) 50915182 = hdisk690 (Avail ) hdisk908 (Avail )
etc.
etc.

RBATTE1 @ /usr/home/RBATTE1>lsvg -p db1vg02 
db1vg02:
PV_NAME           PV STATE          TOTAL PPs   FREE PPs    FREE DISTRIBUTION
vpath1            active            521         3           00..00..00..00..03
vpath2            active            521         1           00..00..00..00..01
vpath3            active            521         1           00..00..00..00..01
vpath4            active            521         1           00..00..00..00..01
vpath5            active            521         1           00..00..00..00..01
vpath6            active            521         1           00..00..00..00..01
vpath7            active            521         1           00..00..00..00..01


If you are newer, then you would need MPIO, which I'm not familiar with, but I think that would blend multiple-path devices into hdisks, so it would seem more normal.


I would also recommend splitting your fibre connections. If you lose a path and feel that you have to replace the fibre card, then you are looking at downtime (well all SAN disks off-line anyway) to do so. If it really is for testing, then splitting would still be a good idea as you could pull a cable and see how it all reacts. Smilie



Robin
Liverpool/Blackburn
UK
Last edited by rbatte1; 08-15-2013 at 12:23 PM.. Reason: Added the snippet of output
# 6  
Old 08-15-2013
Ok,
Have you install the ODM file set for type of storage? It's a native software of aix to detect type of disk.

I am not sure, if you company has bought MPIO software, its a licensed product (its free with v7000 storage), with DS4000 series, you better run by your manager. If yes you will install the devices.sddpcm file set for MPIO.

Set the dynamic tracking to yes and fc_err_recov to fast_fail, if your rootvg is local disk or vscsi, you can run the command without -P flag. else use -P flag and reboot the box for the changes to be affective.
# 7  
Old 08-15-2013
I am using VIOS Version
Code:
$ ioslevel
2.1.3.10-FP23

$ oem_setup_env
#
# oslevel -s
6100-05-00-0000

so, in VIOS as far as I know there is no SDD

I do have the MPIO drivers installed which came with the VIOS

Code:
# lsdev -Cc disk
hdisk0 Available 09-08-00-3,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 09-08-00-4,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 09-08-00-5,0 16 Bit LVD SCSI Disk Drive
hdisk3 Available 09-08-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk4 Available 09-08-01-3,0 16 Bit LVD SCSI Disk Drive
hdisk5 Available 09-08-01-4,0 16 Bit LVD SCSI Disk Drive
hdisk6 Available 09-08-01-5,0 16 Bit LVD SCSI Disk Drive
hdisk7 Available 09-08-01-8,0 16 Bit LVD SCSI Disk Drive
hdisk8 Available 0A-08-02     MPIO Other DS4K Array Disk
hdisk9 Available 0A-09-02     MPIO Other DS4K Array Disk
#
# lsvpcfg
ksh: lsvpcfg:  not found.



# lslpp -l | grep mpio
  devices.common.IBM.mpio.rte
  devices.common.IBM.mpio.rte

# lslpp -lc | grep mpio
/usr/lib/objrepos:devices.common.IBM.mpio.rte:6.1.5.0::COMMITTED:I:MPIO Disk Path Control Module :
/etc/objrepos:devices.common.IBM.mpio.rte:6.1.5.0::COMMITTED:I:MPIO Disk Path Control Module :


# manage_disk_drivers -l
Device           Present Driver     Driver Options
2810XIV          AIX_AAPCM          AIX_AAPCM,AIX_non_MPIO
DS4100           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS4200           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS4300           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS4500           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS4700           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS4800           AIX_APPCM          AIX_APPCM,AIX_fcparray
DS3950           AIX_APPCM          AIX_APPCM
DS5020           AIX_APPCM          AIX_APPCM
DS5100           AIX_APPCM          AIX_APPCM
DS3500           AIX_APPCM          AIX_APPCM

# mpio_get_config -Av
Frame id 0:
    Storage Subsystem worldwide name: 60ab80016a13700005127aff6
    Controller count: 2
    Partition count: 2
    Partition 0:
    Storage Subsystem Name = ''
        hdisk      LUN #   Ownership          User Label
        hdisk8         4   A (preferred)      testdrive
    Partition 1:
        hdisk      LUN #   Ownership          User Label
        hdisk9         4   B (non-preferred)  testdrive


# lsattr -El hdisk8 | grep fail
algorithm       fail_over                                               Algorithm                        True

# lsattr -El hdisk8 | grep  reserve_policy
reserve_policy  single_path                                             Reserve Policy                   True


dac0 Available 0A-08-02 DS3/4K PCM User Interface
dac1 Available 0A-09-02 DS3/4K PCM User Interface
hdisk0 Available 09-08-00-3,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 09-08-00-4,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 09-08-00-5,0 16 Bit LVD SCSI Disk Drive
hdisk3 Available 09-08-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk4 Available 09-08-01-3,0 16 Bit LVD SCSI Disk Drive
hdisk5 Available 09-08-01-4,0 16 Bit LVD SCSI Disk Drive
hdisk6 Available 09-08-01-5,0 16 Bit LVD SCSI Disk Drive
hdisk7 Available 09-08-01-8,0 16 Bit LVD SCSI Disk Drive
hdisk8 Available 0A-08-02 MPIO Other DS4K Array Disk
hdisk9 Available 0A-09-02 MPIO Other DS4K Array Disk

As I explained earlier
Fiber Port 0 is connected to SAN Controller A
Fiber Port 1 is connected to SAN Controller B
There is no SAN Switch in between
and it is direct connection

If both Fiber ports are connected to both controllers then I see duplicated disks.


Do I need to download drivers for IBM FastT 1722 - 60U and it should be appear as 1722-600 (600) Disk Array Device ?

or something else need to be done...

Appreciate your help and feedback...
Last edited by filosophizer; 08-15-2013 at 01:39 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

SAN vs. Local disk.

I am in the market looking to purchase a new E950 server and I am trying to decide between using local SSD drives or SSD based SAN. The application that will be running on this server is read-intensive so I am looking for the most optimal configuration to support this application. There are no... (2 Replies)
Discussion started by: ikx
2 Replies

2. AIX

San disk appearing double in old AIX

Hi guys, :) I'm a studient in IT field (AIX) I'm trying to map a LUN from a SAN (DS3400) to an AIX server (5300-04-00) I know there is no MPIO on this version of AIX, and i see double my LUN from the SAN root@localhost # lscfg | grep hdisk + hdisk7 ... (13 Replies)
Discussion started by: Tharsan
13 Replies

3. AIX

SAN DISK raid level in AIX

Hello All, Our servers having emc clarion for the data disks. Is that possible to see those san disks raid level from AIX ? Am having AIX 6.1 and EMC clarion 5.5. Regards, Gowtham.G (3 Replies)
Discussion started by: gowthamakanthan
3 Replies

4. Solaris

I/O Error on SAN Disk

Hi, I have a production solaris 10 SPARC system (portal). Yesterday legato/Networker gave an I/O Error on one of the files on its SAN mounted disk. I went to that particular file on the system, did an ls and it showed the file. However, ls -l did not work and it said IO error. ... (6 Replies)
Discussion started by: Mack1982
6 Replies

5. UNIX for Dummies Questions & Answers

SAN and Disk I/O ... do we care?

Hi all, My main function is as a DBA. Another person manages the server and the SAN. I just want to know if I should be worried about high disk I/O or is it irrelevant as the I/O "load balancing" will be "taken care" of by the SAN? For example, I have hdisk1-5 and I can see that there are... (2 Replies)
Discussion started by: newbie_01
2 Replies

6. Filesystems, Disks and Memory

SAN Disk w/o Cluster

Scenario: I've got 2 M5000's connected to a 9985 SAN storage array. I have configured the SAN disks with stmsboot, format and newfs. I can access the same SAN space from both systems. I have created files from both systems on the SAN space. Question: Why can't I see the file created... (3 Replies)
Discussion started by: bluescreen
3 Replies

7. Solaris

SAN disk failure

hi all, have a solaris 9 OS and a SAN disk which used to work fine is not getting picked up by my machine. can anyone point out things to check in order to troubleshoot this ?? thanks in advance. (3 Replies)
Discussion started by: cesarNZ
3 Replies

8. AIX

AIX 5.2/5.3 - rootvg on SAN disk - pros and cons

We are considering a DR strategy of booting AIX 5.3 and 5.3 logical partitions from EMC Symmetrix SAN disks, so that we can replicate via SRDF to a recovery site. Has anyone tried configuring AIX 5.x systems to boot from SAN disk? If so, can you provide any information on the pros and cons of... (6 Replies)
Discussion started by: jjgarrot
6 Replies

9. AIX

hard disk and san

Hello everyone I got several aix boxes with aix 5.3 I got a ibm san ds4500 My question is How can I do a match between my disks on aix and the san? I try to do a match with the LUN but for example. In my san I got several 1 LUN and on one of my aix box I got this If I type lscfg... (4 Replies)
Discussion started by: lo-lp-kl
4 Replies

10. AIX

AIX disk less with SAN

Hi All, I have mirrored SAN volume on my B80 rootvg. Can I just remove the mirror and "Remove a P V from a V G" and it will be a diskless AIX? Is that going to boot on SAN rootvg volume? Thanks in advance, itik (3 Replies)
Discussion started by: itik
3 Replies
Login or Register to Ask a Question