Removing Dead Paths And Unusable Path Solaris 9


 
Thread Tools Search this Thread
Operating Systems Solaris Removing Dead Paths And Unusable Path Solaris 9
# 1  
Old 08-01-2011
Removing Dead Paths And Unusable Path Solaris 9

Hi,

One of our Solaris servers was peviously zoned and connected to 2 seperate arrays, one HP and the other EMC. The server is now only connected to the EMC. The sever has x2 single port HBA's.
When running cfgadm I see the following:

[
Code:
 
root@qwicprod /dev/rdsk]# cfgadm -al
Ap_Id Type Receptacle Occupant Condition
c0 fc-private connected configured unknown
c0::21000014c3503afe disk connected configured unknown
c0::500000e01097a811 disk connected configured unknown
c1 scsi-bus connected configured unknown
c1::dsk/c1t0d0 CD-ROM connected configured unknown
c2 fc-fabric connected configured unknown
c2::500601623b202f83 disk connected configured unknown <--- EMC
c2::5006016b3b202f83 disk connected configured unknown <--- EMC
c3 fc-fabric connected configured unknown
c3::50001fe15000de39 disk connected configured unusable <--- HP - don't know why it is picking this up
c3::50001fe15000de3b disk connected configured unusable <--- HP
c3::50001fe15000de3d disk connected configured unusable <--- HP
c3::50001fe15000de3f disk connected configured unusable <--- HP
c3::500601633b202f83 disk connected configured unknown <--- EMC
c3::5006016a3b202f83 disk connected configured unusable <--- EMC CX4BMC1_spa2_zone

I have checked the fibre switches and the server has been completely de-zoned from the HP array. We are also using powerpath which does not detect any dead paths. ie /etc/powermt config, /etc/powermt check and /etc/powermt dispaly dev=all. I have also noticed that when running format I see:

Code:
 
18. c3t50001FE15000DE3Bd110 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,6e
      19. c3t50001FE15000DE3Bd111 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,6f
      20. c3t50001FE15000DE3Bd120 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,78
      21. c3t50001FE15000DE3Bd121 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,79
      22. c3t50001FE15000DE3Bd130 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,82
      23. c3t50001FE15000DE3Bd131 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3b,83
      24. c3t50001FE15000DE3Dd110 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3d,6e
      25. c3t50001FE15000DE3Dd111 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3d,6f
      26. c3t50001FE15000DE3Dd120 <drive not available>
          /pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w50001fe15000de3d,78
      27. c3t50001FE15000DE3Dd121 <drive not available>
truncated

Would using cfgadm to unconfigure be enough or is there something else that needs to run to clear up?

Also noticed that one of the paths connected to the EMC is showing unusable. Luxadm reports that all paths are good.

c3::5006016a3b202f83 disk connected configured unusable <--- EMC CX4BMC1_spa2_zone

Code:
 
[root@qwicprod /dev/rdsk]# luxadm -e port
Found path to 3 HBA ports
/devices/pci@8,600000/SUNW,qlc@1/fp@0,0:devctl CONNECTED
/devices/pci@8,600000/SUNW,qlc@2/fp@0,0:devctl CONNECTED
/devices/pci@9,600000/SUNW,qlc@2/fp@0,0:devctl CONNECTED
[root@qwicprod /dev/rdsk]# luxadm -e dump_map /devices/pci@8,600000/SUNW,qlc@2/fp@0,0:devctl
Pos Port_ID Hard_Addr Port WWN Node WWN Type
0 b1a00 0 500601633b202f83 50060160bb202f83 0x0 (Disk device)
1 b1b00 0 5006016a3b202f83 50060160bb202f83 0x0 (Disk device)
2 c0900 0 210000e08b90318d 200000e08b90318d 0x1f (Unknown Type,Host Bus Adapter)
[root@qwicprod /dev/rdsk]# luxadm -e dump_map /devices/pci@8,600000/SUNW,qlc@1/fp@0,0:devctl
Pos Port_ID Hard_Addr Port WWN Node WWN Type
0 11a00 0 500601623b202f83 50060160bb202f83 0x0 (Disk device)
1 11b00 0 5006016b3b202f83 50060160bb202f83 0x0 (Disk device)
2 21700 0 2100001b3281f2de 2000001b3281f2de 0x1f (Unknown Type,Host Bus Adapter)
 
[root@qwicprod /dev/rdsk]# luxadm display /dev/rdsk/c3t5006016A3B202F83d6s2 DEVICE PROPERTIES for disk: /dev/rdsk/c3t5006016A3B202F83d6s2
Vendor: DGC
Product ID: RAID 5
Revision: 0430
Serial Num: FCNCX0952006
Unformatted capacity: 51200.000 MBytes
Read Cache: Enabled
Minimum prefetch: 0x0
Maximum prefetch: 0x0
Device Type: Disk device
Path(s):
/dev/rdsk/c3t5006016A3B202F83d6s2
/devices/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w5006016a3b202f83,6:c,raw
LUN path port WWN: 5006016a3b202f83
Host controller port WWN: 210000e08b90318d
Path status: O.K. <-------------------------------------------- looks good
/dev/rdsk/c2t5006016B3B202F83d6s2
/devices/pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w5006016b3b202f83,6:c,raw
LUN path port WWN: 5006016b3b202f83
Host controller port WWN: 2100001b3281f2de
Path status: O.K.
/dev/rdsk/c2t500601623B202F83d6s2
/devices/pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w500601623b202f83,6:c,raw
LUN path port WWN: 500601623b202f83
Host controller port WWN: 2100001b3281f2de
Path status: O.K.
/dev/rdsk/c3t500601633B202F83d6s2
/devices/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w500601633b202f83,6:c,raw
LUN path port WWN: 500601633b202f83
Host controller port WWN: 210000e08b90318d
Path status: O.K.
 
[root@qwicprod /dev/rdsk]# /etc/powermt display Symmetrix logical device count=0 CLARiiON logical device count=8 Hitachi logical device count=0 Invista logical device count=0 HP xp logical device count=0 Ess logical device count=0 ==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
3073 pci@8,600000/SUNW,qlc@1/fp@0,0 optimal 16 0 - 2 0
3074 pci@8,600000/SUNW,qlc@2/fp@0,0 optimal 16 0 - 1 21 <---- errors
 
[root@qwicprod /dev/rdsk]# /etc/powermt display paths Symmetrix logical device count=0 ==============================================================================
----- Host Bus Adapters --------- ------ Storage System ----- - I/O Paths -
### HW Path ID Interface Total Dead
==============================================================================
CLARiiON logical device count=8
==============================================================================
----- Host Bus Adapters --------- ------ Storage System ----- - I/O Paths -
### HW Path ID Interface Total Dead
==============================================================================
3073 pci@8,600000/SUNW,qlc@1/fp@0,0 FCNCX095200695 SP A2 8 0
3073 pci@8,600000/SUNW,qlc@1/fp@0,0 FCNCX095200695 SP B3 8 0
3074 pci@8,600000/SUNW,qlc@2/fp@0,0 FCNCX095200695 SP A3 8 0
3074 pci@8,600000/SUNW,qlc@2/fp@0,0 FCNCX095200695 SP B2 8 0
[root@qwicprod /dev/rdsk]# /etc/powermt display port_mode
Storage class = Symmetrix
==============================================================================
----------- Storage System --------------- -- I/O Paths -- --- Stats ---
ID Interface Wt_Q Total Dead Q-IOs Mode
==============================================================================
Storage class = CLARiiON
==============================================================================
----------- Storage System --------------- -- I/O Paths -- --- Stats ---
ID Interface Wt_Q Total Dead Q-IOs Mode
==============================================================================
FCNCX095200695 SP A2 256 8 0 0 Enabled
FCNCX095200695 SP B3 256 8 0 0 Enabled
FCNCX095200695 SP A3 256 8 0 0 Enabled
FCNCX095200695 SP B2 256 8 0 0 Enabled

Could this path be reporting unusable due to the other dead paths still configured on the HP array.
# 2  
Old 08-01-2011
have you tried 'devfsadm -C' to rebuild/clean-up your /dev tree?
# 3  
Old 08-01-2011
Hi Yeaboem

Yes I have tried to clean up using devfsadm -C but it makes no difference
# 4  
Old 08-01-2011
ah, yes. you will have to cfgadm -c unconfigure ... the stale occupants first, then devfsadm -C to clean /dev. After you've done that, the format command will show only your active disks/luns.
# 5  
Old 08-02-2011
Ok Yeaboem thanks for confirming this. Is this safe to do on critical production system cfgadm -c unconfigure c3::50001fe15000de39
# 6  
Old 08-02-2011
the answer is... Maybe?

Have you configured multipathing using both HBAs and pathways to your luns? I am concerned that issuing the cfgadm -c unconfigure command may result in brief intervals where activity is suspended on that HBA. I know for certain that 'cfgadm -c insert/remove' do interrupt traffic thru the HBA, I just don't remember perfectly if the 'configure/unconfigure' commands do, also. If you have multipathing configured, this is not a problem, as your luns would be accessed by an alternate path. My sense of it is that the configure/unconfigure should be safe on a running system.
# 7  
Old 08-02-2011
Yes we have x2 single port HBA's with multipathing configured. I will do the unconfigure during a quiet period. Thanks

Code:
 
[root@qwicprod /dev/rdsk]# luxadm -e dump_map /devices/pci@8,600000/SUNW,qlc@2/fp@0,0:devctl
Pos Port_ID Hard_Addr Port WWN Node WWN Type
0 b1a00 0 500601633b202f83 50060160bb202f83 0x0 (Disk device)
1 b1b00 0 5006016a3b202f83 50060160bb202f83 0x0 (Disk device)
2 c0900 0 210000e08b90318d 200000e08b90318d 0x1f (Unknown Type,Host Bus Adapter)
[root@qwicprod /dev/rdsk]# luxadm -e dump_map /devices/pci@8,600000/SUNW,qlc@1/fp@0,0:devctl
Pos Port_ID Hard_Addr Port WWN Node WWN Type
0 11a00 0 500601623b202f83 50060160bb202f83 0x0 (Disk device)
1 11b00 0 5006016b3b202f83 50060160bb202f83 0x0 (Disk device)
2 21700 0 2100001b3281f2de 2000001b3281f2de 0x1f (Unknown Type,Host Bus Adapter)

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Solaris FIND: Exclude Specific Paths

Using Sol 10 + KSH. I need to run a find command on the whole system "/" and exclude a bunch of explicit directories and files that may or may not be on each system. I cannot use the -name because i dont want to exclude all dirs named just specific paths. -path/-wholename is not an option... (2 Replies)
Discussion started by: nitrobass24
2 Replies

2. UNIX for Dummies Questions & Answers

Configure $PATH in /.bash_profile or /etc/paths?

Hi - I am trying to include the MSQ.exe that I have downloaded for the sake of learning. My current /.bash_profile file reads: PATH=/Library/Frameworks/Python.framework/Versions/3.1/bin:/Applications/XAMPP/xamppfiles/bin:$PATH export PATH ----------------------------------- ... (4 Replies)
Discussion started by: Alexander4444
4 Replies

3. UNIX for Dummies Questions & Answers

Removing path name from list of file names

I have this piece of code printf '%s\n' $pth*.msf | tr ' ' '\n' | sort -t '-' -k7 -k6r \ | awk -F- '{c=($6$7!=p&&FNR!=1)?ORS:"";p=$6$7}{printf("%c%s\n",c,$0)}' When I run it I get /home/chrisd/tatsh/branches/terr0.50/darwin/n02-z30-dsr65-terr0.50-dc0.002-8x6drw-csq.msf... (8 Replies)
Discussion started by: kristinu
8 Replies

4. Shell Programming and Scripting

Solaris Server dectects EMC dead path and send mail immediately

taus-itcapp1#powermt display dev=all Pseudo name=emcpower0a CLARiiON ID=APM00105201788 Logical device ID=60060160B2202B001094F0E0AF5CE011 state=alive; policy=CLAROpt; priority=0; queued-IOs=0; Owner: default=SP A, current=SP A Array failover mode: 1 ... (6 Replies)
Discussion started by: orafup
6 Replies

5. Red Hat

Yum is unusable

How do I delete all of my repo information and start completely fresh? (8 Replies)
Discussion started by: cokedude
8 Replies

6. Shell Programming and Scripting

SED: Removing Filenames From Paths

I'm using a script with a lot of SED commands, in conjunction with grep, cut, etc. I've come up against a wall with a particular road block: I output a file from an SVN registry that gives me a list of files. The list consists of a variable number of lines that contain a path/file. The paths... (4 Replies)
Discussion started by: Brusimm
4 Replies

7. Solaris

Unavailable/Slow Network Paths in $PATH

At work, I'm in a Solaris environment working with csh, and $PATH is populated with anywhere between 10 and 20 entries. Last week, every command I issued (even "ls") took several seconds, if not an entire minute, to run. Once I moved "/home/sybase/bin" to the end of $PATH, certain commands... (2 Replies)
Discussion started by: acheong87
2 Replies

8. Solaris

How to add new paths to $PATH

Hi all, I downloaded a tarball of coreutils .... extracted only to find out that i had to build it... But when i executed ./configure, this is what i got checking build system type... i386-pc-solaris2.11 checking host system type... i386-pc-solaris2.11 configure: autobuild project... GNU... (2 Replies)
Discussion started by: wrapster
2 Replies

9. HP-UX

removing library path

Hi Everyone I have written an installer dependant on several shared libraries. I am attempting to strip the full path from these dependant libraries using the chatr command via a script file but am having no success. Running ldd on the intaller exe fails with the following error. Cant open... (4 Replies)
Discussion started by: C3000
4 Replies

10. Shell Programming and Scripting

Removing duplicate files from list with different path

I have a list which contains all the jar files shipped with the product I am involved with. Now, in this list I have some jar files which appear again and again. But these jar files are present in different folders. My input file looks like this /path/1/to a.jar /path/2/to a.jar /path/1/to... (10 Replies)
Discussion started by: vino
10 Replies
Login or Register to Ask a Question