VxVM not able to see new disk

 
Thread Tools Search this Thread
Homework and Emergencies Emergency UNIX and Linux Support VxVM not able to see new disk
# 1  
Old 01-08-2013
VxVM not able to see new disk

I have VxVM 5.1 running on Solaris-10. I have to increase a application file-system and storage team gave me a lun. After scanning scsi port by cfgadm, I can see them in format output. I labelled it, but I am not able to see them in "vxdisk list".
I already tried commands -->
HTML Code:
vxdctl enable
vxconfigd -k
vxdisk scandisks
query can see new disk
HTML Code:
root@pr_ora_db16:/# prtvtoc /dev/rdsk/c3t5006048AD5315569d1245s2
* /dev/rdsk/c3t5006048AD5315569d1245s2 partition map
*
* Dimensions:
*     512 bytes/sector
*     128 sectors/track
*      15 tracks/cylinder
*    1920 sectors/cylinder
*    9525 cylinders
*    9523 accessible cylinders
*
* Flags:
*   1: unmountable
*  10: read-only
*
*                          First     Sector    Last
* Partition  Tag  Flags    Sector     Count    Sector  Mount Directory
       0      2    00          0    263040    263039
       1      3    01     263040    263040    526079
       2      5    01          0  18284160  18284159
       6      4    00     526080  17758080  18284159
root@pr_ora_db16:/# /usr/lib/vxvm/diag.d/vxdmpinq /dev/rdsk/c3t5006048AD5315569d1245s2
Inquiry for /dev/rdsk/c3t5006048AD5315569d1245s2, evpd 0x0, page code 0x0
        Vendor id                        : EMC
        Product id                       : SYMMETRIX
        Revision                         : 5773
        Serial Number                    : 17!"t000Q
root@pr_ora_db16:/#
root@pr_ora_db16:/# vxconfigd -k
pp_claim_device: Could not get device number for /dev/rdsk/emcpower8
VxVM vxconfigd ERROR V-5-1-8646 Error in claiming /dev/rdsk/emcpower8: No such file or directory
root@pr_ora_db16:/# ls -l /dev/rdsk/emcpower8
lrwxrwxrwx   1 root     root          34 Jan  8 21:31 /dev/rdsk/emcpower8 -> ../../devices/pseudo/emcp@8:wd,raw
Please suggest.

Last edited by solaris_1977; 01-08-2013 at 05:43 PM..
# 2  
Old 01-08-2013
Hi Solaris_1977, this certainly looks like the VxVM is having issues claiming the new LUN. But the why behind that isn't clear here unfortunately. We would need to work with you to get some more information to help find the cause - are you able to open a support case with us?
# 3  
Old 01-08-2013
Hi,

I think that this could be related to 3 points

1) Compatibiliy betwen the VXVM version and powerpath version
2) The HostLun number used by to map the emc device to Port (in this case d1245) is very high for me
3) Before to this, exist another device named emcpower8 that was linked to another device and the VXVM internal data have reference to another disk, please review the files in /etc/vx/ to search old references to emcpower8

Is very strange for me that the Serial number showed in the vxdmpinq outout was

Code:
17!"t000Q

Could you paste the powermt display for your device?
In reference
# 4  
Old 01-10-2013
It seems that device paths were messed up, so did following.
Quote:
mv /etc/vx/array.info /etc/vx/array.info.old
mv /etc/vx/disk.info /etc/vx/disk.info.old
rm /dev/vx/dmp/*
rm /dev/vx/rdmp/*
vxconfigd -k
And that panicked my production box :-( Fortunately it was in cluster so my life was saved. After reboot, new lun was visible in VxVM as well.
# 5  
Old 01-23-2013
Solaris_1977

Let me explain new LUNS and the discovery from the VxVM side ....

When the OS discovers a new LUN, there is a new daemon , called ESD (Event Source Daemon) that tries to do the "windows" "plug&play" bit.

Once a new LUN is discovered , ESD then broadcasts to all registered software (like EMCP and VxVM) that there is a new LUN.

Now, here comes the problem.

VxVM and EMCP sees the new LUN at the same time.
EMCP starts creating a new powerdevice for it, and VxVM creates a new disk record for it.

When EMC powerpath created the device, it again sends a message to ESD and ESD then broadcasts this to the other registered software (VxVM).

VxVM now tries to "link" the power device with the disk ...
The reason is that PowerPath already does DMP, and if VxVM also does DMP, you get double the work and double the time for IO.... VxVM does NOT do DMP to powerdevices to eliminate this double work. So, VxVM has to make the "link" between the disk and the power device .....

Now comes the problem.

This all happens so fast, because in the process, VxVM also sends out a ESD broadcast saying that it knows about a new disk and it can do DMP for it (which EMCP picks up and checks and .....)

OK, so how can you solve this ?

The best way is to stop VxVM from "linking" into ESD.
There is a process called "vxesd" (do a "ps" to see)

If you call support, they will tell you to stop VxVM ESD by looking at this link ....
(explains what I did above in more detail and gives the commands to stop it running)


(oops, can not yet post links ... so go to google and search for symanetc and TECH72540)




When the machine rebooted, the device discovery was done by the OS, then PowerPath and then VxVM (correct order), and as such eliminated the problems.

The steps that you followed (scandisks ...) is 100% correct, and should be followed once you have stopped vxesd from running again.

If you do have further questions, please feel free to ask, or if you want me to look at data on your specific machine, let me know
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. HP-UX

Removing a VxVM disk from a Disk Group

Hello all, So I made a rookie mistake today. I forgot to remove my disk from my disk group, before running the following command:for i in `ioscan -fnN | awk /NO/'{print $3}'` do rmsf -H $i done I am trying to run the following command, but not having any luck obviously:vxdg -g dgvol1 rmdisk... (0 Replies)
Discussion started by: mrkejames2
0 Replies

2. Solaris

Unable to boot from mirror disk on x86 server configured under VxVM

Hi, Can you help me on booting x86 server configured under VxVM. Server boots fine normally from both the disks but if I try to boot server from mirror disk without starting veritas, then it does not boot. vxplex -g rootdg dis var-02 vxplex -g rootdg dis swapvol-02 vxplex -g rootdg dis... (2 Replies)
Discussion started by: milindphanse604
2 Replies

3. Solaris

Lost Root Password on VXVM Encapsulated Root Disk

Hi All Hope it's okay to post on this sub-forum, couldn't find a better place I've got a 480R running solaris 8 with veritas volume manager managing all filesystems, including an encapsulated root disk (I believe the root disk is encapsulated as one of the root mirror disks has an entry under... (1 Reply)
Discussion started by: sunnyd76
1 Replies

4. Solaris

vxvm

hi all, how can we check whether vxvm is installed in our system or not in solaris? Thanks in advance dinu (4 Replies)
Discussion started by: dinu
4 Replies

5. Solaris

vxvm root disk booting problem - solved with boot -a. How?

Hi All, We had a Sun Netra T1 go down the other day, the root disk was mirrored using vxvm. Upon boot from either disk, we had the following error appear: WARNING: Error writing ufs log state WARNING: ufs log for / changed state to Error WARNING: Please umount(1M) / and run... (4 Replies)
Discussion started by: badoshi
4 Replies

6. Solaris

( VxVM ) How to add the removed disk back to previous disk group

Previously , i remove the disk by #vxdg -g testdg -k rmdisk testdg02 But i got error when i -k adddisk bash-2.03# vxdisk list DEVICE TYPE DISK GROUP STATUS c0t0d0s2 auto:none - - online invalid c0t1d0s2 auto:none ... (1 Reply)
Discussion started by: waibabe
1 Replies

7. Solaris

Migrate VxVM boot disks to higher capacity disk

Hi, Im getting a downtime of 4 hrs to do porting of bootdisks. Currently, the system is running on Sf4800. 2 internal disk 36G connected to a SE3510 storage. We're getting 72G disks and we want to restore the OS from the current 36G to the 72G disk. System is under veritas volume manager ctrl.... (4 Replies)
Discussion started by: incredible
4 Replies

8. Solaris

How to add disk into Striped Volume VxVM

VxVM: How to add one more disk into v08 the stripe should change from 7/128 to 8/128 v v08 - ENABLED ACTIVE 8954292224 SELECT v08-01 fsgen pl v08-01 v08 ENABLED ACTIVE 8954292480 STRIPE 7/128 RW sd bkpdg35-01 v08-01 bkpdg35 17216 ... (0 Replies)
Discussion started by: geoffry
0 Replies

9. UNIX for Advanced & Expert Users

VxVM disk/lun grow

hi, i have a volume on a LUN of an EMC-storage and i need to increase the size. i could increase the size of the LUN on the EMC, i could increase the size of the disk for solaris, but how can i tell the veritas volume manager that the disk is larger now? what i've done: 1. LUN on EMC 2.... (3 Replies)
Discussion started by: pressy
3 Replies

10. Solaris

VxVM

All solaris rescue gurus out there .... I've a Solaris 2.6 E450 on which my sysadmin guy has deleted every file (not sub-directories) from the /etc directory. The machine is (was) running Vxvm with the root volume encapsulated. I've tried booting from CDROM, mounting the root volume... (3 Replies)
Discussion started by: andy11983
3 Replies
Login or Register to Ask a Question