Login or Register to Ask a Question and Join Our Community


Red Hat

OEL5.5 hot add disk

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems Linux Red Hat OEL5.5 hot add disk
# 1  
Old 01-23-2012
OEL5.5 hot add disk
Hi All,

I have an issue when trying to hot-add a SAN disk to an oracle enterprise linux 5.5 server.

The storage array we are using is an HP 24000, we have no issues with the disk usage for both ASM and LVM setup, it is just a simple matter of not being able to scan for new disk when it is added without a reboot.

We have tried:
Code:
scan "- - -" > /sys/class/scsi_host/host(0 or 1)/scan

which errors with the following message:
Code:
unexpected response from lun 142, scan aborted

lun 142 happens to be the new added disk.

And also we have found a script called rescan_scsi_bus.sh, this runs successfully but does not add any new scsi devices.

I have a feeling on a reboot the scan is forced while loading the qla2xxx module, however we cannot remove the module and re-add it during server running time as this comes up with a "Fatal: module is in use" error message.

We have also tried to restart the multipathing deamon to see if the disk gets picked up, and also to run xpinfo, neither of which seem to see the disk.

I have raised a call with oracle support and have now been waiting 3 weeks without a response, however if i do get a useful reply i will post it here.

Cheers,
Tom
# 2  
Old 01-23-2012
What does dmesg say?

Also, try with ioscan and modprobe.
# 3  
Old 01-24-2012
hi verdepollo,

dmesg just gives the error message: unexpected response from lun 142, scan aborted

ioscan is not an installed prgram. However i will try this when i can get some resource to do so on a test box (install ioscan, assign some SAN disk and try to add it), which may take a couple of weeks due to the environment we are running, everything even for test environments must go through change control. I actually thought ioscan was just an HP-UX command.

As for modprobe, we tried to take it out and add it back in, which it can't do because it says "Fatal: module is in use" as per my original post Smilie

Any other possibilities would be greatly appreciated, or even a possibility why the scan command doesn't work. I have been told it was a problem for 5.3 distro's and earlier so why should i be having the issue with 5.5?

Cheers,
Tom
# 4  
Old 01-24-2012
This is documentation we have tested and verified in our QA lab, and its known to be working on RHEL 5.5 with a P2000 G3 FC. Its based on the RH online storage guide. It assumes you're using multipathing.

List the disks by typing
multipath -l

This will give you the current host and lun numbers (x:0:0:n, where x is the host number, n is the lun number).
A sample output is below:
Code:
[root@baschinfs01 ~]# multipath -l                                              
mpath14 (3600c0ff000118652f9351f4e01000000) dm-16 HP,P2000 G3 FC                
[size=1.8T][features=1 queue_if_no_path][hwhandler=0][rw]                       
\_ round-robin 0 [prio=0][enabled]                                              
 \_ 2:0:0:6 sdy        65:128 [active][undef]                                   
 \_ 5:0:0:6 sdab       65:176 [active][undef]                                   
\_ round-robin 0 [prio=0][enabled]                                              
 \_ 3:0:0:6 sdz        65:144 [active][undef]                                   
 \_ 4:0:0:6 sdaa       65:160 [active][undef]


Once you've created the lun on the SAN, type (again, where x is the host number, n is the lun)
Code:
echo "0 0 n" > /sys/class/scsi_host/hostX/scan

For each host number that should have access to the lun.

So looking back at our sample it'd be:
Code:
[root@baschinfs01 ~]# echo "0 0 6" > /sys/class/scsi_host/host2/scan            
[root@baschinfs01 ~]# echo "0 0 6" > /sys/class/scsi_host/host3/scan            
[root@baschinfs01 ~]# echo "0 0 6" > /sys/class/scsi_host/host4/scan            
[root@baschinfs01 ~]# echo "0 0 6" > /sys/class/scsi_host/host5/scan

Next type
Code:
multipath
multipath -l

and you should now see the new device. At that point you should be able to add the volume to oracle ASM.

If that doesn't work, you can reference the online storage config docs here:
Online Storage Reconfiguration Guide
# 5  
Old 02-09-2012
Hi msarro,

Sorry for such a long delay on the reply but i have been absolutely bogged down with work on other projects and other BAU that means i haven't had a chance to even log in.

But thanks for your feed back, during the echo command as i showed with my original post we only ever used "- - -". When i get a chance i will try it with the "0 0 lunid" to see if that works. However that may prove difficult to test as there is database installation and development and testing going on across all our current environments, the next chance i get for testing might be within the next 3-4 weeks when we are building 4 new Linux servers so i can only comment on how it works then.

I will send a response on either the sucess or failure when i can.

Cheers,
Tom
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. SuSE

Hot-add memory to SuSE / VMware virtual server

Hi, Here is the issue. Some more memory has been added from vCenter to the virtual machine. From the virtual machine running SuSE 11 SP3. # modprobe acpiphp # modprobe acpi-memhotplug # grep -v online /sys/devices/system/memory/*/state # It looks like there is no offline memory, but free... (1 Reply)
Discussion started by: aixlover
1 Replies

2. Red Hat

Error after first boot OEL5.8

Server Model HP Proliant DL380P, Gen 8 Raid Controller= HP smart Array P420i Operating system Installation OEl5.8 On first boot after OS installation ERROR: Red Hat nash Version 5.119.6 starting -300.10.1.el5uek)' Mounting proc Filesystem Reading all physical volume this may take... (1 Reply)
Discussion started by: sohail Jafferi
1 Replies

3. UNIX for Advanced & Expert Users

Error after first boot OEL5.8

Server Model HP Proliant DL380P, Gen 8 Raid Controller= HP smart Array P420i Operating system Installation OEl5.8 On first boot after OS installation ERROR: Red Hat nash Version 5.119.6 starting -300.10.1.el5uek)’ Mounting proc Filesystem Reading all physical volume this may take a... (0 Replies)
Discussion started by: sohail Jafferi
0 Replies

4. AIX

IBM SAN STORAGE HOT SPARE DISK

Hello, I have DS4000 IBM SAN Storage ( aka FastT Storage ) One of my disks has failed and I had a hot spare disk covering all the arrays. As the disk failed, immediately the hotspare disk took over the failed disk ( see the JPEG in the attachment ) My Question: How can I make the hotspare... (1 Reply)
Discussion started by: filosophizer
1 Replies

5. Red Hat

hot-add disk in oracle enterprise linux 5.5

Hi all, I have an Oracle Enterprise Linux 5.5 server which is a virtual guest on a vSphere host. I have provisioned 500GB disk space from SAN. I then migrated the VM from a 200GB disk onto the new 500GB disk. I then increased the disk space allocated to the VMware to the maximum size of... (7 Replies)
Discussion started by: Tommyk
7 Replies

6. Solaris

Disk Storage Need to Add more Disk

Hi, Anyone can help me, just want to confirm, if possible adding a disk storage that we have a RAWDATA with +ASM in our database. If possible, what would you recommend "workaround used" from us to do and the preparation. And also how long the downtime will take. Our disk continuous to grow,... (0 Replies)
Discussion started by: fpalero
0 Replies

7. AIX

how to hot remove/add a tape

hi all :) i'd like to remove a broken scsi tape device from a system p5 520. it is the only device on the external scsi hookup. then i would like to add a new scsi tape device (same model). is this, and if - how ?, doable without rebooting? (using aix 5.3) best regards, deuter (2 Replies)
Discussion started by: deuter
2 Replies

8. Solaris

( VxVM ) How to add the removed disk back to previous disk group

Previously , i remove the disk by #vxdg -g testdg -k rmdisk testdg02 But i got error when i -k adddisk bash-2.03# vxdisk list DEVICE TYPE DISK GROUP STATUS c0t0d0s2 auto:none - - online invalid c0t1d0s2 auto:none ... (1 Reply)
Discussion started by: waibabe
1 Replies

9. Linux

Need suggestions before install OEL5.0 on IBM3400

Hi, I need to install Oracle Enterprise Linux 5.0 on IBM3400.Before start it,I expect your valuable suggestions regarding partition size...etc. This server is having 146 GB of hard disk and 4GB of RAM.I need to create 15 restricted users on this server.These 15 users will access their folders... (1 Reply)
Discussion started by: masatheesh
1 Replies

10. What is on Your Mind?

Too Hot Here

Officially, we had high of 96°F with a relative humidity of 52% here in Rockville Md today. But my car's thermometer said the outside temp was 110° when I first got in this afternoon. After driving for 30 minutes it cooled down to 103°. I actually have a nasty burn on my hand just from leaning... (19 Replies)
Discussion started by: Perderabo
19 Replies
Login or Register to Ask a Question