Missing ASM Disks in Solaris 11.3 LDOM


 
Thread Tools Search this Thread
Operating Systems Solaris Missing ASM Disks in Solaris 11.3 LDOM
# 8  
Old 10-23-2018
Hi Peasant,

The reason for the failure as you'll have deduced is that the disks assigned to ASM were incorrectly configured, the original build document instructed that they skipped Cylinder 0 for the ASM slice. However this wasn't done and as the server had to be rebooted Solaris threw a flaky when it couldn't read the label, no surprise there.

The disk assigned to ASM are the raw devices and the ASM header covers the first 8 sectors of the disk, which is the label and some of the bitmap.

The zpool that I created was to try a quick and dirty fix as follows.

Use dd to directly copy the raw device to a file inside the asm_recovery zpool, my intention was to then label the original luns and restart the LDOM without ASM and AFD. At that point I would have also presented the dd files to the LDOM and would have used kfed to sort the disks out.

I wanted to run a comparison with the raw dd files and the ASM disks before dumping the database and blowing the disks away, however things have moved on here and I probably won't have time to do this. I was looking at using the mdb to get round the label problem (This exists at a LUN level - so is problematic in the primary LDOM as well.) so as I could dd the disks to the target files.

In all fairness using s2 would not have yielded a different result, as the earlier post shows - slice 2 also started at Cylinder 0 - so ASM would have just killed the disk - I have spoken with two Sun (now Oracle people - both with two digit employee numbers) and the chances of sorting this out are slim.

The long and the short of this is that the person who built the system, missed the requirement to have the ASM disks start at Cylinder 1. His experience of ASM before this was limited to using soft partitions in SVM and adding the meta device to a zone, although he did use ASM on top of AIX and RHEL - the configuration is significantly different.

The disks used for ASM and AFD have only been labelled, they are raw devices - these normally show up in format as;

Code:
root@fvskirsun01:~# echo | format
Searching for disks...done

c0t60050768018086B6E80000000000045Ad0: configured with capacity of 1022.00MB
c0t60050768018086B6E8000000000004B8d0: configured with capacity of 49.98GB
c0t60050768018086B6E80000000000045Bd0: configured with capacity of 299.98GB
c0t60050768018086B6E80000000000045Cd0: configured with capacity of 299.98GB
c0t60050768018086B6E80000000000045Dd0: configured with capacity of 5.00GB
c0t60050768018086B6E80000000000045Ed0: configured with capacity of 5.00GB
c0t60050768018086B6E80000000000045Fd0: configured with capacity of 5.00GB
c0t60050768018086B6E800000000000462d0: configured with capacity of 49.98GB
c0t60050768018086B6E800000000000463d0: configured with capacity of 10.00GB
c0t60050768018086B6E800000000000461d0: configured with capacity of 49.98GB
c0t60050768018086B6E800000000000460d0: configured with capacity of 20.00GB


AVAILABLE DISK SELECTIONS:

These are labelled and pushed through to the LDOM in question as;

Code:
VDS
    NAME         VOLUME         OPTIONS          MPGROUP        DEVICE
    fdbkirnhht01-vds0 volume1                                        /dev/dsk/c0t60050768018086B6E800000000000457d0s0
                 nhht_db_vol2                                   /dev/rdsk/c0t60050768018086B6E800000000000459d0s0
                 nhht_db_vol3                                   /dev/rdsk/c0t60050768018086B6E800000000000464d0s0
                 nhht_ba_vol2                                   /dev/rdsk/c0t60050768018086B6E800000000000465d0s0
                 nhht_asm_01                                    /dev/rdsk/c0t60050768018086B6E80000000000045Ad0s0
                 nhht_asm_02                                    /dev/rdsk/c0t60050768018086B6E80000000000045Bd0s0
                 nhht_asm_03                                    /dev/rdsk/c0t60050768018086B6E80000000000045Cd0s0
                 nhht_asm_04                                    /dev/rdsk/c0t60050768018086B6E80000000000045Dd0s0
                 nhht_asm_05                                    /dev/rdsk/c0t60050768018086B6E80000000000045Ed0s0
                 nhht_asm_06                                    /dev/rdsk/c0t60050768018086B6E80000000000045Fd0s0
                 nhht_asm_07                                    /dev/rdsk/c0t60050768018086B6E800000000000460d0s0
                 nhht_asm_08                                    /dev/rdsk/c0t60050768018086B6E800000000000462d0s0
                 nhht_asm_09                                    /dev/rdsk/c0t60050768018086B6E800000000000461d0s0
                 nhht_asm_10                                    /dev/rdsk/c0t60050768018086B6E800000000000463d0s0

I will update you all if there are any changes, if I can get the disks copied I'll let you know. Failing that then I'll clone the production system and they will have an up to date test system.

Thanks again for the pointers and information.

Regards

Gull04
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Solaris

Solaris LDOM IP conflict

I have a Sun T4-1 running Solaris 11.4 with a static IP 192.168.0.183. On this machine is a Solaris 10 LDOM with a static IP of 192.168.0.78. The other day I had to stop the LDOM to do a memory reconfigure. When I rebooted it I got an error that the IP 192.168.0.78 was already in use and so... (4 Replies)
Discussion started by: Michele31416
4 Replies

2. Solaris

Oracle ASM on Solaris 11.3

Hi Folks, I've just built a Solaris 11.3 server with a number of LDOM's, all good and well and not any serious issues so far. On our older Solaris 10 systems we ran Oracle 11g using ASM disks, these disks were the raw device meta disks and came in very nicely as "/dev/md/rdsk/dnn" all worked... (4 Replies)
Discussion started by: gull04
4 Replies

3. Solaris

Virtual Switch in Solaris LDOM

Hi, Our existing environment is having primary domain and 3 guest domains are running over it. See the attached image. Now we want to add a new primary virtual switch and move LDOM3 to be connected with new primary switch. So, I am not sure how to achieve this because. If I remove the... (7 Replies)
Discussion started by: praveensharma21
7 Replies

4. Solaris

Virtual disks are not showing up in LDom

I have an Oracle VM set up with 1 virtual disk. I am trying to add 2 new disks to it. I was able to successfully add 1 (it appears when I run "format" in the VM) but when I add the second and third disks they do not appear in my VM. Here are the commands I ran: ldm add-vdsdev... (3 Replies)
Discussion started by: unblockable
3 Replies

5. Solaris

Disks missing from /devices folder. Not sure why.

Help Please! I picked up a V440 and it has 4 disks. I installed Solaris fine to disk 3, but I cannot see the other disks in Solaris. I have run probe-scsi-all from OBP and I see the other disks and they have names in devalias AFAIK. It's just in Solaris they do not appear. I have run... (6 Replies)
Discussion started by: greg1975
6 Replies

6. Solaris

ZFS LDOM problem on Solaris 10

Apologies if this is the wrong forum.. I have some LDOMs running on a Sparc server. I copied the disk0 file from one chassis over to another, stopped the ldom on the source system and started it on the 2nd one. All fine. Shut it down and flipped back. We then did a fair bit of work on the... (4 Replies)
Discussion started by: tommyq
4 Replies

7. Solaris

Solaris 10 Installation - Disks missing, and Raid

Hey everyone. First, let me start by saying I'm primarily focused on linux boxes, and just happened to get pulled into building two T5220's. I'm not super educated on sun boxes. Both T5220's have 8 146GB 15k SAS drives. Inside the service processor, I can run SHOW /SYS/HDD{0-7} and they all come... (2 Replies)
Discussion started by: msarro
2 Replies

8. Solaris

How to find missing disks on Sun x4150 without reboot?

Hi, Here is the issue: There are 4 disks on this Sun x4150 system under Solaris 10, but only 1 disk can be seen by the OS. I've tried commands disks and devfsadm but not working. It's an important production server, so 'reboot -r' is not a choice. # format < /dev/null Searching for... (6 Replies)
Discussion started by: aixlover
6 Replies

9. Solaris

Installing Solaris into LDom using DVD

Hi, I have issues installing Solaris into a LDom using a Solaris10u5/08 DVD. I have been troubleshooting for the past 2 days and I still cannot get it up. Here is the logs: root@eld-app2# ldm add-vdsdev /cdrom/sol_10_508_sparc/s0 cdrom0@primary-vds0 root@eld-app2# ldm add-vdisk cdrom0... (4 Replies)
Discussion started by: bolasutra
4 Replies
Login or Register to Ask a Question