OVM 2 / Xen 3.4.0 Cluster consisting of 3 Machines
Shared SAN Storage synced with OCFS2
SAN connected with 4GB FC on 4 Paths per LUN
SAN target are 2 EMC Clariion mirroring each other
The problems we're facing are that the OCFS2 file system and the file systems inside the VMs are reporting I/O errors, and that Cluster nodes are dying without apparent reason. The file systems are getting corrupted time and again.
dmesg fills the screen with these error messages:
multipathd.conf (same on all nodes): multipath -ll:
OCFS2 cluster.conf (auto generated by OVM):
Any help is appreciated, since we're basically trying to get everything running again for the last 24 hours, and we're out of ideas.
No, we don't have a support contract for OVM with Oracle.
Hi pludi,
check the alert log of the failing database instances. Could you also post the content of /var/log/messages (dmesg's output may not be enough) from the time the errors occurred?
@bartus
Ad 1) Yes, for the past 2 weeks
Ad 2) We removed an empty OVM repository and the associated LUN
@radoulov
I'll try to get the contents of the messages file from around the incident(s) (it's currently around 650M, so I won't post it all)
EDIT: Added the contents of syslog from the three cluster nodes.
I'm not able to find anything on MOS. I found various threads related to OCFS2/SAN problems on the OTN forums, but they don't seem to match your situation.
Let me know if the database alert log(s) contain something interesting.
It's fixed. Basically, what a consultant told us was that we were lucky it did even last that long, as both the configuration for dm-multipath and the EMC storage were off. I don't know what exactly they did on the SAN side, but after ALUA was switched on on the Clariion, everything runs as smooth as can be. No extra settings required on the machines, as dm-multipath automagically configures itself when detecting an EMC storage with ALUA set.
Hello,
We have few critical databases running on T series servers. Setup consists of LDOMS and zonemanager running on them and databases are running on their zones. We want to get away from this setup and looking for alternate solution to run our Oracle databases.
One option is OVM from Oracle.... (7 Replies)
Hi everybody,
i am working on the new script , its job discover the Storage Env ( especially MultiPATH ) and FC cards for solaris 11 sparc systems for now..
script is seem working ( but may contain any mistakes or bug ) on the oracle Qlogic fc cards on Emc_VMAx systems and Solaris 11 Sparc_64... (0 Replies)
Need attach Oracle Linux 7.1 to IBM Storage DS5300
in AIX use sddpcm package for storage driver, but in oracle linux i can not find similar driver in IBM site. Someone confronted with a like case ? (1 Reply)
I have some T3's we just purchased and we are looking to carve these up into LDOMS's.
Just wondering if anyone can give me a quick run down or pro / cons on SAN vs local internal for the LDOM itself. These will external SAN storage for their applications. (0 Replies)
Hi,
We are moving the RMAN oracle backup to tape on daily basis.After they went for SAN change in the solaris server , we started receiveing ora-600 errors and backup is getting fails.
I am from Oracle DBA team.I need to know whether any command for check SAN change or root cause for this... (2 Replies)
Sorry for my english.
We have a IBM BLADES JS21. AIX 5.3 update to 6.
Our JS21 has 2 FC (fcs0 and fcs1).
We have one DS4072, one Disk system with 2 controllers and 2 FC by controllers.
This means, all AIX FC see all Disk systems controllers by 2 FC switchs. (one fc two roads)
FC AIX... (4 Replies)
Hi,
I have a strange problem. we're trying to connect an IBM pseries, to a Brocade switch, for SAN acess, using a badged emulex card, (IBM FC6239) WE can configure the device to see the fabric. The only problem we have is that the Brocade sees the HBA as storage, and not as a HBA.
We've zoned... (1 Reply)
Hi all,
Sorry if this is in the wrong place but needed to make sure lots of people saw this so that hopefully someone will be able to help.
Basically i've upgraded a test server from 4.3 to 5.3 TL04.
The server has hdisk0 and 1 as rootvg locally but then has another vg setup on our ESS... (5 Replies)
Hi:
I am in the process of configuring the SAN for Solaris to host 6 oracle 9i databases. We have 30 -146 GB disks stiped with RAID 10 for SAN. Of which 11 are dedicated for databsaes related things. Then we have 2 v880 Sun Servers with 16 -73 GB disks and 24 GB memory.
The questions... (1 Reply)