Login or Register to Ask a Question and Join Our Community


Emergency UNIX and Linux Support

RHEL and Centos VMs with IO failure on root

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Homework and Emergencies Emergency UNIX and Linux Support RHEL and Centos VMs with IO failure on root
# 1  
Old 01-18-2012
RHEL and Centos VMs with IO failure on root
Hello,

I am running into this issues, few VMWare VM's that are running with RHEL 5.6 and Centos 5.7, are having read write errors on the root file system. This is noticed on all vm's. After looking to log files this what I noticed.

#touch test.txt
touch: cannot touch `test.txt': Read-only file system.
#

after this we have reboot the server, during booting up, fsck is fixing the issue, in one case we had to rebuild whole VM as did keep on panic, it did'nt as prompt for fsck.

some of the log message error that I noticed.

Jan 18 13:25:01 Hostname1 kernel: EXT3-fs warning (device dm-0): ext3_clear_journal_err: Filesystem error recorded from previous mount: IO failure
Jan 18 13:25:01 Hostname1 kernel: EXT3-fs warning (device dm-0): ext3_clear_journal_err: Marking fs in need of filesystem check.

Thanks,
# 2  
Old 01-18-2012
Can you post the GRUB boot parameters passing to the kernel? Did you clone or P2V the VMs?
# 3  
Old 01-18-2012
All the VM's that were built from a template -> we use "deploy it to Virtual Machine", to build a new virtual machine.

Here is the o/p of grub.conf

Code:
Hostname1# more /boot/grub/grub.conf
# grub.conf generated by anaconda
#
# Note that you do not have to rerun grub after making changes to this file
# NOTICE:  You have a /boot partition.  This means that
#          all kernel and initrd paths are relative to /boot/, eg.
#          root (hd0,0)
#          kernel /vmlinuz-version ro root=/dev/VolGroup00/LogVol00
#          initrd /initrd-version.img
#boot=/dev/sda
default=0
timeout=5
splashimage=(hd0,0)/grub/splash.xpm.gz
hiddenmenu
title Red Hat Enterprise Linux Server (2.6.18-238.el5)
        root (hd0,0)
        kernel /vmlinuz-2.6.18-238.el5 ro root=/dev/VolGroup00/LogVol00 rhgb quiet
        initrd /initrd-2.6.18-238.el5.img
Hostname1#

# 4  
Old 01-18-2012
Is it a production server?
can you append the following in the kernel parameters and check (only if it's a non-production server. Don't blame me if things go wrong! Smilie )
Code:
rd_LVM_LV=VolGroup00/LogVol00

Also, if possible, please post dmesg output. What I have seen so far if the VMs are created through a template or cloned or P2V-ed, things go wrong and kernel some times fails to detect hard disk or fails to mount properly.

Are you using VMWare ESXi?
# 5  
Old 01-18-2012
journal errors are SPOF. in the linux filesystem. The surest way to clear them is to drop the journal and then add it again. In yiur case, you would use a recovery (virtual) CD and then use tune2fs to drop and then re add the journal. Check the man page for the options on doing this. (sorry, on my iphone)
# 6  
Old 01-20-2012
Hello,

I apologize for the late reply, I was looking for similar server which is having this kind of issue. Today morning I noticed one !!!!

As this is not a production server I updated the grub.conf file.

admin_xor, as suggested I updated the grub.conf file and rebooted the server, here is the o/p of dmesg file.

Code:
Linux version 2.6.18-274.3.1.el5 (mockbuild@builder10.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.
1.2-51)) #1 SMP Tue Sep 6 20:13:52 EDT 2011
Command line: ro root=/dev/VolGroup00/LogVol00 rd_LVM_LV=VolGroup00/LogVol00
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000010000 - 000000000009f800 (usable)
 BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000ca000 - 00000000000cc000 (reserved)
 BIOS-e820: 00000000000dc000 - 00000000000e4000 (reserved)
 BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bfef0000 (usable)
 BIOS-e820: 00000000bfef0000 - 00000000bfeff000 (ACPI data)
 BIOS-e820: 00000000bfeff000 - 00000000bff00000 (ACPI NVS)
 BIOS-e820: 00000000bff00000 - 00000000c0000000 (usable)
 BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000fffe0000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000440000000 (usable)
DMI present.
DMI: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/13/2009
ACPI: RSDP (v002 PTLTD                                 ) @ 0x00000000000f6940
ACPI: XSDT (v001 INTEL  440BX    0x06040000 VMW  0x01324272) @ 0x00000000bfef085d
ACPI: FADT (v004 INTEL  440BX    0x06040000 PTL  0x000f4240) @ 0x00000000bfefee98
ACPI: BOOT (v001 PTLTD  $SBFTBL$ 0x06040000  LTP 0x00000001) @ 0x00000000bfef0a15
ACPI: MADT (v001 PTLTD           APIC   0x06040000  LTP 0x00000000) @ 0x00000000bfef09c5
ACPI: MCFG (v001 PTLTD  $PCITBL$ 0x06040000  LTP 0x00000001) @ 0x00000000bfef0989
ACPI: SRAT (v002 VMWARE MEMPLUG  0x06040000 VMW  0x00000001) @ 0x00000000bfef08e1
ACPI: DSDT (v001 PTLTD  Custom   0x06040000 MSFT 0x03000001) @ 0x0000000000000000
SRAT: Node 0 PXM 0 0-a0000
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 0-440000000
No NUMA configuration found
Faking a node at 0000000000000000-0000000440000000
Bootmem setup node 0 0000000000000000-0000000440000000
bootmap start 100000 pages 136
Memory for crash kernel (0x0 to 0x0) notwithin permissible range
disabling kdump
Setting up node 0 0-440000
On node 0 totalpages: 4131741
  DMA zone: 2421 pages, LIFO batch:0
  DMA32 zone: 768040 pages, LIFO batch:31
  Normal zone: 3361280 pages, LIFO batch:31
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 6:12 APIC version 17
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Setting APIC routing to physical flat
Using ACPI (MADT) for SMP configuration information
Nosave address range: 000000000009f000 - 00000000000a0000
Nosave address range: 00000000000a0000 - 00000000000ca000
Nosave address range: 00000000000ca000 - 00000000000cc000
Nosave address range: 00000000000cc000 - 00000000000dc000
Nosave address range: 00000000000dc000 - 00000000000e4000
Nosave address range: 00000000000e4000 - 00000000000e8000
Nosave address range: 00000000000e8000 - 0000000000100000
Nosave address range: 00000000bfef0000 - 00000000bfeff000
Nosave address range: 00000000bfeff000 - 00000000bff00000
Nosave address range: 00000000c0000000 - 00000000e0000000
Nosave address range: 00000000e0000000 - 00000000f0000000
Nosave address range: 00000000f0000000 - 00000000fec00000
Nosave address range: 00000000fec00000 - 00000000fec10000
Nosave address range: 00000000fec10000 - 00000000fee00000
Nosave address range: 00000000fee00000 - 00000000fee01000
Nosave address range: 00000000fee01000 - 00000000fffe0000
Nosave address range: 00000000fffe0000 - 0000000100000000
Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
SMP: Allowing 1 CPUs, 0 hotplug CPUs
Built 1 zonelists.  Total pages: 4131741
Kernel command line: ro root=/dev/VolGroup00/LogVol00 rd_LVM_LV=VolGroup00/LogVol00
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 32768 bytes)
Using TSC for driving interrupts
Console: colour VGA+ 80x25
Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Checking aperture...
ACPI: DMAR not present
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing software IO TLB between 0x2823000 - 0x6823000
Memory: 16432520k/17825792k available (2603k kernel code, 344180k reserved, 1660k data, 224k init)
Calibrating delay loop (skipped) preset value.. 5851.99 BogoMIPS (lpj=2925999)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 12288K
MCE: Machine Check Exception Reporting is disabled.
SMP alternatives: switching to UP code
Freeing SMP alternatives: 32k freed
ACPI: Core revision 20060707
Cannot setup NMI watchdog on CPU 0
Using local APIC timer interrupts.
Detected 4.125 MHz APIC timer.
Brought up 1 CPUs
time.c: Using 3.579545 MHz WALL PM GTOD TSC Timekeeping timer.
time.c: Detected 2925.999 MHz processor.
sizeof(vma)=176 bytes
sizeof(page)=56 bytes
sizeof(inode)=560 bytes
sizeof(dentry)=216 bytes
sizeof(ext3inode)=760 bytes
sizeof(buffer_head)=96 bytes
sizeof(skbuff)=248 bytes
checking if image is initramfs... it is
Freeing initrd memory: 3460k freed
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using MMCONFIG at e0000000
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI quirk: region 1000-103f claimed by PIIX4 ACPI
PCI quirk: region 1040-104f claimed by PIIX4 SMB
PCI: Transparent bridge - 0000:00:11.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 *9 10 11 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 *5 6 7 9 10 11 14 15)
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 13 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
ACPI: DMAR not present
PCI-GART: No AMD northbridge found.
pnp: 00:0c: ioport range 0x1060-0x107f has been reserved
pnp: 00:0c: iomem range 0xe0000000-0xefffffff could not be reserved
pnp: 00:0c: iomem range 0xdbe00000-0xdbffffff has been reserved
PCI: Bridge: 0000:00:01.0
  IO window: disabled.
  MEM window: disabled.
  PREFETCH window: disabled.
PCI: Bridge: 0000:00:11.0
  IO window: 2000-3fff
 MEM window: d8900000-d9cfffff
  PREFETCH window 0x00000000dc400000-0x00000000dc9fffff
PCI: Bridge: 0000:00:15.0
  IO window: 4000-4fff
  MEM window: d9d00000-d9dfffff
  PREFETCH window 0x00000000dca00000-0x00000000dcafffff
PCI: Bridge: 0000:00:15.1
  IO window: 8000-8fff
  MEM window: da100000-da1fffff
  PREFETCH window 0x00000000dce00000-0x00000000dcefffff
PCI: Bridge: 0000:00:15.2
  IO window: c000-cfff
  MEM window: da500000-da5fffff
  PREFETCH window 0x00000000dd200000-0x00000000dd2fffff
PCI: Bridge: 0000:00:15.3
  IO window: disabled.
  MEM window: da900000-da9fffff
  PREFETCH window 0x00000000dd600000-0x00000000dd6fffff
PCI: Bridge: 0000:00:15.4
  IO window: disabled.
  MEM window: dad00000-dadfffff
  PREFETCH window 0x00000000dda00000-0x00000000ddafffff
PCI: Bridge: 0000:00:15.5
  IO window: disabled.
  MEM window: db100000-db1fffff
  PREFETCH window 0x00000000dde00000-0x00000000ddefffff
PCI: Bridge: 0000:00:15.6
  IO window: disabled.
  MEM window: db500000-db5fffff
  PREFETCH window 0x00000000de200000-0x00000000de2fffff
PCI: Bridge: 0000:00:15.7
  IO window: disabled.
  MEM window: db900000-db9fffff
  PREFETCH window 0x00000000de600000-0x00000000de6fffff
PCI: Bridge: 0000:00:16.0
  IO window: 5000-5fff
  MEM window: d9e00000-d9efffff
  PREFETCH window 0x00000000dcb00000-0x00000000dcbfffff
PCI: Bridge: 0000:00:16.1
  IO window: 9000-9fff
  MEM window: da200000-da2fffff
  PREFETCH window 0x00000000dcf00000-0x00000000dcffffff
PCI: Bridge: 0000:00:16.2
  IO window: d000-dfff
  MEM window: da600000-da6fffff
  PREFETCH window 0x00000000dd300000-0x00000000dd3fffff
PCI: Bridge: 0000:00:16.3
  IO window: disabled.
  MEM window: daa00000-daafffff
  PREFETCH window 0x00000000dd700000-0x00000000dd7fffff
PCI: Bridge: 0000:00:16.4
  IO window: disabled.
  MEM window: dae00000-daefffff
  PREFETCH window 0x00000000ddb00000-0x00000000ddbfffff
PCI: Bridge: 0000:00:16.5
  IO window: disabled.
  MEM window: db200000-db2fffff
  PREFETCH window 0x00000000ddf00000-0x00000000ddffffff
PCI: Bridge: 0000:00:16.6
  IO window: disabled.
  MEM window: db600000-db6fffff
  PREFETCH window 0x00000000de300000-0x00000000de3fffff
PCI: Bridge: 0000:00:16.7
  IO window: disabled.
  MEM window: dba00000-dbafffff
  PREFETCH window 0x00000000de700000-0x00000000de7fffff
PCI: Bridge: 0000:00:17.0
  IO window: 6000-6fff
  MEM window: d9f00000-d9ffffff
  PREFETCH window 0x00000000dcc00000-0x00000000dccfffff
PCI: Bridge: 0000:00:17.1
  IO window: a000-afff
  MEM window: da300000-da3fffff
  PREFETCH window 0x00000000dd000000-0x00000000dd0fffff
PCI: Bridge: 0000:00:17.2
  IO window: e000-efff
MEM window: da700000-da7fffff
  PREFETCH window 0x00000000dd400000-0x00000000dd4fffff
PCI: Bridge: 0000:00:17.3
  IO window: disabled.
  MEM window: dab00000-dabfffff
  PREFETCH window 0x00000000dd800000-0x00000000dd8fffff
PCI: Bridge: 0000:00:17.4
  IO window: disabled.
  MEM window: daf00000-daffffff
  PREFETCH window 0x00000000ddc00000-0x00000000ddcfffff
PCI: Bridge: 0000:00:17.5
  IO window: disabled.
  MEM window: db300000-db3fffff
  PREFETCH window 0x00000000de000000-0x00000000de0fffff
PCI: Bridge: 0000:00:17.6
  IO window: disabled.
  MEM window: db700000-db7fffff
  PREFETCH window 0x00000000de400000-0x00000000de4fffff
PCI: Bridge: 0000:00:17.7
  IO window: disabled.
  MEM window: dbb00000-dbbfffff
  PREFETCH window 0x00000000de800000-0x00000000de8fffff
PCI: Bridge: 0000:00:18.0
  IO window: 7000-7fff
  MEM window: da000000-da0fffff
  PREFETCH window 0x00000000dcd00000-0x00000000dcdfffff
PCI: Bridge: 0000:00:18.1
  IO window: b000-bfff
  MEM window: da400000-da4fffff
  PREFETCH window 0x00000000dd100000-0x00000000dd1fffff
PCI: Bridge: 0000:00:18.2
  IO window: f000-ffff
  MEM window: da800000-da8fffff
  PREFETCH window 0x00000000dd500000-0x00000000dd5fffff
PCI: Bridge: 0000:00:18.3
  IO window: disabled.
  MEM window: dac00000-dacfffff
  PREFETCH window 0x00000000dd900000-0x00000000dd9fffff
PCI: Bridge: 0000:00:18.4
  IO window: disabled.
  MEM window: db000000-db0fffff
  PREFETCH window 0x00000000ddd00000-0x00000000dddfffff
PCI: Bridge: 0000:00:18.5
  IO window: disabled.
  MEM window: db400000-db4fffff
  PREFETCH window 0x00000000de100000-0x00000000de1fffff
PCI: Bridge: 0000:00:18.6
  IO window: disabled.
  MEM window: db800000-db8fffff
  PREFETCH window 0x00000000de500000-0x00000000de5fffff
PCI: Bridge: 0000:00:18.7
  IO window: disabled.
  MEM window: dbc00000-dbcfffff
  PREFETCH window 0x00000000de900000-0x00000000de9fffff
PCI: Setting latency timer of device 0000:00:01.0 to 64
PCI: Setting latency timer of device 0000:00:15.0 to 64
PCI: Setting latency timer of device 0000:00:15.1 to 64
PCI: Setting latency timer of device 0000:00:15.2 to 64
PCI: Setting latency timer of device 0000:00:15.3 to 64
PCI: Setting latency timer of device 0000:00:15.4 to 64
PCI: Setting latency timer of device 0000:00:15.5 to 64
PCI: Setting latency timer of device 0000:00:15.6 to 64
PCI: Setting latency timer of device 0000:00:15.7 to 64
PCI: Setting latency timer of device 0000:00:16.0 to 64
PCI: Setting latency timer of device 0000:00:16.1 to 64
PCI: Setting latency timer of device 0000:00:16.2 to 64
PCI: Setting latency timer of device 0000:00:16.3 to 64
PCI: Setting latency timer of device 0000:00:16.4 to 64
PCI: Setting latency timer of device 0000:00:16.5 to 64
PCI: Setting latency timer of device 0000:00:16.6 to 64
PCI: Setting latency timer of device 0000:00:16.7 to 64
PCI: Setting latency timer of device 0000:00:17.0 to 64
PCI: Setting latency timer of device 0000:00:17.1 to 64
PCI: Setting latency timer of device 0000:00:17.2 to 64
PCI: Setting latency timer of device 0000:00:17.3 to 64
PCI: Setting latency timer of device 0000:00:17.4 to 64
PCI: Setting latency timer of device 0000:00:17.5 to 64
PCI: Setting latency timer of device 0000:00:17.6 to 64
PCI: Setting latency timer of device 0000:00:17.7 to 64
PCI: Setting latency timer of device 0000:00:18.0 to 64
PCI: Setting latency timer of device 0000:00:18.1 to 64
PCI: Setting latency timer of device 0000:00:18.2 to 64
PCI: Setting latency timer of device 0000:00:18.3 to 64
PCI: Setting latency timer of device 0000:00:18.4 to 64
PCI: Setting latency timer of device 0000:00:18.5 to 64
PCI: Setting latency timer of device 0000:00:18.6 to 64
PCI: Setting latency timer of device 0000:00:18.7 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 262144 bind 65536)
TCP reno registered
Simple Boot Flag at 0x36 set to 0x80
audit: initializing netlink socket (disabled)
type=2000 audit(1327074960.245:1): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
Initializing Cryptographic API
alg: No test for crc32c (crc32c-generic)
ksign: Installing public key data
Loading keyring
- Added public key 9112142D6E666F01
- User ID: CentOS (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
Limiting direct PCI/PCI transfers.
Boot video device is 0000:00:0f.0
PCI: Setting latency timer of device 0000:00:15.0 to 64
PCI: Setting latency timer of device 0000:00:15.1 to 64
PCI: Setting latency timer of device 0000:00:15.2 to 64
PCI: Setting latency timer of device 0000:00:15.3 to 64
PCI: Setting latency timer of device 0000:00:15.4 to 64
PCI: Setting latency timer of device 0000:00:15.5 to 64
PCI: Setting latency timer of device 0000:00:15.6 to 64
PCI: Setting latency timer of device 0000:00:15.7 to 64
PCI: Setting latency timer of device 0000:00:16.0 to 64
PCI: Setting latency timer of device 0000:00:16.1 to 64
PCI: Setting latency timer of device 0000:00:16.2 to 64
PCI: Setting latency timer of device 0000:00:16.3 to 64
PCI: Setting latency timer of device 0000:00:16.4 to 64
PCI: Setting latency timer of device 0000:00:16.5 to 64
PCI: Setting latency timer of device 0000:00:16.6 to 64
PCI: Setting latency timer of device 0000:00:16.7 to 64
PCI: Setting latency timer of device 0000:00:17.0 to 64
PCI: Setting latency timer of device 0000:00:17.1 to 64
PCI: Setting latency timer of device 0000:00:17.2 to 64
PCI: Setting latency timer of device 0000:00:17.3 to 64
PCI: Setting latency timer of device 0000:00:17.4 to 64
PCI: Setting latency timer of device 0000:00:17.5 to 64
PCI: Setting latency timer of device 0000:00:17.6 to 64
PCI: Setting latency timer of device 0000:00:17.7 to 64
PCI: Setting latency timer of device 0000:00:18.0 to 64
PCI: Setting latency timer of device 0000:00:18.1 to 64
PCI: Setting latency timer of device 0000:00:18.2 to 64
PCI: Setting latency timer of device 0000:00:18.3 to 64
PCI: Setting latency timer of device 0000:00:18.4 to 64
PCI: Setting latency timer of device 0000:00:18.5 to 64
PCI: Setting latency timer of device 0000:00:18.6 to 64
PCI: Setting latency timer of device 0000:00:18.7 to 64
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
ACPI: Processor [CPU0] (supports 8 throttling states)
Real Time Clock Driver v1.12ac
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
agpgart: Detected an Intel 440BX Chipset.
agpgart: AGP aperture is 256M @ 0x0
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:0a: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
PIIX4: IDE controller at PCI slot 0000:00:07.1
PIIX4: chipset revision 1
PIIX4: not 100% native mode: will probe irqs later
    ide0: BM-DMA at 0x10c0-0x10c7, BIOS settings: hda:pio, hdb:pio
    ide1: BM-DMA at 0x10c8-0x10cf, BIOS settings: hdc:DMA, hdd:pio
Probing IDE interface ide0...
Probing IDE interface ide1...
hdc: VMware Virtual IDE CDROM Drive, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
Probing IDE interface ide0...
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:MOUS] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
ACPI: (supports S0 S1 S4 S5)
Initalizing network drop monitor service
Freeing unused kernel memory: 224k freed
Write protecting the kernel read-only data: 527k
input: AT Translated Set 2 keyboard as /class/input/input0
input: ImPS/2 Generic Wheel Mouse as /class/input/input1
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
USB Universal Host Controller Interface driver v3.0
SCSI subsystem initialized
Fusion MPT base driver 3.04.18rh
Copyright (c) 1999-2008 LSI Corporation
Fusion MPT SPI Host driver 3.04.18rh
GSI 16 sharing vector 0x33 and IRQ 16
ACPI: PCI Interrupt 0000:00:10.0[A] -> GSI 17 (level, low) -> IRQ 51
mptbase: ioc0: Initiating bringup
ioc0: LSI53C1030 B0: Capabilities={Initiator}
scsi0 : ioc0: LSI53C1030 B0, FwRev=01032920h, Ports=1, MaxQ=128, IRQ=51
  Vendor: VMware    Model: Virtual disk      Rev: 1.0
  Type:   Direct-Access                      ANSI SCSI revision: 02
 target0:0:0: Beginning Domain Validation
 target0:0:0: Domain Validation skipping write tests
 target0:0:0: Ending Domain Validation
 target0:0:0: FAST-40 WIDE SCSI 80.0 MB/s ST (25 ns, offset 127)
SCSI device sda: 41943040 512-byte hdwr sectors (21475 MB)
sda: Write Protect is off
sda: Mode Sense: 03 00 00 00
sda: cache data unavailable
sda: assuming drive cache: write through
SCSI device sda: 41943040 512-byte hdwr sectors (21475 MB)
sda: Write Protect is off
sda: Mode Sense: 03 00 00 00
sda: cache data unavailable
sda: assuming drive cache: write through
 sda: sda1 sda2
sd 0:0:0:0: Attached scsi disk sda
  Vendor: VMware    Model: Virtual disk      Rev: 1.0
  Type:   Direct-Access                      ANSI SCSI revision: 02
 target0:0:1: Beginning Domain Validation
 target0:0:1: Domain Validation skipping write tests
 target0:0:1: Ending Domain Validation
 target0:0:1: FAST-40 WIDE SCSI 80.0 MB/s ST (25 ns, offset 127)
SCSI device sdb: 209715200 512-byte hdwr sectors (107374 MB)
sdb: Write Protect is off
sdb: Mode Sense: 03 00 00 00
sdb: cache data unavailable
sdb: assuming drive cache: write through
SCSI device sdb: 209715200 512-byte hdwr sectors (107374 MB)
sdb: Write Protect is off
sdb: Mode Sense: 03 00 00 00
sdb: cache data unavailable
sdb: assuming drive cache: write through
 sdb: sdb1
sd 0:0:1:0: Attached scsi disk sdb
libata version 3.00 loaded.
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.11.6-ioctl (2011-02-18) initialised: dm-devel@redhat.com
device-mapper: dm-raid45: initialized v0.2594l
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
type=1404 audit(1327074996.637:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
security:  3 users, 6 roles, 2005 types, 267 bools, 1 sens, 1024 cats
security:  61 classes, 80385 rules
SELinux:  Completing initialization.
SELinux:  Setting up existing superblocks.
SELinux: initialized (dev dm-0, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts
SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs
SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts
SELinux: initialized (dev devpts, type devpts), uses transition SIDs
SELinux: initialized (dev eventpollfs, type eventpollfs), uses task SIDs
SELinux: initialized (dev inotifyfs, type inotifyfs), uses genfs_contexts
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts
SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts
SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
SELinux: initialized (dev cpuset, type cpuset), uses genfs_contexts
SELinux: initialized (dev proc, type proc), uses genfs_contexts
SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
type=1403 audit(1327074996.854:3): policy loaded auid=4294967295 ses=4294967295
SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts
Intel(R) PRO/1000 Network Driver - version 7.3.21-k4-3-NAPI
Copyright (c) 1999-2006 Intel Corporation.
GSI 17 sharing vector 0x3B and IRQ 17
ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 18 (level, low) -> IRQ 59
PCI: Setting latency timer of device 0000:02:00.0 to 64
e1000: 0000:02:00.0: e1000_probe: (PCI:66MHz:32-bit) 00:50:56:b7:00:70
parport: PnPBIOS parport detected.
parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
GSI 18 sharing vector 0x43 and IRQ 18
ACPI: PCI Interrupt 0000:02:01.0[A] -> GSI 19 (level, low) -> IRQ 67
PCI: Setting latency timer of device 0000:02:01.0 to 64
e1000: 0000:02:01.0: e1000_probe: (PCI:66MHz:32-bit) 00:50:56:b7:00:73
input: PC Speaker as /class/input/input2
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
hdc: ATAPI 1X DVD-ROM DVD-R-RAM CD-R/RW drive, 32kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
piix4_smbus 0000:00:07.3: Found 0000:00:07.3 device
piix4_smbus 0000:00:07.3: Host SMBus controller not enabled!
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
lp0: using parport0 (interrupt-driven).
lp0: console ready
VMware PVSCSI driver - version 0.0.0.6
ACPI: AC Adapter [ACAD] (on-line)
ACPI: Power Button (FF) [PWRF]
ACPI: Mapper loaded
dell-wmi: No known WMI GUID found
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: multipath: version 1.0.6 loaded
loop: loaded (max 8 parport: PnPBIOS parport detected.
parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
GSI 18 sharing vector 0x43 and IRQ 18
ACPI: PCI Interrupt 0000:02:01.0[A] -> GSI 19 (level, low) -> IRQ 67
PCI: Setting latency timer of device 0000:02:01.0 to 64
e1000: 0000:02:01.0: e1000_probe: (PCI:66MHz:32-bit) 00:50:56:b7:00:73
input: PC Speaker as /class/input/input2
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
hdc: ATAPI 1X DVD-ROM DVD-R-RAM CD-R/RW drive, 32kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
piix4_smbus 0000:00:07.3: Found 0000:00:07.3 device
piix4_smbus 0000:00:07.3: Host SMBus controller not enabled!
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
lp0: using parport0 (interrupt-driven).
lp0: console ready
VMware PVSCSI driver - version 0.0.0.6
ACPI: AC Adapter [ACAD] (on-line)
ACPI: Power Button (FF) [PWRF]
ACPI: Mapper loaded
dell-wmi: No known WMI GUID found
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: multipath: version 1.0.6 loaded
loop: loaded (max 8 devices)
EXT3 FS on dm-0, internal journal
kjournald starting.  Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: initialized (dev sda1, type ext3), uses xattr
SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
Adding 4095992k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:4095992k
SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
devices)
#

Before rebooting this server, I when I ran pvcreate or any lvm command I noticed this error message.

"file-based locking initialization failed"

Otheus, can you suggest any link to perform removing and adding journals on root filesystem.

Thanks,
# 7  
Old 01-21-2012
Linux is the victim here, not the culprit. Ext3 will remount a filesystem as read-only whenever it considers I/O to that device to be unreliable, in order to protect the data (as best it can). The fact that this problem is impacting more than one VM indicates an underlying problem with the storage being shared by the ESX hosts. I don't know if this is SAN storage or iSCSI or NAS shares, but whatever it is, it's in trouble at the ESX level. Look in the VMware console for the device that's being used for the root filesystems of the problem VM's and fix it. Once that's fixed, the error messages at the guest level will disappear after the guests are rebooted. This is also what's causing the errors from the LVM commands like pvcreate.
Last edited by sds9985; 01-21-2012 at 01:31 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Red Hat

Need RHEL/CentOS 7 'Little Endian' ISO for PowerPC

Hi! One of our clients need RHEL 7 on PPC hardware for their R&D setup and they are particular about this being 'Little Endian'. The problem is that Redhat doesn't have LE RHEL7 images below 7.1 while the latest toolkit (which is needed while reimaging an IBM LPAR) that IBM provides only... (0 Replies)
Discussion started by: satish51392111
0 Replies

2. Red Hat

How to reduce the LVM Size in RHEL/Centos 7 ?

Hi All, I have one logical volume with size as 900G and it is mounted as xfs file system. Now I want to reduce this partition to 500G. So I followed the below steps. unmount the mount point /home Reduced the volume using the command Now I remounted the partition. But the problem... (3 Replies)
Discussion started by: kalpeer
3 Replies

3. Red Hat

Network Teaming not working in RHEL/CentOS 7

I was testing Networking Teaming (activebackup) with a VM hosted on VmWare Workstation and VirtualBox, and the result is, if the active interface is down, the system is not using the backup interface. Tested on both CentOS / RHEL 7 Please find below the command I have used to configure teaming.... (0 Replies)
Discussion started by: atanubanerji
0 Replies

4. UNIX for Dummies Questions & Answers

[Solved] Boot Failure - Openindiana w/ Napp-it - Full Root?

Came home the other day to a Napp-it Gui that would not load. Login would appear but when i attempted I would get the following Set default permissions and reading disk and pool parameter, please wait.. in case of problems, try a reboot after Power-Off or check disk and pool status at CLI.... (1 Reply)
Discussion started by: fastedd27
1 Replies

5. Red Hat

Resizing root virtual disk on the CentOS

Hello, Can someone suggest me what I missing, I re-sized a root virtual disk to 30GB on the CentOS VM. After re-sizing the disk, I booted the OS and ran fdisk -list command I was able view the size of the disk as 30GB. Paritions in the vm before I resize are: /boot - Primary parition /... (1 Reply)
Discussion started by: bobby320
1 Replies

6. Red Hat

OpenSUSE installation using RHEL / CentOS Kickstart

Hi guys I have CentOS installed on my server. I have also installed TFTP server, DHCP server. I am able to install CentOS on remote machines using PXE boot and kickstart cfg file. I would like to install OpenSUSE using CentOS kickstart file. How do I do it ? I am also fine with any other... (2 Replies)
Discussion started by: msohail
2 Replies

7. Red Hat

IPv4 and IPv6 Related Question to CentOS VMs

Hello, I was wondering if it would be possible to run two VMs one with services for IPv4 and the other one with services for IPv6. The main physical system would be connected to a IPv6 switch. I think it should be fine but I would like to hear out your comments. (1 Reply)
Discussion started by: svalenciatech
1 Replies

8. Red Hat

Centos/rhel 5 cluster 3 nodes with out Quorum

Hi all, i have 3 nodes cluster (Centos 5 cluster suit) with out quorum disk, node vote = 1, the value of a quorum = 2, when 2 nodes going offline, cluster services are destoys. How i can save the cluster and all services(move all services to one alive node) with out quorum disk when other... (3 Replies)
Discussion started by: Flomaster
3 Replies

9. Red Hat

Questions About RHEL 6, CentOS 5.5 download and install

Hi, I have some questions about RHEL and CentOS download and installation. (1) Is RHEL6.0 x86_64 beta downloaded from Red Hat site working fine? (2) Where to download CentOS 5.5 DVD iso without using BitTorrent? (3) What are the differences between these two images - CentOS 5.5 i386 and... (6 Replies)
Discussion started by: aixlover
6 Replies

10. Virtualization and Cloud Computing

virtualization in RHEL 5.3 & Centos 5.3

Hi I would like to know how to do virtualization in Rhel 5.3 and Cent os 5.3, As i am new this Virtualization need guidence how to install and configure guest os in Rhel and Cent Os can some one guide me step by step Regards Solaris8in (1 Reply)
Discussion started by: solaris8in
1 Replies
Login or Register to Ask a Question