Tru64 How to identify what causes the server to go down?
Hi All,
I need some pointers, advice, tips & anything that can help me figure out what's causing our OSF1 xxx.xx.xxx.xxx V5.1 2650 alpha to go down unexpectedly.
It's gone down 3 times in the past 5 days.
I'm still new to unix administration, so appreciate if you could share your wealth of experiences?
From what I found on the net, I did a crashdc and the output is below:-
I need to know what is it that conclusively brought down the server?
Thanks in advance!!!
#
# crashdc
#
# Crash Data Collection (Version 1.4)
#
_crash_data_collection_time: Mon Sep 15 12:59:14 MYT 2008
_current_directory: /var/adm
_crash_kernel: /vmunix
_crash_core: /dev/mem
_crash_arch: alpha
_crash_os: Compaq Tru64 UNIX
_host_version: V5.1B (Rev. 2650)
Compaq Tru64 UNIX V5.1B (Rev. 2650); Tue Oct 3 13:39:46 GMT 2006
_crash_version: V5.1B (Rev. 2650)
Compaq Tru64 UNIX V5.1B (Rev. 2650); Tue Oct 3 13:39:46 GMT 2006
warning: Files compiled -g3: parameter values probably wrong
_crashtime: struct {
tv_sec = 1221454756
tv_usec = 262544
}
_boottime: struct {
tv_sec = 1221442983
tv_usec = 200080
}
_config: struct {
sysname = "OSF1"
nodename = "sneha.my.comptel.com"
release = "V5.1"
version = "2650"
machine = "alpha"
}
_cpu: 57
_system_string: 0xfffffffffffee8b0 = "COMPAQ AlphaServer DS10 617 MHz"
_ncpus: 1
_avail_cpus: 1
_partial_dump: 0
_physmem(MBytes): 2047
_panic_string: (nil)
_paniccpu: -1
_panic_thread: 0xfffffc0000a4e3c8
_preserved_message_buffer_begin:
struct {
hdr = struct {
msg_magic = 0x880524
msg_bufx = 0x8ff
msg_bufr = 0x8ff
msg_size = 0x1ffe0
}
msg_bufc = "Memory trolling not supported, cpu Major id 11, Minor id 6
Alpha boot: available memory from 0x2bfc000 to 0x7fffc000
Compaq Tru64 UNIX V5.1B (Rev. 2650); Tue Oct 3 13:39:46 GMT 2006
physical memory = 2048.00 megabytes.
available memory = 1979.78 megabytes.
using 7824 buffers containing 61.12 megabytes of memory
Firmware revision: 6.1-2
PALcode: UNIX version 1.88-70
COMPAQ AlphaServer DS10 617 MHz
pci0 (primary bus:0) at nexus
isa0 at pci0
gpc0 at isa0
gpc1 not probed
ace0 at isa0
ace1 at isa0
lp0 at isa0
fdi0 at isa0
fd0 at fdi0 unit 0
tu0: DECchip 21143: Revision: 4.1
tu0: auto negotiation capable device
tu0 at pci0 slot 9
tu0: DEC TULIP (10/100) Ethernet Interface, hardware address: 00-10-64-30-EC-CA
tu0: auto negotiation off: selecting 10BaseT (UTP) port: half duplex
tu1: DECchip 21143: Revision: 4.1
tu1: auto negotiation capable device
tu1 at pci0 slot 11
tu1: DEC TULIP (10/100) Ethernet Interface, hardware address: 00-10-64-30-EC-C9
tu1: auto negotiation off: selecting 10BaseT (UTP) port: half duplex
ata0 at pci0 slot 13
ata0: ACER M1543C
scsi0 at ata0 slot 0 rad 0
scsi1 at ata0 slot 1 rad 0
pci1 (primary bus:0 subordinate bus:2) at pci0 slot 15
itpsa0 at pci1 slot 4
IntraServer ROM Version V2.0 (c)1998
scsi2 at itpsa0 slot 0 rad 0
ee0 at pci1 slot 5
ee0: COMPAQ Intel 82559 (10/100 Mbps) Ethernet Interface
ee0: Driver Rev = V1.0.28, Chip Rev = 8, hardware address: 00-06-2B-02-F6-56
comet0: Card type 'IntraServer Combo/3DLabs P2V' with 4MB framebuffer memory.
comet0 at pci1 slot 6
Created FRU table binary error log packet
kernel console: ace0
dli: configured
NetRAIN configured.
Random number generator configured.
i2c: Server Management Hardware Present
ee0: Autonegotiated, 100 Mbps full duplex
vm_swap_init: swap is set to eager allocation mode
datalink: links=128, macs=6
Environmental Monitoring Subsystem Configured.
SuperLAT. Copyright 1994 Meridian Technology Corp. All rights reserved.
mvfs: Ok: INFO: MVFS: Setting mvfs_largeinit to 2 based on physical memory size of 2097136KB
mvfs: Ok: INFO: MVFS version 2002.05.00 (Sun May 8 10:18:11 EDT 2005)
(C) Copyright IBM Corp. 1990, 2005. All Rights Reserved.
Covered by U.S. patent No 5,574,898.
Other U.S. and foreign patents pending.
Covered by U.S. patent No 5,574,898.
Other U.S. and foreign patents pending.
"
}
_preserved_message_buffer_end:
_kernel_process_status_begin:
PID COMM
00000 kernel idle
00001 init
00003 kloadsrv
00005 hotswapd
00053 esmd
00084 update
00209 evmd
00252 evmlogger
00253 evmchmgr
00402 syslogd
00406 binlogd
00496 portmap
00504 ypbind
00511 mountd
00513 nfsd
00516 nfsiod
00519 rpc.statd
00522 rpc.lockd
00528 automount
00691 sshd2
00714 xntpd
00749 sendmail
00752 snmpd
00760 svrMgt_mib
00762 svrSystem_mib
00772 os_mibs
00773 pmgrd
00792 cpq_mibs
00806 cpqthresh_mib
00835 config_hmmod
00836 sysman_hmmod
00841 insightd
00842 envmond
00877 advfsd
00888 inetd
00889 inetd
00915 cron
01012 lpd
01029 albd_server
01031 lockmgr
04800 nsrexecd
04801 nsrexecd
04809 dtlogin
04867 java
04893 Xdec
04895 dtlogin
04904 smsd
04921 dtgreet
04978 getty
05011 sshd2
05013 sh
05140 httpd
05142 rotatelogs
05144 rotatelogs
05149 httpd
05150 httpd
05151 httpd
05152 httpd
05166 java
05189 rmiregistry
05192 start_nemo.ksh
05197 java
05198 update_pid_file.
05209 start_te.ksh
05216 java
05217 update_pid_file.
05220 start_re.ksh
05227 java
05228 update_pid_file.
05238 il_monitor.ksh
05476 sshd2
05479 sh
05811 ftcd
05940 httpd
05946 httpd
06008 httpd
06012 oracle
06014 oracle
06016 oracle
06018 oracle
06021 oracle
06023 oracle
06061 httpd
06062 httpd
06063 httpd
06064 httpd
06078 tnslsnr
06081 oracle
06105 httpd
06107 oracle
06166 oracle
06243 oracle
06244 fcron
06286 oracle
06287 ftm
06438 httpd
06439 httpd
06440 httpd
06958 oracle
06982 oracle
06984 oracle
07062 oracle
08127 sshd2
08129 sh
08283 oracle
17851 uerf
19020 sshd2
19022 bash
19051 vi
19142 sleep
19166 sleep
19178 crashdc
19196 awk
19197 crashdc
19198 dbx
19199 grep
19200 grep
19201 grep
19202 sleep
19213 sleep
_kernel_process_status_end:
_current_pid: 19198
_current_tid: 0xfffffc0074e9f880
_proc_thread_list_begin:
thread 0xfffffc0074e9f880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
_proc_thread_list_end:
_dump_begin:
> 0 thread_block() ["../../../../src/kernel/kern/sched_prim.c":3317, 0xfffffc00002eaab0]
thread = 0xfffffc0074e9f880
new_thread = (nil)
myprocessor = (nil)
map_lock = (nil)
mycpu = 0
s = 0
pag = (nil)
sp = 0xfffffc00041f68c0
1 vm_fault(0xfffffc001dcbdc00, 0x0, 0x0, 0xfffffe04a1c18000, 0xfffffc00255e5ec0) ["../../../../src/kernel/vm/vm_fault.c":202, 0xfffffc000053309c]
_dump_end:
_kernel_thread_list_begin:
thread 0xfffffc007fe1e380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1e700 stopped at [thread_bootstrap:3220 ,0xfffffc00005770b0] Source not available
thread 0xfffffc007fe1ea80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1ee00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1f180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1f500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1f880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe1fc00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe32000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe32380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe32700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe32a80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe32e00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe33180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe33500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe33880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe33c00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3e000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3e380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3e700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3ee00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3f180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fe3f500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ee000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ee380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4eea80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ef180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ef500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ef880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4efc00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fea2000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fea2380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b4ee700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fea3880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007fea3c00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f0000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f0380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f0700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f0a80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f0e00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f1180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f1500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f1880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b3f1c00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40a000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40a380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40a700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40aa80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40ae00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40b180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40b500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40b880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b40bc00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b470000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b470380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b470700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b470a80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b471180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b471500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc007b471880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc003e29a000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc006b865180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc006b864e00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc006b864a80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc006b865880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc006b865c00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075824000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075824380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075824700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075824a80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075824e00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075825180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075825500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075825880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0075825c00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060cae000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060cae380 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060cae700 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060caea80 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060caee00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060caf180 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060caf500 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060caf880 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0060cafc00 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc0013dc2000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
thread 0xfffffc005eb9e000 stopped at [thread_block:3317 ,0xfffffc00002eaab0] Source not available
_kernel_thread_list_end:
_savedefp: (nil)
_kernel_memory_fault_data_begin:
struct {
fault_va = 0x0
fault_pc = 0x0
fault_ra = 0x0
fault_sp = 0x0
access = 0x0
status = 0x0
cpunum = 0x0
count = 0x0
pcb = (nil)
thread = (nil)
task = (nil)
proc = (nil)
}
_kernel_memory_fault_data_end:
_uptime: 3.27 hours
warning: Files compiled -g3: parameter values probably wrong
paniccpu: 0xffffffff
machine_slot[paniccpu]: struct {
is_cpu = 0x0
cpu_type = 0x0
cpu_subtype = 0xa4e388
running = 0xfffffc00
cpu_ticks = {
[0] 0xfffffc0000a4e388
[1] 0x0
[2] 0x7fffffff
[3] 0x9cb
[4] 0x0
}
clock_freq = 0x0
error_restart = 0x0
cpu_panicstr = 0xfffffc007fea3880 = ""
cpu_panic_thread = 0xfffffc0000a4e3c8
}
tset machine_slot[paniccpu].cpu_panic_thread:
Begin Trace for machine_slot[paniccpu].cpu_panic_thread:
warning: thread 0xfffffc0000a4e3c8 appears to be swapped out
invalid pid (2145406016)
ignored: cannot set pid
> 0 thread_block() ["../../../../src/kernel/kern/sched_prim.c":3317, 0xfffffc00002eaab0]
1 thread_preempt(thread = 0xfffffc00003cd650, may_susp = 0x1dcbdb00) ["../../../../src/kernel/kern/sched_prim.c":5206, 0xfffffc00002edc94]
End Trace for machine_slot[paniccpu].cpu_panic_thread:
warning: Files compiled -g3: parameter values probably wrong
_stack_trace[0]_begin:
> 0 thread_block() ["../../../../src/kernel/kern/sched_prim.c":3317, 0xfffffc00002eaab0]
1 fifo_write(vp = 0xfffffe04a1577878, uiop = 0xfffffc001dcbdb00, ioflag = 0, cred = (unallocated - symbol optimized away)) ["../../../../src/kernel/vfs/fifo_vnops.c":1182, 0xfffffc00004cb0d0]
_stack_trace[0]_end:
warning: Files compiled -g3: parameter values probably wrong
_kdbx_sum_start:
Hostname : sneha.my.comptel.com
cpu: COMPAQ AlphaServer DS10 617 MHz avail: 1
Boot-time: Mon Sep 15 09:43:03 2008
Time: Mon Sep 15 12:59:56 2008
Kernel : OSF1 release V5.1 version 2650 (alpha)
_kdbx_sum_end:
_kdbx_swap_start:
Swap device name Size In Use Free
-------------------------------- ---------- ---------- ----------
/dev/disk/dsk0b 1536000k 8k 1535992k
192000p 1p 191999p
/dev/disk/dsk1a 2144040k 8k 2144032k
268005p 1p 268004p
/dev/disk/dsk2a 2301688k 8k 2301680k
287711p 1p 287710p
-------------------------------- ---------- ---------- ----------
Total swap partitions: 3 5981728k 24k 5981704k
747716p 3p 747713p
_kdbx_swap_end:
_kdbx_proc_start:
Addr PID PPID PGRP UID NICE SIGCATCH P_SIG Event Flags
=========== ===== ===== ===== ===== ==== ======== ======== =========== ============
k0x7fe11740 0 0 0 0 0 00000000 00000000 NULL in sys
k0x7fe20cc0 1 0 1 0 0 307a62ff 00000000 NULL in contign pagv
k0x7fecc240 3 1 3 0 0 00000001 00000000 NULL in pagv
k0x7fecccc0 5 1 5 0 0 00001ef8 00000000 NULL in pagv
k0x7fe21740 53 1 53 0 0 00003001 00000000 NULL in pagv
k0x25500240 84 1 84 0 0 00002000 00000000 NULL in pagv
k0x5c054cc0 209 1 209 0 0 fffffffffffaf047 00000000 NULL in pagv
k0x4bc5d740 252 209 209 0 0 40083001 00000000 NULL in pagv
k0x4bc5c240 253 209 209 0 0 00003001 00000000 NULL in pagv
k0x6ba70cc0 402 1 402 0 0 70087001 00000000 NULL in pagv
k0x6ba70240 406 1 406 0 0 20007001 00000000 NULL in pagv
k0x4bc5ccc0 496 1 496 0 0 00080628 00000000 NULL in pagv
k0x5c055740 504 1 0 0 0 00086efe 00000000 NULL in pagv
k0x5c054240 511 1 511 0 0 66006001 00000000 NULL in pagv
k0x6c96e240 513 1 513 0 0 00000000 00000000 NULL in pagv
k0x6c96ecc0 516 1 516 0 0 00000000 00000000 NULL in pagv
k0x6c96f740 519 1 519 0 0 66082000 00000000 NULL in pagv
k0x13956240 522 1 522 0 0 66002000 00000000 NULL in pagv
k0x13957740 528 1 0 0 0 20084001 00000000 NULL in pagv
k0x6ba71740 691 1 691 0 0 ffffffffe3887eff 00000000 NULL in pagv
k0x5a9d7740 714 1 714 0 0 60006207 00000000 NULL in pagv
k0x4ddc8240 749 1 749 0 0 20086ef9 00000000 NULL in pagv
k0x13956cc0 752 1 752 0 0 20004003 00000000 NULL in pagv
k0x2cf6d740 760 1 760 0 0 00004002 00000000 NULL in pagv
k0x4ddc8cc0 762 1 762 0 0 00004002 00000000 NULL in pagv
k0x35530cc0 772 1 772 0 0 00004002 00000000 NULL in pagv
k0x35531740 773 1 773 0 -1 00005002 00000000 NULL in pagv
k0x5b8a6cc0 792 1 792 0 0 00003efa 00000000 NULL in pagv
k0x5a9d6cc0 806 1 806 0 0 00004002 00000000 NULL in pagv
k0x2cf6c240 835 1 835 0 0 00000ef8 00000000 NULL in pagv
k0x35814cc0 836 1 836 0 0 00000ef8 00000000 NULL in pagv
k0x5a9d6240 841 1 840 0 0 03806efa 00000000 NULL in pagv ctty
k0x2cf6ccc0 842 1 842 0 0 00004003 00000000 NULL in pagv
k0x35530240 877 1 354 0 -1 60027eff 00000000 NULL in pagv ctty
k0x4ddc9740 888 1 888 0 0 40084005 00000000 NULL in pagv
k0x5b8a7740 889 888 888 0 0 60083001 00000000 NULL in pagv
k0x3f832cc0 915 1 915 0 0 00006000 00000000 NULL in pagv
k0x35815740 1012 1 1012 0 0 00085007 00000000 NULL in pagv
k0x3f832240 1029 1 0 0 0 000a4007 00000000 NULL in pagv
k0x43186240 1031 1 1031 0 0 00000004 00000000 NULL in pagv
k0x43187740 4800 1 4800 0 0 40001ef8 00000000 NULL in pagv
k0x35814240 4801 4800 4800 0 0 40084efb 00000000 NULL in pagv
k0x4e27c240 4809 1 4809 0 0 20084003 00000000 NULL in pagv
k0x3f833740 4867 1 354 0 0 21800efc 00000000 NULL in pagv ctty
k0x2084d740 4893 4809 4893 0 0 00004203 00000000 NULL in pagv
k0x4e27d740 4895 4809 4895 0 0 20004002 00000000 NULL in pagv
k0x4e27ccc0 4904 1 4904 0 0 00000ef8 00000000 NULL in pagv
k0x25500cc0 4921 4895 4921 0 0 00004000 00000000 NULL in pagv
k0x7fecd740 4978 1 4978 0 0 00000000 00000000 NULL in pagv ctty
k0x43186cc0 5011 691 691 0 0 ffffffffe3887eff 00000000 NULL in pagv
k0x2084c240 5013 5011 5013 0 0 60003eff 00000000 NULL in pagv ctty
k0x19458cc0 5140 1 5140 2960 0 2000462b 00000000 NULL in pagv
k0x54689740 5142 5140 5140 2960 0 00000000 00000000 NULL in pagv
k0x19459740 5144 5140 5140 2960 0 00000000 00000000 NULL in pagv
k0x14029740 5149 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x54688240 5150 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x79179740 5151 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x09160240 5152 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x19458240 5166 1 5120 2960 0 20004403 00000000 NULL in pagv ctty
k0x54688cc0 5189 1 5189 2960 0 20004efb 00000000 NULL in pagv
k0x79178240 5192 1 5192 2960 0 60006afb 00000000 NULL in pagv
k0x5b8a3740 5197 5192 5192 2960 0 20004403 00000000 NULL in pagv
k0x5b8a2240 5198 5192 5192 2960 0 60006af9 00000000 NULL in pagv
k0x47242240 5209 1 5209 2960 0 60006afb 00000000 NULL in pagv
k0x47243740 5216 5209 5209 2960 0 20004403 00000000 NULL in pagv
k0x47242cc0 5217 5209 5209 2960 0 60006af9 00000000 NULL in pagv
k0x03816cc0 5220 1 5220 2960 0 60006afb 00000000 NULL in pagv
k0x166a0240 5227 5220 5220 2960 0 20004403 00000000 NULL in pagv
k0x03817740 5228 5220 5220 2960 0 60006af9 00000000 NULL in pagv
k0x09161740 5238 1 5120 2960 0 60007af8 00000000 NULL in pagv ctty
k0x0b2ea240 5476 691 691 0 0 ffffffffe3887eff 00000000 NULL in pagv
k0x0b2eacc0 5479 5476 5479 0 0 60003eff 00000000 NULL in pagv ctty
k0x79178cc0 5811 1 5811 3095 0 0000468b 00000000 NULL in pagv
k0x60faa240 5940 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x52eb2240 5946 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x11890cc0 6008 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x1e61f740 6012 1 6012 1000 0 41802ebc 00000000 NULL in pagv
k0x6c714240 6014 1 6014 1000 0 41802ebc 00000000 NULL in pagv
k0x6c715740 6016 1 6016 1000 0 41802ebc 00000000 NULL in pagv
k0x166a0cc0 6018 1 6018 1000 0 41802ebc 00000000 NULL in pagv
k0x6faf7740 6021 1 6021 1000 0 41802ebc 00000000 NULL in pagv
k0x708b4240 6023 1 6023 1000 0 41802ebc 00000000 NULL in pagv
k0x708b5740 6061 1 6061 3095 0 2000462b 00000000 NULL in pagv
k0x1e61ecc0 6062 6061 6061 3095 0 2408f62b 00000000 NULL in pagv
k0x52eb2cc0 6063 6061 6061 3095 0 2408f62b 00000000 NULL in pagv
k0x6faf6240 6064 6061 6061 3095 0 2408f62b 00000000 NULL in pagv
k0x1cd54240 6078 1 6078 1000 0 00000000 00000000 NULL in pagv ctty
k0x11890240 6081 1 6081 1000 0 4180aebc 00000000 NULL in pagv
k0x60fab740 6105 6061 6061 3095 0 2408f62b 00000000 NULL in pagv
k0x6c714cc0 6107 6062 6107 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x1cd54cc0 6166 1 6166 1000 0 4180aebc 00000000 NULL in pagv
k0x0d59ccc0 6243 1 6243 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x0d59c240 6244 1 6244 3095 0 0008568b 00000000 NULL in pagv
k0x1e61e240 6286 1 6286 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x3b2ef740 6287 1 6287 3095 0 2008568b 00000000 NULL in pagv
k0x03816240 6438 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x6683b740 6439 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x0d59d740 6440 5140 5140 2960 0 0000462b 00000000 NULL in pagv
k0x74d53740 6958 1 6958 1000 0 4180aebc 00000000 NULL in pagv
k0x42c3ccc0 6982 1 6982 1000 0 4180aebc 00000000 NULL in pagv
k0x74d52cc0 6984 6064 6984 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x42c3c240 7062 6105 7062 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x1963e240 8127 691 691 0 0 ffffffffe3887eff 00000000 NULL in pagv
k0x1963ecc0 8129 8127 8129 0 0 60003eff 00000000 NULL in pagv ctty
k0x6fafa240 8283 6063 8283 3095 0 4180aebc 00000000 NULL in pagv xonly
k0x3b2eecc0 17851 5479 5479 0 0 00000000 00000000 NULL in pagv ctty
k0x74d52240 19020 691 691 0 0 ffffffffe3887eff 00000000 NULL in pagv
k0x3b2ee240 19022 19020 19022 3095 0 67883efb 00000000 NULL in pagv ctty
k0x42c3d740 19051 19022 19051 3095 0 080216bb 00000000 NULL in pagv ctty
k0x60faacc0 19178 5013 5013 0 0 00007efe 00000000 NULL in pagv ctty
k0x5b8a2cc0 19240 19178 5013 0 0 00000000 00000000 NULL in pagv ctty
k0x3613a240 19241 19240 5013 0 0 00007efe 00000000 NULL in exit pagv ctty
k0x3613acc0 19242 19240 5013 0 0 080c3002 00000000 NULL in pagv ctty
k0x1963f740 19243 19240 5013 0 0 00000000 00000000 NULL in pagv ctty
k0x6fafb740 19244 19240 5013 0 0 00000000 00000000 NULL in pagv ctty
k0x6fafacc0 19245 19242 19245 0 0 0000068e 00000000 NULL in pagv ctty
k0x2084ccc0 19271 19242 5013 0 0 00000000 00000000 NULL in pagv ctty
k0x09160cc0 19327 5198 5192 2960 0 00000000 00000000 NULL in pagv
k0x256c7740 19336 5217 5209 2960 0 00000000 00000000 NULL in pagv
k0x701eacc0 19337 5228 5220 2960 0 00000000 00000000 NULL in pagv
k0x166a1740 19359 5238 5120 2960 0 00000000 00000000 NULL in pagv ctty
_kdbx_proc_end:
warning: Files compiled -g3: parameter values probably wrong
Audit subsystem disabled
field .base: Not a structure
pid 19707 exited with status 1
#
_crash_data_collection_finished:
Parts of the /var/adm/messages prior to the system startup are printing these error messages:-
...
...
...
Sep 6 10:23:04 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:19 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:19 sneha vmunix: NFS3 RFS3_GETATTR failed for server kaix53net: RPC: Timed out
Sep 6 10:23:20 sneha last message repeated 2 times
Sep 6 10:23:21 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:22 sneha vmunix: NFS3 RFS3_GETATTR failed for server kaix53net: RPC: Timed out
Sep 6 10:23:23 sneha last message repeated 3 times
Sep 6 10:23:24 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:39 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:39 sneha vmunix: NFS3 RFS3_GETATTR failed for server kaix53net: RPC: Timed out
Sep 6 10:23:39 sneha vmunix: NFS3 RFS3_GETATTR failed for server kaix53net: RPC: Timed out
Sep 6 10:23:41 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
Sep 6 10:23:42 sneha vmunix: NFS3 RFS3_GETATTR failed for server kaix53net: RPC: Timed out
Sep 6 10:23:43 sneha last message repeated 3 times
Sep 6 10:23:44 sneha vmunix: NFS3 RFS3_READ failed for server kaix53net: RPC: Timed out
...
...
...
Sep 11 16:28:10 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 16:43:22 sneha last message repeated 10 times
Sep 11 16:47:05 sneha last message repeated 2 times
Sep 11 17:47:24 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 17:54:59 sneha last message repeated 9 times
Sep 11 22:03:21 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 22:03:54 sneha last message repeated 2 times
Sep 11 23:17:40 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 23:21:19 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 23:28:45 sneha vmunix: fcntl: Local lock-manager not registered
Sep 11 23:35:31 sneha last message repeated 6 times
Sep 12 10:10:13 sneha vmunix: fcntl: Local lock-manager not registered
Sep 12 10:20:18 sneha last message repeated 14 times
Sep 12 10:30:28 sneha last message repeated 37 times
Sep 12 10:40:28 sneha last message repeated 34 times
Sep 12 10:50:18 sneha last message repeated 23 times
Sep 12 11:00:34 sneha last message repeated 28 times
...
...
...
09-15-2008
