Svc messages flooding the system logs every second


 
Thread Tools Search this Thread
Operating Systems Solaris Svc messages flooding the system logs every second
# 1  
Old 11-27-2012
Oracle Svc messages flooding the system logs every second

Hi all

I have a newly installed Oracle X2-4 server running Solaris 10 x86 with the latest patches.
I have one non-global zone configured running an Oracle DB instance.
After configuring IPMP failover between two NICs on the server and rebooting I am seeing the /var/adm/messages being flooded every second with the following output:

Code:
Nov 26 10:21:24 host_server svc.startd[9]: [ID 122153 daemon.warning] svc:/system/vxpbx:default: Method or service exit timed out.  Killing contract 7299.
Nov 26 10:21:24 host_server svc.startd[9]: [ID 122153 daemon.warning] svc:/application/management/wbem:default: Method or service exit timed out.  Killing contract 7301.
Nov 26 10:21:24 host_server svc.startd[9]: [ID 122153 daemon.warning] svc:/application/management/hwmgmtd:default: Method or service exit timed out.  Killing contract 95.
Nov 26 10:21:24 host_server svc.startd[9]: [ID 122153 daemon.warning] svc:/system/webconsole:console: Method or service exit timed out.  Killing contract 7306.
Nov 26 10:21:24 host_server svc.startd[9]: [ID 122153 daemon.warning] svc:/system/zones:default: Method or service exit timed out.  Killing contract 7300.

svcs -xv returns a blank output.
I've tried disabling those services but to no avail. I've also rebooted the server.
I am not seeing any negative impact in terms of server functionality. The IPMP failover works fine, the zone is running perfectly as well.

Any help in resolving this would be highly appreciated.

Last edited by notreallyhere; 11-27-2012 at 07:07 AM.. Reason: typos
# 2  
Old 11-27-2012
Something is not configured correctly - obviously. And things are not fine.
You created (I hope) two
Code:
/etc/hostname.[NIC card name]
like:
/etc/hostname.bge0

files
Your actual names will be different.

Please show the output of:
Code:
cat /etc/hostname.ce0  # or whatever it is called
cat /etc/hostname.ce1  # or whatever it is called
grep solaris /etc/hostname
ifconfig -a
ipmpstat -g

Have you tried:
Code:
if_mpadm -d [name of primary NIC]

Don't do it yet, please. You may cause more problems.
# 3  
Old 11-27-2012
Hi Jim

This server was one of 7 that I was busy configuring with IPMP failover. I've used the same procedure as on the other servers and this is the only one that is giving me this issue.

Below are some outputs:

Code:
:~# grep solaris /etc/hostname
grep: can't open /etc/hostname

Code:
:~# dladm show-dev
igb0            link: up        speed: 1000  Mbps       duplex: full
igb1            link: up        speed: 1000  Mbps       duplex: full
igb2            link: unknown   speed: 0     Mbps       duplex: half
igb3            link: unknown   speed: 0     Mbps       duplex: half

Code:
:~# ls -l /etc/hostname.*
-rw-r--r--   1 root     root         117 Nov 25 12:04 /etc/hostname.igb0
-rw-r--r--   1 root     root          76 Nov 25 12:03 /etc/hostname.igb1

Code:
:~# cat /etc/hostname.igb0
host_server-igb0 group ipmp_prod netmask + broadcast + -failover deprecated up addif host_server  netmask + broadcast + up

:~# cat /etc/hostname.igb1
host_server-igb1 group ipmp_prod netmask + broadcast + -failover deprecated up

Code:
:~# cat /etc/hosts
xx.xx.xx.xx   host_server        host_server.domain       loghost
xx.xx.xx.xx   host_server-igb0
xx.xx.xx.xx   host_server-igb1

Code:
:~# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000
lo0:1: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        zone db_zone
        inet 127.0.0.1 netmask ff000000
igb0: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 5
        inet xx.xx.xx.xx netmask fffffc00 broadcast xx.xx.xx.xx
        groupname ipmp_prod
        ether x:x:x:x:x
igb0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 5
        inet xx.xx.xx.xx netmask fffffc00 broadcast xx.xx.xx.xx
igb0:2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 5
        zone db_zone
        inet xx.xx.xx.xx netmask fffffc00 broadcast xx.xx.xx.xx
igb1: flags=9040843<UP,BROADCAST,RUNNING,MULTICAST,DEPRECATED,IPv4,NOFAILOVER> mtu 1500 index 4
        inet xx.xx.xx.xx netmask fffffc00 broadcast xx.xx.xx.xx
        groupname ipmp_prod
        ether x:x:x:x:x

I have also run the if_mpadm command to test failover on both primary and secondary NICs (I do this by default to test IPMP after configuring it) and I have not lost my ssh session and failover works as it should.
Perhaps I have missed something and maybe you can spot it in some of the outputs I've posted.
# 4  
Old 11-27-2012
And you ran
Code:
if_mpadm -r

to restore the primary NIC. I'm assuming ipmpstat shows ok on both NICs.

I don't see anything. However, some of those services that are having problems like system/zones are important, and should not be dumping logs.

Maybe someone else can see something. There are several folks here with Solaris admin background.
# 5  
Old 11-27-2012
Can you post output of:
Code:
svcs -xv svc:/system/vxpbx:default svc:/system/zones:default

# 6  
Old 11-27-2012
Quote:
Originally Posted by jim mcnamara
And you ran
Code:
if_mpadm -r

to restore the primary NIC. I'm assuming ipmpstat shows ok on both NICs.
I forgot to mention that I don't have that ipmpstat command on my Solaris installation. I ran a find on it now as well but came up with no results.

---------- Post updated at 01:04 PM ---------- Previous update was at 01:02 PM ----------

Quote:
Originally Posted by bartus11
Can you post output of:
Code:
svcs -xv svc:/system/vxpbx:default svc:/system/zones:default

Code:
:~# svcs -xv svc:/system/vxpbx:default svc:/system/zones:default
svc:/system/vxpbx:default (Symantec Private Branch Exchange Service.)
 State: online since Sun Nov 25 11:51:02 2012
   See: /var/svc/log/system-vxpbx:default.log
Impact: None.

svc:/system/zones:default (Zones autoboot and graceful shutdown)
 State: online since Sun Nov 25 11:51:02 2012
   See: man -M /usr/share/man -s 5 zones
   See: man -M /usr/share/man -s 1M zonecfg
   See: /var/svc/log/system-zones:default.log
Impact: None.

# 7  
Old 11-27-2012
And:
Code:
tail -20 /var/svc/log/system-vxpbx:default.log
tail -20 /var/svc/log/system-zones:default.log

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sudo or su keeps flooding my /var/log/messages

It is crazy when you just entered a command example sudo or su or even ps. It will flood your /var/log/messages. Please see duplicate entries except for the pid. At 1 specific time. Thanks $ cat b Jan 13 17:09:05 SERVER1 bash: user1 as root: Jan 13 17:09:05 SERVER1 bash: user1 as root: Jan... (3 Replies)
Discussion started by: invinzin21
3 Replies

2. Red Hat

Writing to System Logs

This isn't a RedHat specific question. The software in question might be used for any Linux distribution. Would it be advisable or inadvisable for my application, to be downloaded by many people I don't know, to write to the following logs in /var/log? maillog or mail.log messages secure ... (10 Replies)
Discussion started by: Brandon9000
10 Replies

3. Solaris

svc:/network/physical:default: Method "/lib/svc/method/net-physical" failed with exit status 96. [ n

After a memory upgrade all network interfaces are misconfigued. How do i resolve this issue. Below are some out puts.thanks. ifconfig: plumb: SIOCLIFADDIF: eg000g0:2: no such interface # ifconfig eg1000g0:2 plumb ifconfig: plumb: SIOCLIFADDIF: eg1000g0:2: no such interface # ifconfig... (2 Replies)
Discussion started by: andersonedouard
2 Replies

4. AIX

system logs

good evening all dear all where i can find the system logs in AIX 5.3 (1 Reply)
Discussion started by: thecobra151
1 Replies

5. Solaris

svc:/system/filesystem/local is always in maintenance status

Hello Friends, I need to change network filesystem status as online but it always seems in maintenance mode, I appreciate your any suggestion to change its state as online. shell>svcadm enable svc:/system/filesystem/local shell>svcs -l svc:/system/filesystem/local fmri ... (4 Replies)
Discussion started by: EAGL€
4 Replies

6. Solaris

logs for system shutdown

I am working on a SUN T2000 machine with Solaris 10 running on it. When I checked the system this morning, I found it to be turned off. The lastreboot command showed that the system had been shut down the previous night. I want to find out how the system was shut down. I have run hardware health... (2 Replies)
Discussion started by: batman727
2 Replies

7. Solaris

smf fails to mount svc:/system/filesystem/usr:default

http://i44.tinypic.com/2cmq7vn.jpg Please help me on this issue i'm using solaris on vmware x86 even i runed fsck on root disk like 'fsck -Y /dev/rdsk/c0d0s0 ' but again after reboot it is going to maintanance mode reply soon (6 Replies)
Discussion started by: knl.sundeep
6 Replies

8. AIX

System Logs

Dear Gurus I am running AIX with several users that are using the system, i would like to monitor the commands that are run by these users. Is there a log system that records the commands that are executed by the users??? Any kind of help will be appreciated. Regards Masquerder (6 Replies)
Discussion started by: masquerer
6 Replies

9. Solaris

system logs' life

How can you control old system logs keep(or storage) time in Solaris ? Is there any method ? it depends on buffer size long or date long ? (1 Reply)
Discussion started by: xramm
1 Replies

10. Solaris

how do you login as sms-svc on a system controller

hi, i have got a SUN F15K DOMAIN TAKING HARDWARE CONFIGURATION DUMP. DUMP FILE: -D/VA message i wnat to logon as sms-svc on to the controller to check what's happening can you please guide me how do i login as sms-svc on the controller and check thank you (1 Reply)
Discussion started by: vinix
1 Replies
Login or Register to Ask a Question