CPU with long hours in top, is this bad?


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers CPU with long hours in top, is this bad?
# 1  
Old 05-30-2013
CPU with long hours in top, is this bad?

Hi,

We have a Solaris server that has about 43 Oracle databases on it and we also have the Oracle Enterprise Manager - emagent that is used to monitor these databases

When running top, the emagent is showing as one of the top process. Excerpts from running top shows something as below:

Code:
 
load averages:  2.34,  2.48,  2.60                                                                                                                        19:27:50
2197 processes:2195 sleeping, 2 on cpu
CPU states: 86.8% idle,  4.4% user,  8.7% kernel,  0.0% iowait,  0.0% swap
Memory: 128G real, 39G free, 96G swap free
  PID USERNAME THR PRI NICE  SIZE   RES STATE   TIME    CPU COMMAND
29230 oracle    45  59    0    0K    0K sleep  73.8H  0.38% emagent
28396 oracle     1   1    0    0K    0K sleep   0:00  0.13% perl
16834 oracle     1  46    0    0K    0K sleep  31:38  0.09% oracle
14364 oracle     1  12    0    0K    0K sleep 164:26  0.07% oracle
25177 oracle     1  28    0    0K    0K sleep 152:25  0.07% oracle
19822 oracle     1   1    0    0K    0K sleep 182:10  0.07% oracle
 
$: ps -eafl | grep emagent
 0 S   oracle 28653 16712   0  40 20        ?    212        ? 19:28:46 pts/11      0:00 grep emagent
 0 O   oracle 29230 22667   0  48 20        ?  48687            May 17 ?        4430:37 /opt/oracle/agent11g/bin/emagent
 
$: prstat -T
   PID USERNAME  SIZE   RSS STATE  PRI NICE      TIME  CPU PROCESS/NLWP
  5147 oracle     10M 9272K cpu2    55    0   0:00:03 0.7% prstat/1
 29230 oracle    380M  373M cpu20   51    0  73:51:26 0.4% emagent/45
     4 root        0K    0K sleep    0  -20  29:55:55 0.4% vmtasks/16
  4368 root       45M   25M sleep   18    0  20:00:42 0.1% nscd/110
 16834 oracle   2781M 2148M sleep   55    0   0:31:43 0.1% oracle/1
 17621 oracle   1069M 1041M sleep   27    0   2:53:57 0.1% oracle/1
 13057 oracle   3421M 1086M sleep   44    0   3:29:45 0.1% oracle/1
 18015 oracle    721M  526M sleep    1    0   3:02:31 0.1% oracle/1
  8979 oracle   2781M  829M sleep   58    0   3:02:56 0.1% oracle/1
  4757 oracle   1724M  606M sleep    1    0   1:11:26 0.1% oracle/1
 13041 oracle   3422M 1071M sleep   59    0   4:57:26 0.1% oracle/1
 17435 oracle   2781M  873M sleep   50    0   3:05:52 0.0% oracle/1
 19822 oracle    721M  526M sleep    1    0   3:02:12 0.0% oracle/1
  9220 oracle   2269M  769M sleep    1    0   3:00:23 0.0% oracle/1
  6636 oracle   3037M  846M sleep    1    0   2:46:36 0.0% oracle/1
 15778 oracle   1757M  677M sleep    1    0   2:45:13 0.0% oracle/1
 10156 oracle   2789M 2184M cpu5     1    0   0:08:18 0.0% oracle/1
 19567 oracle    733M  697M sleep    1    0   2:27:16 0.0% oracle/1

Please advise if this is something to worry about or not? If the monitoring agent is a problem then that seems to suggest it is not doing what it is supposed to be doing and is actually causing a problem itself Smilie

Any advise/feedback much appreciated. Thanks in advance.
# 2  
Old 05-30-2013
When you say 43 databases, do you mean that there are 43 SIDs running and therefore 43 pmon processes? If this is the case, then I'm not surprised that the process you are seeing has lots of work to do, just keeping track of them all.

If you mean 43 schemas in one SID (one pmon process) then this is a little more worrying, but I suppose the question is "Are you seeing any performance problems?"




Robin
Liverpool/Blackburn
UK
# 3  
Old 06-04-2013
Quote:
Originally Posted by rbatte1
When you say 43 databases, do you mean that there are 43 SIDs running and therefore 43 pmon processes? If this is the case, then I'm not surprised that the process you are seeing has lots of work to do, just keeping track of them all.

If you mean 43 schemas in one SID (one pmon process) then this is a little more worrying, but I suppose the question is "Are you seeing any performance problems?"




Robin
Liverpool/Blackburn
UK

Hi,

There are 43 SIDs and therefore 43 pmon processes.

We are not seeing performance issue per se, but most of the times, OEM just times out and some of the databases when you check on OEM are in an unknown state.

And on the database server, if I try to do emctl clearstate to clear up the unknown, it returns with a Timeout Smilie-

Last edited by newbie_01; 06-04-2013 at 05:47 AM.. Reason: more info
# 4  
Old 06-04-2013
With this number of SIDs in play I would consider the memory load that they will create. Perhaps the total memory defined for each exceeds real memory and you are forcing paging. This could cause an load on the server with processes timing out as all the SIDs fight for the IO to get their memory pages back in.

I've been off Solaris for a while so I can't quite remember the commands. swap -l perhaps? Another thing to investigate with is vmstat

If you set it running on one screen with vmstat 5 and make sure that the display is wide enough to display it all (statistics wrapped wrong a line are very hard to see a trend) and look at the Page section (check in the man page which it is) then on a second screen or using the OEM, fire in the request and watch what happens.

If this does cause paging, then you might be in a struggle to lower the memory definitions of each SID, but obviously keeping them running satisfactorily. You may be after purchasing memory at the end of this, if paging is the problem. Sorry.

I hope that this gives you a pointer. I would welcome any other suggestions though.


Robin
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Red Hat

Understanding cpu consumption with TOP

Hi please see attached picture of the TOP command. the "java" process seem to consume 700% of cpu is that mean that he uses 100% of every 7 cpu cores? thanks (2 Replies)
Discussion started by: guy3145
2 Replies

2. Solaris

Help me Solaris 10&11 cpu load average states for 24 hours report

need to capture the following data on an hourly basis without cronjob scheduling in Solaris 5.10/5.11:- 1. load averages 2. Total no. of processes. 3. CPU state 4. Memory 5. Top 3 process details. any other third-party tool is available? (7 Replies)
Discussion started by: thoranam
7 Replies

3. Solaris

Long running thread limited to 1.5% cpu

I have some long running threads on a T5220 / Solaris 10 box and it seems they never get more then 1.5% of cpu per thread. Is there a way to give a thread more cpu on the T5220's? (1 Reply)
Discussion started by: jcthreader
1 Replies

4. HP-UX

Bad performance but Low CPU loading?

There might be some problem with my server, because every morning at 7, it's performance become bad with no DB extra deadlock. But I just couldn't figure it out. Please give me some advise, thanks a lot... According to the CPU performace chart, Daily CPU loading Maximum: 42 %, Average:36%. ... (8 Replies)
Discussion started by: GreenShery
8 Replies

5. Solaris

top is showing 0% cpu Idle

What should we do if we show a 0% cpu idl on top? (5 Replies)
Discussion started by: Pouchie1
5 Replies

6. AIX

Need a list of top 10 CPU using processes (also top 10 memory hogs, separately)

Okay, I am trying to come up with a multi-platform script to report top ten CPU and memory hog processes, which will be run by our enterprise monitoring application as an auto-action item when the CPU and Memory utilization gets reported as higher than a certain threshold I use top on other... (5 Replies)
Discussion started by: thenomad
5 Replies

7. UNIX for Dummies Questions & Answers

how to get persistant cpu utilization values per process per cpu in linux (! top,ps)

hi, i want to know cpu utilizatiion per process per cpu..for single processor also if multicore in linux ..to use these values in shell script to kill processes exceeding cpu utilization.ps (pcpu) command does not give exact values..top does not give persistant values..psstat,vmstat..does njot... (3 Replies)
Discussion started by: pankajd
3 Replies

8. UNIX for Advanced & Expert Users

top %CPU.

I am using the Red Hat Enterprise Linux AS release 3 (Taroon), 2.4.21-4.EL. When I see the output of the command 'top'. I am getting the following ************************************************************************************ 2 processes: 227 sleeping, 5 running, 0 zombie, 0 stopped... (3 Replies)
Discussion started by: praveen_b744
3 Replies

9. UNIX for Dummies Questions & Answers

N00b question on CPU % in top

I have a process in my TOP output that is consistantly at 97% usage. I have 16 CPUs on my box. So is the 97% the cumalative usage of all the CPUs or just one? (3 Replies)
Discussion started by: kskywr
3 Replies

10. UNIX for Dummies Questions & Answers

Dual CPU's and 'top'

Hi have just built a new sunfire 280r with solaris 9 and i Have 2 questions 1) where can i view some information that will tell me for definate that the 2*900 mhz processors are both being used, i tried using "top" but it doesnt tell me for sure that both processors are churning away together ... (3 Replies)
Discussion started by: hcclnoodles
3 Replies
Login or Register to Ask a Question