High Runqueue (R) LOW CPU LOW I/O Low Network Low memory usage


 
Thread Tools Search this Thread
Operating Systems AIX High Runqueue (R) LOW CPU LOW I/O Low Network Low memory usage
# 1  
Old 01-12-2012
High Runqueue (R) LOW CPU LOW I/O Low Network Low memory usage

Hello All

I have a system running AIX 61 shared uncapped partition (with 11 physical processors, 24 Virtual 72GB of Memory) .

The output from NMON, vmstat show a high run queue (60+) for continous periods of time intervals, but NO paging, relatively low I/o (6000) , CPU % is 40, Low network.

The only indicators are the high number of syscalls being made. Any thoughts would be appreciated
# 2  
Old 01-12-2012
What applications running there? Is SMT activated? What OS level do you have (latest fix pack installed?)? Is that always, only at peak times? What has changed since? More info would be helpful, thanks.
# 3  
Old 01-12-2012
SMT is on running on a P720 (ie SMT=4), AIX TL6-SP3-1048 (6100-06-03-1048)
A DATA Base server (Universe DB). No changes on system , except volume, ie more user activity

That is the main issue: I do not have any more data to offer except observations in regards the high syscall count, I was hoping to understand how I can I get to see the syscals being made; I ran a trace---> curt and and the majority of calls are made to "unknown" routines.

Last edited by IL-Malti; 01-12-2012 at 12:36 PM..
# 4  
Old 01-12-2012
can you post output of vmstat -v 2 10 taken during a peak time when your run queue is high, iostat -Dl, vmstat -v, vmstat -s outputs please. High runqueues with low cpu utilization in most cases point to IO- or memory problems
Regards
zxmaus
# 5  
Old 01-13-2012
Here is some data; Am I right in reading: plenty of memory (no paging and tons in the fre), idle time is relative plentiful; and no io wait.....


Code:
----- ----------- ------------------------ ------------ -----------------------
r b avm fre re pi po fr sr cy in sy cs us sy id wa pc ec
12 1 3569398 5794339 0 0 0 0 0 0 4650 1770166 10110 62 20 18 0 11.32 103.0
10 1 3568772 5794931 0 0 0 0 0 0 4367 1500395 9389 51 21 28 0 10.18 92.5
18 0 3570140 5793348 0 0 0 0 0 0 4579 1797185 10839 64 21 15 0 11.46 104.2
27 0 3570626 5792608 0 0 0 0 0 0 4885 1927251 11404 63 21 16 0 11.45 104.1
32 0 3571451 5791641 0 0 0 0 0 0 4458 1842323 10604 62 21 16 0 11.33 103.0
16 2 3572631 5790341 0 0 0 0 0 0 3937 1536208 9027 58 20 22 0 10.88 98.9
22 0 3571930 5790930 0 0 0 0 0 0 4787 1489063 10280 54 21 25 0 10.75 97.7
19 1 3572992 5789819 0 0 0 0 0 0 4560 1575266 10585 57 21 22 0 10.86 98.7
0 0 3575629 5787020 0 0 0 0 0 0 4551 1609988 10993 60 20 20 0 10.84 98.6
21 0 3578575 5783902 0 0 0 0 0 0 4735 1940362 11115 66 19 15 0 11.49 104.4
23 0 3579044 5783308 0 0 0 0 0 0 3812 1734049 9016 67 17 16 0 11.57 105.1
29 1 3579558 5782506 0 0 0 0 0 0 4539 1605220 10287 61 20 19 0 11.20 101.8

Moderator's Comments:
Mod Comment Use code tags please, thanks.

Last edited by zaxxon; 01-13-2012 at 02:41 PM.. Reason: code tags
# 6  
Old 01-13-2012
The figures in the User CPU "us" column are high for a database system. Have you checked for looping orphan prococeses ?
# 7  
Old 01-13-2012
60% (on average) is deemed high for DB work? I was thinking that the "sy" (20%) was high; that is why I was thinking that my syscalls were the bottlekneck;



No looping process seen or noticed. All tasks ended whether normally ot via a time out.


Thank you all.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Linux live cd for low memory

Could I please get some recommendations of a linux live cd for low memory? (1 Reply)
Discussion started by: cokedude
1 Replies

2. Red Hat

High RAM usage, extremely low swapping

Hi team I have three physical servers running on Red Hat Enterprise Linux Server release 6.2 with the following memory conditions: # cat /proc/meminfo | grep -i mem MemTotal: 8062888 kB MemFree: 184540 kB Shmem: 516 kB and the following swap conditions: ... (6 Replies)
Discussion started by: hedkandi
6 Replies

3. AIX

Low Virtual memory available

Hi I am running AIX 5.2. My server is running low on memory. It it using about 1307775 file pages on a total of 1511424 (from vmstat -v). I looked at the memory yesterday morning, and we had plenty of free memory. I did a backup from Windows (ftp mget command) of a large file selection. From... (5 Replies)
Discussion started by: fredrivard
5 Replies

4. UNIX for Dummies Questions & Answers

Kernel/ user space and high/ low mem

Need some clarification on this.... 1. how are kernel/ user spaces and high/low memory related? 2. What do they all mean when i have the kernel command line as: "console=ttyS0,115200 root=/dev/sda2 rw mem=exactmap memmap=1M@0 memmap=96M@1M irqpoll" or 2. what do mem and memmap mean in... (3 Replies)
Discussion started by: dragonpoint
3 Replies

5. HP-UX

Bad performance but Low CPU loading?

There might be some problem with my server, because every morning at 7, it's performance become bad with no DB extra deadlock. But I just couldn't figure it out. Please give me some advise, thanks a lot... According to the CPU performace chart, Daily CPU loading Maximum: 42 %, Average:36%. ... (8 Replies)
Discussion started by: GreenShery
8 Replies

6. Shell Programming and Scripting

Split file into chunks of low & high byte

Hi guys, i have a question about spliting a binary file into 2 chunks. First chunk with all high bytes and the second one with all low bytes. What unix tools can i use? And how can this be performed? I looked in manpages of split and dd but this does not help. Thanks (2 Replies)
Discussion started by: basta
2 Replies

7. Shell Programming and Scripting

Picking high and low variables in a bash script - possible?

Is it possible to have a bash script pick the highest and lowest values of four variables? I've been googling for this but haven't come up with anything. I have a script that assigns variables ($c0, $c1, $c2, and $c3) based on the coretemps from grep/sed statements of sensors. I'd like to also... (5 Replies)
Discussion started by: graysky
5 Replies

8. Shell Programming and Scripting

low & high values

on the file Ftp'd from the mainframe ,do we have any UNIX command to replace mainframe low and values to space or null. i tried using tr and it doesn't work ... Thanks (1 Reply)
Discussion started by: rlmadhav
1 Replies

9. Solaris

malloc returning NULL if freemem high & swapmem low

Hi All, In my application malloc is returning NULL even though there is sufficient amount of free memory is available but swap memory is low. Is this possible that, if free memory is high & swap memory is low, malloc will not be able to allocate memory & return NULL ?:) Kindly look into... (5 Replies)
Discussion started by: Ritesh Kumar
5 Replies

10. Solaris

Low average cpu utilization.

Hi to all, i have an app on solaris 5.8 writed in C++ (3.2.1) that use multi threading. Hardware has 8 cpu. When i run my app i note that the average of cpu go at least at 40%, and the performance are not so higher.. There is a cpu limitation on solaris, that dedicate only a part of cpu... (3 Replies)
Discussion started by: Moodie
3 Replies
Login or Register to Ask a Question