High Disk0 & Disk1 Utilization


 
Thread Tools Search this Thread
Operating Systems AIX High Disk0 & Disk1 Utilization
# 1  
Old 03-12-2008
High Disk0 & Disk1 Utilization

Dear all,

A p505 Server with AIX 5.3 is running our backofice System.

It contains several Data Bases that its DB is on individual VG

I have a big utilization at the OS Disks,

Please see bellow topas results.

Any ideas?

Thanks in advance

George Govotsis

Syscall 7307 Writech5511.5K7
Kernel 4.7 |## | Reads 740 Rawin 0
User 2.8 |# | Writes 3618 Ttyout 621
Wait 49.4 |############## | Forks 0 Igets 0
Idle 43.1 |############# | Execs 0 Namei 69
Runqueue 0.0 Dirblk 0
Network KBPS I-Pack O-Pack KB-In KB-Out Waitqueue 9.5
en0 2.6 5.0 4.0 0.6 2.0
en1 1.0 2.0 0.5 0.3 0.7 PAGING MEMORY
lo0 0.0 0.0 0.0 0.0 0.0 Faults 530 Real,MB 3840
Steals 1997 % Comp 83.8
Disk Busy% KBPS TPS KB-Read KB-Writ PgspIn 60 % Noncomp 6.0
hdisk0 100.0 2362.0 413.0 76.0 2286.0 PgspOut 876 % Client 6.0
hdisk1 100.0 2372.0 415.5 90.0 2282.0 PageIn 160
hdisk2 15.0 6596.2 114.5 0.0 6596.2 PageOut 2566 PAGING SPACE
hdisk3 15.0 6604.2 116.5 8.0 6596.2 Sios 2610 Size,MB 25088
hdisk10 9.5 932.0 168.0 76.0 856.0 % Used 24.1
hdisk23 4.0 352.0 31.0 12.0 340.0 NFS (calls/sec) % Free 75.8
hdisk6 4.0 41.8 13.0 0.0 41.8 ServerV2 0
hdisk7 3.5 41.8 13.0 0.0 41.8 ClientV2 0 Press:
hdisk8 0.5 2.2 1.0 0.0 2.2 ServerV3 0 "h" for help
hdisk9 0.5 2.2 1.0 0.0 2.2 ClientV3 0 "q" to quit
hdisk4 0.0 0.0 0.0 0.0 0.0
hdisk11 0.0 0.0 0.0 0.0 0.0
cd0 0.0 0.0 0.0 0.0 0.0
dac2 0.0 7000.2 161.5 20.0 6980.2
hdisk12 0.0 0.0 0.0 0.0 0.0
hdisk13 0.0 0.0 0.0 0.0 0.0
hdisk14 0.0 0.0 0.0 0.0 0.0

Name PID CPU% PgSp Owner
_progres 1093776 6.0 10.4 ace
lrud 16392 0.9 0.5 root
topas 3801098 0.5 3.2 ace
_progres 2838730 0.2 10.9 ace
_progres 2289822 0.1 12.2 ace
j2pg 98360 0.1 2.0 root
java 1011810 0.1 50.8 root
java 1241188 0.0 17.1 root
pilegc 45078 0.0 7.8 root
_progres 2818288 0.0 10.2 ace
_progres 1921266 0.0 18.5 ace
_progres 3547302 0.0 18.5 ace
_progres 1962182 0.0 17.5 ace
_progres 2216082 0.0 17.5 ace
_progres 2826284 0.0 17.7 ace
_progres 1425546 0.0 11.3 ace
gil 69666 0.0 0.9 root
_progres 2891846 0.0 11.0 ace
# 2  
Old 03-12-2008
The high "wait"-value suggests that heavy swapping is going on. Run a "vmstat 1" for some time (1-2 screen full) and observe the middle columns titled "page" These should be mostly "0" with occasional little numbers mixed in. If some columns are more or less constantly non-0, then you perhaps have not enough memory.

If you have not enough memory the machine starts paging and usually the internal disks are housing the swap space. This would explain the high disk activity.

Issue a "svmon -G" (as root user) and observe the output. Here is a sample with the important parts marked bold:

Code:
# svmon -G
               size      inuse       free        pin    virtual
memory      2097152    2028714      68438     432098    1947206
pg space    1572864     225772

               work       pers       clnt
pin          432098          0          0
in use      1796594      62110     170010

PageSize   PoolSize      inuse       pgsp        pin    virtual
s   4 KB          -    1921210     217388     348450    1836022
m  64 KB          -       6719        524       5228       6949

The left number is the amount of memory you would need, the right value is the amount of memory you have. Both numbers are in 4k-units (memory pages). If the right value is way below the left one you can roughly estimate the amount of memory you will need to install by building the difference: eg. if the "inuse" shows 1Mio more than "virtual" then you will need approximately 1Mio x 4k = 4GB additional memory.

Note, that this is only a rough estimation - it doesn't replace a thorough analysis of the situation.

I hope this helps.

bakunin
# 3  
Old 03-12-2008
Thanks for your help I will try them and I will let you know

Thanks,

George Govotsis
# 4  
Old 03-12-2008
Quote:
Originally Posted by bakunin
[...]
Code:
# svmon -G
               size      inuse       free        pin    virtual
memory      2097152    2028714      68438     432098    1947206
pg space    1572864     225772

               work       pers       clnt
pin          432098          0          0
in use      1796594      62110     170010
[...]

The left number is the amount of memory you would need, the right value is the amount of memory you have. [...]
Just to clarify: "size" is the amount of RAM that is installed in the system and "virtual" is the active virtual memory that is allocated/needed.

To the OP: with 4Gig of RAM and 25% usage of a 25Gig paging space you do not really wonder why your rootvg disks (where hd6 is) are busy, do you? Smilie That is a gap that probably cannot be closed by tuning vmm. Get more RAM.
# 5  
Old 03-12-2008
Quote:
Originally Posted by shockneck
To the OP: with 4Gig of RAM and 25% usage of a 25Gig paging space you do not really wonder why your rootvg disks (where hd6 is) are busy, do you? Smilie
If i do understand you correctly this is a misconception: If a process is used very rarely (like, say, once a day) and otherwise is idling it will get swapped out. This would add to the usage numbers of the swap space but would pose no problem to the machine at all. The swapping in would take some time, true, but only once a day. After that the process would get swapped out again, until it "rests" in the swap.

Obviously this is not the case here, so my point is not connected to the problem the OP raised and of merély theoretical interest. I just had a case where a customers sysdmin pointed to the output of "lsps -a" and demanded more memory whereas the machine was already having enough memory at all. This was easily shown by analysing the vmstat-output.

bakunin
# 6  
Old 03-12-2008
Quote:
Originally Posted by bakunin
If i do understand you correctly this is a misconception: If a process is used very rarely (like, say, once a day) and otherwise is idling it will get swapped out. This would add to the usage numbers of the swap space but would pose no problem to the machine at all. The swapping in would take some time, true, but only once a day. After that the process would get swapped out again, until it "rests" in the swap.

Obviously this is not the case here, so my point is not connected to the problem the OP raised and of merély theoretical interest. I just had a case where a customers sysdmin pointed to the output of "lsps -a" and demanded more memory whereas the machine was already having enough memory at all. This was easily shown by analysing the vmstat-output.

bakunin
I see what you mean. However, I would think that such a theoretical point might confuse the OP as what you describe does probably not apply to his p5
Quote:
Disk Busy% KBPS TPS KB-Read KB-Writ PgspIn 60 [...]
hdisk0 100.0 2362.0 413.0 76.0 2286.0 PgspOut 876 [...]
hdisk1 100.0 2372.0 415.5 90.0 2282.0 PageIn 160 [...]
hdisk2 15.0 6596.2 114.5 0.0 6596.2 PageOut 2566 [...]
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Red Hat

Kswapd high cpu utilization.

Hi, Please suggest how to troubleshoot, kswapd is utilizing high cpu? also wanted to know which parameters are important and needs to be added with sar command for monitoring the performance of Linux (Oracle 5.8 -64 bit Please guide me. I am facing the issue where server is getting... (0 Replies)
Discussion started by: manoj.solaris
0 Replies

2. Red Hat

High CPU Utilization

Hi Experts, I need to understand few basic things regarding top command result from one of the node i have collected: Cpu0 : 4.6%us, 2.0%sy, 0.0%ni, 91.4%id, 1.3%wa, 0.3%hi, 0.3%si, 0.0%st Cpu1 : 0.0%us, 0.3%sy, 0.0%ni, 99.7%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Cpu2 : ... (5 Replies)
Discussion started by: mackjack87
5 Replies

3. Solaris

High Memory Utilization

Hello Guys, I have one Solaris server with high memory utilization >90%. As per checking, below is the output for memory usage. bash-3.00# ps -efo pmem,uid,pid,ppid,pcpu,comm | sort -r %MEM UID PID PPID %CPU COMMAND 1.7 29496 20668 1 0.0 /opt/app/iw-home/tools/java/bin/java 1.5... (1 Reply)
Discussion started by: myrpthidesis
1 Replies

4. AIX

Copying LVs from disk1 to disk0

Dear i have two internal disks in one production system some LVs are created in hdisk0 and the remaining are created in hdisk1 i want to move all this LVs to hdisk0 and make the hdisk1 free to install my application . lspv -l hdisk0 hdisk0: LV NAME LPs PPs DISTRIBUTION MOUNT POINT hd4 16... (1 Reply)
Discussion started by: thecobra151
1 Replies

5. UNIX for Advanced & Expert Users

[Solved] High CPU utilization

Hi, i am observing few processes taking high CPU and when i got some more detials about them it looks like this PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 9452 xmp 25 0 16736 1224 860 R 100.0 0.0 903:54.18 ffmpeg -i - 9777 xmp 25 0 16736 1224 ... (1 Reply)
Discussion started by: Siddheshk
1 Replies

6. UNIX for Advanced & Expert Users

high cpu utilization

good morning. just wanted to ask if there's a way to check what causes the high cpu utilization of a server for the past 2 months? My jffnms report resulted to high utilization for a specific server last month. is there a way to check via a command line? thanks (9 Replies)
Discussion started by: lhareigh890
9 Replies

7. Red Hat

Disk Utilization is very high

Hi, I have monitored that disk utilization is very high on one of red hat linux VM. Would like to know how to find out that issue of high disk utilization is because of disk or Installed Application on that server is causing the problem. Regards, Manoj (1 Reply)
Discussion started by: manoj.solaris
1 Replies

8. AIX

High CPU utilization

Hi am facing high cpu utilization on my sybase server. I have P550 Number Of Processors: 4 Processor Clock Speed: 1656 MHz CPU Type: 64-bit Kernel Type: 32-bit LPAR Info: 1 65-D837E Memory Size: 7840 MB in topas it shows Name PID CPU% PgSp Owner dataserv 565264 ... (1 Reply)
Discussion started by: vjm
1 Replies

9. Solaris

High CPU Utilization

Good morning, I need some help figuring out what's eating up my cpu. My application can't get enough cpu to do its job. this is a sunfire V440 2CPU's at 1/593 GHZ with 8GB of memory. In the morning hours the box is at less than 3%. I can't figure out what else is using the CPU. We use foglight and... (2 Replies)
Discussion started by: bbouhaik
2 Replies

10. UNIX for Advanced & Expert Users

Sun: High kernel usage & very high load averages

Hi, I am seeing very high kernel usage and very high load averages on my system (Although we are not loading much data to our database). Here is the output of top...does anyone know what i should be looking at? Thanks, Lorraine last pid: 13144; load averages: 22.32, 19.81, 16.78 ... (4 Replies)
Discussion started by: lorrainenineill
4 Replies
Login or Register to Ask a Question