07-11-2002
Quote:
Originally posted by lawadm1
Around 4:00pm EST EVERY DAY our applications batch job queue is jammed, and we can have 40-50 jobs "waiting" to run. According to "top", we have plenty of free memory available and CPU% never gets below 10 on any of the processors.
The very function of batch queue is to throttle the jobs. Let me describe the standard unix batch system....
The standard "batch" command that comes with unix is controlled by a file called queuedefs. If you don't turn the queuedefs file, then you get the defaults. And the defaults are that two jobs in the batch queue can be running at once. While two jobs are running, the other jobs wait. It doesn't matter how many cpu's or memory pages are idle. Two jobs is two jobs.
You can tune this if it's too low. But the idea is that batch jobs don't need to be run immediately. Putting a job in a batch queue and then complaining that the job isn't running immediately is a little odd. If you want to run a job immediately, simply run it.
Now I've been describing the standard unix batch system. But I'm guessing that your application's batch system is similiar. I would look carefully at the documentation for it to see if the number of jobs can be increased. Also remember that a batch system is reserving system resources so that they are available to non-batch jobs. You need to understand your mix of jobs. If everything is going through the batch system, you need to ask why.
And about paging... your os probably uses the paging system to get stuff into core. You want to ignore page-in's and look at page-out's.
10 More Discussions You Might Find Interesting
1. Debian
Hi All,
I am running my application on a dual cpu debian linux 3.0 (2.4.19 kernel).
For my application:
<sar -U ALL>
CPU %user %nice %system %idle
...
10:58:04 0 153.10 0.00 38.76 0.00
10:58:04 1 3.88 0.00 4.26 ... (0 Replies)
Discussion started by: jaduks
0 Replies
2. Shell Programming and Scripting
Is there any limitation for the function substr()
Iam trying to assign some 11 digit number value to variable. And printing the variable. This is printing invalid values.
cur_val=substr($0,36,11);
printf "Current Value is: %d\n",cur_val
I tried till 9 digits length, it was working fine. If... (6 Replies)
Discussion started by: lokiman
6 Replies
3. UNIX for Dummies Questions & Answers
hi all,
i would like to collect stat. about the cpu usage every 30 mins
so, I set up the cron job sth like
0,30 * * * * * /usr/bin/top -d 1 >> $STAT
i know cron doesn't have a TERM output, so error occurs.
any ideas or work around for this??
many thanks (3 Replies)
Discussion started by: freddy1228
3 Replies
4. UNIX for Dummies Questions & Answers
Ever noticed that using the top command on a multiple cpu box can often give totally misleading answers, like 230%, when you think that 100% should be the max?
Well, that's because top has a bizarre mode called "Irix mode" wherein if you have 4 cpus, the %CPU column of top can go up to 400%. I... (1 Reply)
Discussion started by: fabulous2
1 Replies
5. AIX
Can someone explain the differences I'm seeing below in TOP and VMSTAT commands on my AIX 5.3 server?
Thanks!
CPUs: 4; load averages: 0.86, 0.97, 0.97 18:09:26
926 processes: 4 stopped, 922 running
CPU states: 78.4% idle, 8.5% user, 12.6% kernel, 0.3% wait
Memory: 23680M Total.... (1 Reply)
Discussion started by: troym72
1 Replies
6. Shell Programming and Scripting
Hi,
I am trying to get the system RAM size from "top" command's output by the following but it is not working.
top | sed "s/^Mem.**\(*\), *//" (10 Replies)
Discussion started by: royalibrahim
10 Replies
7. Shell Programming and Scripting
Hi,
I have line in input file as below:
3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL
My expected output for line in the file must be :
"1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL"
Can someone... (7 Replies)
Discussion started by: shis100
7 Replies
8. HP-UX
Hi all,
I need a clarification about the top command in HP-UX.
If I run:
top -s300
I see the screen refresh every 5 minutes.
From the "man top" I understand that the values displayed every 5 minutes are instantaneous, not average on the previous 5 minutes.
Is this interpretation correct?
... (3 Replies)
Discussion started by: Evan
3 Replies
9. UNIX for Dummies Questions & Answers
Hi,
how to put "top" command in crontab through script in
suse linux.
Below script is working fine, but it is not working when sheduled in crontab
script scheduled in cron:
health.sh
---------
#! /bin/ksh
top |head -5 >output.txt
Thanks
Suresh (3 Replies)
Discussion started by: suresh3566
3 Replies
10. UNIX for Dummies Questions & Answers
How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address
and column 3 contains “cc” e-mail address to include with same email.
Sample input file, email.txt
Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies
LEARN ABOUT CENTOS
processcsv.py
PROCESSCSV.PY(1) Virtualization Support PROCESSCSV.PY(1)
NAME
processcsv.py - process virt-top CSV files
SUMMARY
virt-top --csv data.csv
processcsv.py < data.csv
DESCRIPTION
virt-top is a top(1)-like utility for showing stats of virtualized domains.
processcsv.py is a simple Python script that post-processes the output of "virt-top --csv".
It is used like this:
virt-top --csv data.csv
processcsv.py < data.csv
The second command will overwrite the following files in the current directory:
"global.csv"
This contains the global (host) statistics columns from the CSV file.
"domainNN.csv" (multiple files)
For each libvirt domain ID NN, a file is created containing the per-domain statistics from the CSV file.
SEE ALSO
virt-top(1)
AUTHORS
Richard W.M. Jones <rjones @ redhat . com>
COPYRIGHT
(C) Copyright 2007-2012 Red Hat Inc., Richard W.M. Jones http://libvirt.org/
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 675 Mass Ave, Cambridge, MA 02139, USA.
virt-top-1.0.8 2013-12-29 PROCESSCSV.PY(1)