Keep a certain number of background processes running Post: 302280675

Sponsored Content

Top Forums Shell Programming and Scripting Keep a certain number of background processes running Post 302280675 by awk on Tuesday 27th of January 2009 11:13:29 AM

01-27-2009

Registered User

I had a similar problem - submit up to and including four background jobs, and when one or more finish, built back up to the max.

Code:

while read LINE                          # go through the output file from the view one line at a time
do

### Commented a lot of code - but basically, based on the LINE, 
###   set up the job with export statements

###   the secret is the jobs command gives a list of background jobs to this process
###   then the wc -l tells me how many

###   if it is >= 4, it goes to sleep for 30 seconds, then checks the count again

    # getting here, we want to submit the job to run, up to the limit of 4 jobs running at one time
    # See if there are 4 jobs running right now
      while [[ $( jobs | wc -l ) -ge 4 ]]
      do
        echo_f going to sleep now at $(date)
        sleep 30
      done

      /avidyn/scripts/avd_runit_002.ksh 1>/dev/null 2>&1 &   # parameters are passed by the export statements

done < /avidyn/tmp/avd_runit_001_jobs_to_run.txt

###  Not show after the done, is a "wait" command, to wait until all background jobs are finished.

awk

View Public Profile for awk

Find all posts by awk

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Running two processes in background

hi there, here's what i need in my korn-shell: ... begin korn-shell script ... nohup process_A.ksh ; nohup process_B.ksh & ... "other stuff" ... end lorn-shell script in plain english i want process A and process B to run in the background so that the script can continue doing...

2. Shell Programming and Scripting

Determine Number of Processes Running

I am pretty new to unix, and I have a project to do. Part of the project asks me to determine the number of processes running and assign it to a variable. I know how to every part of the project but determine the number of processes running. How can I get just the number of processes...

3. Solaris

About running processes in background

Hi, I need to establish a procedure that will start an application in background each time my remote Solaris server is (re)started. This would be a kind of daemon. I am no sysadmin expert, so I am looking for pointers. How should I proceed? What are the main steps? Thanks, JVerstry

4. Shell Programming and Scripting

Waiting for an arbitrary background process (limiting number of jobs running)

Hi, I'm trying to write a script to decompress a directory full of files. The decompression commands can run in the background, so that many can run at once. But I want to limit the number running at any one time, so that I don't overload the machine. Something like this: n=0 for i in *.gz...

5. Shell Programming and Scripting

Background Processes

Ok guys so I have my first dummy shell almost done except for one tiny part: I do not know how to run a process in the background, from the code! I already know how to do that in a normal shell: $ program & However, no clue when it comes to how to program that thing. :eek: A very...

6. Shell Programming and Scripting

How to Control Number of Processes Running

Hi Is there a way to count how many processes a script has started, count how many of these have finished, and make the script wait if their difference goes over a given threshold? I am using a script to repeatedly execute a code (~100x) which converts 2 data files into one .plt which is in...

7. UNIX for Dummies Questions & Answers

Query on Running Multiple processes in background

HI All , Pardon me for asking some very basic questions, I would be grateful if someone can help. I am trying to execute a shell script which runs multiple processes in background. It includes various operations like copying , DB operations etc etc. Now problem is that the complete script...

8. UNIX for Dummies Questions & Answers

How do you print the number of processes that each user is currently running in Unix?

Ok, so I know there's a way to do this, but I've been trying to find out all afternoon with no luck. I think it should print out something like this: 1 bin 2 daemon 6 duo Where the numbers on the left are the number of processes being run by the user whose name is listed on the right. Is...

9. Shell Programming and Scripting

Need help on background processes

Hi, I have a schell script parent.ksh from which I am calling three background processes a.ksh,b.ksh and c.ksh. Once these three processes completes the next step in parent.ksh should execute. How to achieve this? Please help me.... Thanks...

10. UNIX for Dummies Questions & Answers

How do I find the number of processes running on root?

Is there a certain man command I'm missing here? I searched in ps but I couldn't find something that would give me the number of processes running on root. I only want to see the number of processes, not the processes itself.

LEARN ABOUT DEBIAN

qorder

qorder(1B)								PBS								qorder(1B)

NAME

       qorder - exchange order of two pbs batch jobs in a queue.

SYNOPSIS

       qorder job_identifier job_identifier

DESCRIPTION

       To  order two jobs is to exchange the jobs positions in the queue or queues in which the jobs resides.  The two jobs must be located at the
       same server.  No attribute of the job, such as priority is changed.  The impact of interchanging the order with the queue(s)  is  dependent
       on local job scheduled policy, contact your systems administrator.

       A job in the running state cannot be reordered.

OPERANDS

       Both  operands  are  job_identifiers which specify the jobs to be exchanged.  The qorder command accepts two job_identifier operands of the
       form:
	   sequence_number[.server_name][@server]
       The server specification for the two jobs must agree as to the current location of the two job IDs.

STANDARD ERROR

       The qorder command will write diagnostic messages to standard error for each error occurrence.

EXIT STATUS

       Upon successful processing of all the operands presented to the qorder command, the exit status will be a value of zero.

       If the qorder command fails to process any operand, the command exits with a value greater than zero.

SEE ALSO

       qsub(1B), qmove(1B), pbs_orderjob(3B), pbs_movejob(3B)

Local																	qorder(1B)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Running two processes in background

Discussion started by: jacob_gs

2. Shell Programming and Scripting

Determine Number of Processes Running

Discussion started by: wayne1411

3. Solaris

About running processes in background

Discussion started by: JVerstry

4. Shell Programming and Scripting

Waiting for an arbitrary background process (limiting number of jobs running)

Discussion started by: p.f.moore