job/process scheduling or control


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting job/process scheduling or control
# 1  
Old 03-30-2008
job/process scheduling or control

Hi forum,

I have a problem concerning job or process scheduling and control.

I have to run 24 jobs (could be more sometimes less) of the same programme with different parameters. The machine this code is running on is an 8-core machine, so I was thinking that running all the processes at once would not be such a good idea because it would cause throttling between processes and some overhead. I could be wrong on this, feel free to correct me...

However, I don't seem to get my head around a way to control my batch of jobs/processes so that only 8 and always 8 processes are running (except at the end of the batch ofcourse).

in pseudocode it would have to look something like

for i in 1 to 24
x = get nr of jobs
while x < 8
start job i
done
done

however this stops if 7 jobs are reached. The while loop should be have a part that polls for the number of jobs and updates x, and re-enters the for loop if the condition is not met instead of exiting both the while and for loop.

Any pointers, ideas?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Job Scheduling

Hi All, I am new to unix and i have a task in front of me. The code part is "android update sdk" . I need to crontab this process. Hence i have written a script that runs the above command and sends a mail once the update is done. The problem with the automation is the installer asks for a... (5 Replies)
Discussion started by: Kashyap
5 Replies

2. Red Hat

Scheduling cron job

Hi Everybody, I want to run a script at every 5 seconds. I know how to run it every 5 minutes, is there any possibility to run a script at 5 seconds interval. Regards, Mastan (3 Replies)
Discussion started by: mastansaheb
3 Replies

3. UNIX and Linux Applications

Job Scheduling (Autosys)

Hello! I will be working with Autosys and I am looking for individuals that have knowledge of this UNIX application. Thank-you! (3 Replies)
Discussion started by: preshe79
3 Replies

4. UNIX for Advanced & Expert Users

Autosys job scheduling

Hi, I want to schedule a job through Autosys (in Linux server) to run on 1st day of every 3rd month(gap of 90 days). Please someone help me to achive my above requirement Example: Run the sample.sh on 01-Jan-2009, 01-Apr-2009, 01-Jul-2009, 01-Oct-2009. Thanks in advance (4 Replies)
Discussion started by: apsprabhu
4 Replies

5. Shell Programming and Scripting

Job Scheduling Issue

Hi Guys, I am new to Unix, Please tell me how to schedule a job to be executed on saturday,sunday and on friday night 8:00 PM onwards. and also how to change the password of oracle user every year through unix? Please help me to resolve this issue... Regards, Mahesh Raghunandanan (1 Reply)
Discussion started by: mraghunandanan
1 Replies

6. UNIX for Advanced & Expert Users

can some one give me some link about process and job control commands

can some one give me some link about process and job control commands (2 Replies)
Discussion started by: alokjyotibal
2 Replies

7. Shell Programming and Scripting

Job Scheduling

I am working on UNIX AIX system, with Oracle OS. We are not supposed to use any tools to schedule our unix shell scripts. Basically we have to make use of Oracle tables and Shell scripts to manage dependencies, restartability, scheduling, parallelizing,etc. If anyone has worked/ is working... (4 Replies)
Discussion started by: singhabhijit
4 Replies

8. UNIX and Linux Applications

Job Scheduling

I am working on UNIX AIX system, with Oracle OS. We are not supposed to use any tools to schedule our unix shell scripts. Basically we have to make use of Oracle tables and Shell scripts to manage dependencies, restartability, scheduling, parallelizing,etc. If anyone has worked/ is working... (1 Reply)
Discussion started by: singhabhijit
1 Replies

9. UNIX for Advanced & Expert Users

cron job scheduling

Hi, How can I configure cron file , to execute a script on evey alternate saturdays ? I am using AIX 5.0 machine Thanks in advance Shihab (1 Reply)
Discussion started by: shihabvk
1 Replies

10. Shell Programming and Scripting

Job Scheduling

Hello, I want to know about job scheduling utilities available in unix. It should not be responsible just for starting the job like in case of cron but should also be able to handle the execution of jobs. Regards, Ritesh (1 Reply)
Discussion started by: turlapaty
1 Replies
Login or Register to Ask a Question
pbs(1B) 								PBS								   pbs(1B)

NAME
pbs - general information on pbs DESCRIPTION
PBS stands for Portable Batch System. It is a networked subsystem for submitting, monitoring, and controlling a work load of batch jobs on one or more systems. More information about PBS is available in the PBS Users Guide. Batch means that the job will be scheduled for execution at a time chosen by the subsystem according to a defined policy and the availabil- ity of resources. For a normal batch job, the standard output and standard error of the job will be returned to files available to the user when the job is complete. This differs from an interactive session where commands are executed when entered via the terminal and output is returned directly to the terminal. PBS also supports an interactive batch mode where the input and output is connected to the user's terminal, but the scheduling of the job is still under control of the batch system. A job is typically a shell script and a set of attributes which provide resource and control information about the job. A job does not have to be submitted on the system where it will run, tt can be submitted on any system with the PBS commands and access to the execution system, see qsub(1B). Output will be returned to the system from which the job was submitted unless directed otherwise. Attributes offer control over when a job is eligible to be run, what happens to the output when it is completed and how the user is noti- fied when it completes. The attributes of the job may be specified on the command line or in the job script when the job is submitted. For information about job attributes, see qsub(1B) and pbs_job_attributes(7B). One important attribute is the resource list. The list specifies the amount and type of resources needed by the job in order to execute. The list also implies a hard upper limit on usage of those resources. When the limit is reached, the job is terminated. The types of resources available to a job vary with the system architecture. For a list of resources supported on the default system, see pbs_resources(7B). There are man pages for other systems types as well, see pbs_resources_aix4(7B), pbs_resources_fujitsu(7B), pbs_resources_irix5(7B), pbs_resources_solaris5(7B), pbs_resources_sp2(7B), pbs_resources_sunos4(7B), or pbs_resources_unicos8(7B). Once a job has been submitted, it may be monitored by use of the qstat(1B) command. Two forms of output are available with the qstat com- mand. The default form is the short display. Information about a job is limited to a single line. Complete information about the job or jobs is available through qstat with the -f option. Information will be given about all jobs in the system, all jobs in specified queues, or only specified jobs. When displaying status of jobs, you will see in which queue the job resides. In PBS a queue is just a collection point for jobs, it does not imply any execution ordering. That ordering is determined by a scheduling policy implemented by the system administration. Other commands of interest which have man pages of their own are: qalter Alter a job's attributes. qdel Delete a job. qhold Place a hold on a job to keep it from being scheduled for running. qmove Move a job to a different queue or server. qmsg Append a message to the output of an executing job. qrerun Terminate an executing job and return it to a queue. qrls Remove a hold from a job. qselect Obtain a list of jobs that met certain criteria. qsig Send a signal to an executing job. SEE ALSO
qalter(1B), qdel(1B), qhold(1B), qmove(1B), qmsg(1B), qrerun(1B), qrls(1B), qselect(1B), qsig(1B), qsub(1B) and the PBS User Guide. Start- ing with qsub(1B), you can find all other available PBS man pages by following references in the "See Also" section. Local pbs(1B)