Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Executing scripts in Parallel
Top Forums Shell Programming and Scripting Executing scripts in Parallel Post 302202793 by fabtagon on Thursday 5th of June 2008 04:43:41 PM
Old 06-05-2008
simple polling approach (this master script itself may not run parallel, vulnerable to symlink attacks through unsafe tmp file creation, ...)
Code:
#!/bin/bash
# should work in most shells
(script1; echo $? > /tmp/retval1 ) &
script2
# both do now run in parallel
# ...
# well, after some time script2 will have finished, so well have to check whether 2 also has
retval2=$?
while [ $? -eq 0 ]
do
  sleep 1s
  pidof script1 > /dev/null
done
retval1=`cat /tmp/retval1`
if [ something about retval1 and retval2 ]
then
  script3
fi

Last edited by fabtagon; 06-05-2008 at 05:47 PM.. Reason: missed one point
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Running scripts in parallel

Hi, Iam having the scripts as follows. i jus want to run those in parallel. main aim is to minimise the time for overall execution of the script. now out.txt is having 1 lac records. script1(split.sh) split -1000 out.txt splitout ls -A splitout* > filelist.txt cat filelist.txt... (6 Replies)
Discussion started by: nivas
6 Replies

2. Shell Programming and Scripting

Help with executing parallel sessions for same shell script with different but fixed parameters

Hi Experts, There is a shell script that accepts positional parameter between 1-25 to execute case statement of script depending upon the parameter passed. Now I need to run all the 25 sessions parallely. In each option of case statement it is connecting with sqlplus and executing a select... (11 Replies)
Discussion started by: Opamps123
11 Replies

3. Shell Programming and Scripting

Executing two commands in parallel

Hi, I am stuck into a situation where i want to execute a command in my shell script well along with a previous command in order to achieve something but i am not figuring out a way. here is a snippet: service management restart rm -rf lock.file in the above, if you see, i am trying to... (5 Replies)
Discussion started by: sunrexstar
5 Replies

4. Shell Programming and Scripting

Find and execute shell scripts in multiple sub directories in parallel

I have one parent directory and within that parent directory there are several other sub-directories and within those sub-directories there are several other "large number" of sub-directories. All the sub directories have a shell script in them with a common file name execute_command.sh I want... (4 Replies)
Discussion started by: shoaibjameel123
4 Replies

5. Shell Programming and Scripting

Execute scripts in Parallel

Hi I want to execute few scripts in Parallel. There is a Master Script (MS.ksh) which will call internally all the scripts we need to run in Parallel. Say there are three set of scripts : ABC_1.ksh --> ABC_2.ksh --> ABC_3.ksh (execute ABC_2 when ABC_1 is successful ; Execute ABC_3 only when... (6 Replies)
Discussion started by: dashing201
6 Replies

6. Shell Programming and Scripting

[Solved] Running scripts in parallel that issue prompt

Hi all - I am totally stuck here :wall I have been asked to write a shell script that does a few little things and then reads from a config file and kicks off an instance of another script, say scriptB.ksh for each line in the config file. These should all be run in parallel. This is all fine but... (2 Replies)
Discussion started by: sjmolloy
2 Replies

7. Shell Programming and Scripting

[Solved] Running scripts in parallel

i have script A and script B, both scripts have to run in parallel, my requirement is script A create table temp1, post creating it will run fr 4 hrs , script B has to start 0nly after creation of table temp1 ( which is done by script A) , again script B will run for 5 hrs if i run sequencially... (7 Replies)
Discussion started by: only4satish
7 Replies

8. Shell Programming and Scripting

Executing Multiple Queries in parallel in Shell

I have n number of SQL queries needs to executed in Shell. Result of this query need to assign in a variable. Once all the queries are executed script needs to exit. Sample Query: SQL 1: Select Count(*) from TABLE GROUP BY COL1,COL2 SQL 2: Select Count(*) from TABLE GROUP BY COL1,COL2 ... (2 Replies)
Discussion started by: Niranjancse
2 Replies

9. Shell Programming and Scripting

Parallel bash scripts

Need some help to replace bash script with parallel to speed up job on multiple files (400files.list is the file contains the absolute path to those 400 files). The bash script is to run the same program over the files repetitively. My bash_script.sh is: for sample in `cat 400files.list`; do... (3 Replies)
Discussion started by: yifangt
3 Replies

10. UNIX for Beginners Questions & Answers

Executing SQL's in parallel

Hi Folks, I have requirement to pull a bunch of SQL's from a table in DB and execute them in parallel and update the status of each query as and when they complete. Can you please help me with ideas on how this can be achieved? create table list_of_sql ( id number, full_sql... (3 Replies)
Discussion started by: member2014
3 Replies

LEARN ABOUT XFREE86

startpar

STARTPAR(8)						      System Manager's Manual						       STARTPAR(8)

NAME

       startpar - start runlevel scripts in parallel

SYNOPSIS

       startpar [-p par] [-i iorate] [-t timeout] [-T global_timeout] [-a arg] prg1 prg2 ...
       startpar [-p par] [-i iorate] [-t timeout] [-T global_timeout] -M [ boot|start|stop]

DESCRIPTION

       startpar  is  used  to run multiple run-level scripts in parallel.  The degree of parallelism on one CPU can be set with the -p option, the
       default is full parallelism. An argument to all of the scripts can be provided with the -a option.  Processes blocked by pending  I/O  will
       cause  new  process  creation  to be weighted by the iorate factor 800.	To change this factor the option -i can be used to specify another
       value.  The amount weight=(nblockedxiorate)/1000 will be subtracted from the total number  of  processes  which	could  be  started,  where
       nblocked is the number of processes currently blocked by pending I/O.

       The  output  of	each  script is buffered and written when the script exits, so output lines of different scripts won't mix. You can modify
       this behaviour by setting a timeout.

       The timeout set with the -t option is used as buffer timeout. If the output buffer of a script is not empty and the last output was timeout
       seconds ago, startpar will flush the buffer.

       The  -T option timeout works more globally. If no output is printed for more than global_timeout seconds, startpar will flush the buffer of
       the script with the oldest output. Afterwards it will only print output of this script until it is finished.

       The -M option switches startpar into a make(1) like behaviour.  This option takes three different arguments:  boot,  start,  and  stop  for
       reading .depend.boot or .depend.start or .depend.stop respectively in the directory /etc/init.d/.  By scanning the boot and runlevel direc-
       tories in /etc/init.d/ it then executes the appropriate scripts in parallel.

FILES

       /etc/init.d/.depend.boot
       /etc/init.d/.depend.start
       /etc/init.d/.depend.stop

SEE ALSO

       init(8) insserv(8).

COPYRIGHT

       2003,2004 SuSE Linux AG, Nuernberg, Germany.
       2007 SuSE LINUX Products GmbH, Nuernberg, Germany.

AUTHOR

       Michael Schroeder <mls@suse.de>
       Takashi Iwai <tiwai@suse.de>
       Werner Fink <werner@suse.de>

								     Jun 2003							       STARTPAR(8)
All times are GMT -4. The time now is 04:14 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy