07-17-2006
Running three scripts parallelly
Hi All,
We have three shell script batch, which extract data from three different systems(oracle, db2, db2/400).
By running each shell script batch, the data is extracted from respective systems. while the batch is running, job date, system_name, start_date and end_date will be inserted into a common staging database for each shell script batch.
we are facing some technical problem while executing the three shell scripts parallelly. we use data stage ETL tool to run the three shell script batch in parallel.
while running parallel, the three rows should be inserted into staging database table for respective source system. but one or two rows only getting inserted into staging table. some times Shell script gets failed while executing the sql script(which insert the above mentioned data to staging table) within the batch. even there is no dependency between the three shell scripts
If we run the batch one after other, we are not facing any issues.
i m very much thankful, if i could get a solution from this forum.
thankz & regards
Anwar
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello everybody,
I'm trying to run a shell script in crontab file. But anyhow it's not getting executed. Following is the command that I've used in crontab.
30 07 * * * . ./.cronprofile;/om/reports/reportscripts/jitu/prod/prd_pre_to_post.sh
35 11 * * * .... (3 Replies)
Discussion started by: jitu.jk
3 Replies
2. Shell Programming and Scripting
Hi guys just wondering how i could make one of my scripts run unattended without the use of cron? (3 Replies)
Discussion started by: musicmancanora
3 Replies
3. UNIX for Dummies Questions & Answers
Can someone advise me how to get started automatically running scripts? I believe it has something to do with cron? (4 Replies)
Discussion started by: jeffreydavisjr
4 Replies
4. Shell Programming and Scripting
Hi All,
Am using the below command to start my application using the root user
su - bin -c "/home/bin/test/start.sh"
but am getting the error becaue i have set some environment varibales in bin .profile
when i execute the command start.sh by logging directly into bin account it's... (8 Replies)
Discussion started by: ravi.sri24
8 Replies
5. Shell Programming and Scripting
Hi all,
I have set up a cron job which calls another shell script shell script which in turn calls a Java process. The cron tab looks so.
0,30 7-18 * * 1-5 /u01/home/weblogic/brp/bin/checkstatus.sh >> /u01/home/weblogic/logs/checkstatus.log
The checkstatus.sh scripts looks like this.
... (4 Replies)
Discussion started by: sirbrian
4 Replies
6. Homework & Coursework Questions
1. The problem statement, all variables and given/known data:
Running different parts of the assignment together in 1 script
2. Relevant commands, code, scripts, algorithms:
awk, nawk, bash, cp, cut, echo, expr, grep, join, mkdir, paste, rm, sort, sed, test, tr, true and false.
3. The... (0 Replies)
Discussion started by: bigubosu
0 Replies
7. Shell Programming and Scripting
I am writing a bash script to run test some scripts.
The names scripts of the scripts to tests are stored in an array.
scptArr='chcksfrd.bash'
scptArr='compute-misfit.bash'
scptArr='compute-travel-times.bash'
scptArr='create-data-tinv.bash'
scptArr='create-docs.bash' ... (3 Replies)
Discussion started by: kristinu
3 Replies
8. Shell Programming and Scripting
Hi Team ,
I have one Master.sh file which call X,Y,Z scripts ,
but here X may call again some sub scripts X_sub1.sh , X_sub2.sh
Y calls Y_sub1.sh,Y_sub2.sh and similarly Z script also .
Now requirement is Both X and Y should execute parallel bcz X and Y are independent... (9 Replies)
Discussion started by: chandini
9 Replies
9. Shell Programming and Scripting
Hi I have set two set of scripts sets in a file which perform similar operations but with different script names for e.g.:
1st set of script1.txt:
1.sh
2.sh
3.sh
4.sh
2nd set of script2.txt:
1_1.sh
2_1.sh
3_3.sh
4_4.sh
I want to execute these set of scripts parallelly in such... (16 Replies)
Discussion started by: rohit_shinez
16 Replies
10. Shell Programming and Scripting
Hi,
I'm trying to load the huge amount of records in the database. I did the successful load but it took more time to load as numbers are huge.
Here what I have -
1. create a database table (t) with 2 columns- Not an issue
2. create a script to load huge amount of data - Here I would... (2 Replies)
Discussion started by: Mannu2525
2 Replies
LEARN ABOUT POSIX
queuedefs
queuedefs(4) File Formats queuedefs(4)
NAME
queuedefs - queue description file for at, batch, and cron
SYNOPSIS
/etc/cron.d/queuedefs
DESCRIPTION
The queuedefs file describes the characteristics of the queues managed by cron(1M). Each non-comment line in this file describes one queue.
The format of the lines are as follows:
q.[njobj][nicen][nwaitw]
The fields in this line are:
q The name of the queue. a is the default queue for jobs started by at(1); b is the default queue for jobs started by batch (see
at(1)); c is the default queue for jobs run from a crontab(1) file.
njob The maximum number of jobs that can be run simultaneously in that queue; if more than njob jobs are ready to run, only the first
njob jobs will be run, and the others will be run as jobs that are currently running terminate. The default value is 100.
nice The nice(1) value to give to all jobs in that queue that are not run with a user ID of super-user. The default value is 2.
nwait The number of seconds to wait before rescheduling a job that was deferred because more than njob jobs were running in that job's
queue, or because the system-wide limit of jobs executing has been reached. The default value is 60.
Lines beginning with # are comments, and are ignored.
EXAMPLES
Example 1: A sample file.
#
#
a.4j1n
b.2j2n90w
This file specifies that the a queue, for at jobs, can have up to 4 jobs running simultaneously; those jobs will be run with a nice value
of 1. As no nwait value was given, if a job cannot be run because too many other jobs are running cron will wait 60 seconds before trying
again to run it.
The b queue, for batch(1) jobs, can have up to 2 jobs running simultaneously; those jobs will be run with a nice(1) value of 2. If a job
cannot be run because too many other jobs are running, cron(1M) will wait 90 seconds before trying again to run it. All other queues can
have up to 100 jobs running simultaneously; they will be run with a nice value of 2, and if a job cannot be run because too many other jobs
are running cron will wait 60 seconds before trying again to run it.
FILES
/etc/cron.d/queuedefs queue description file for at, batch, and cron.
SEE ALSO
at(1), crontab(1), nice(1), cron(1M)
SunOS 5.10 1 Mar 1994 queuedefs(4)