Running three scripts parallelly


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Running three scripts parallelly
# 1  
Old 07-17-2006
Running three scripts parallelly

Hi All,

We have three shell script batch, which extract data from three different systems(oracle, db2, db2/400).

By running each shell script batch, the data is extracted from respective systems. while the batch is running, job date, system_name, start_date and end_date will be inserted into a common staging database for each shell script batch.

we are facing some technical problem while executing the three shell scripts parallelly. we use data stage ETL tool to run the three shell script batch in parallel.

while running parallel, the three rows should be inserted into staging database table for respective source system. but one or two rows only getting inserted into staging table. some times Shell script gets failed while executing the sql script(which insert the above mentioned data to staging table) within the batch. even there is no dependency between the three shell scripts

If we run the batch one after other, we are not facing any issues.

i m very much thankful, if i could get a solution from this forum.

thankz & regards
Anwar
# 2  
Old 07-18-2006
my reply may not be that useful, just a pointer to ur problem.

since all the 3 scripts are inserting into a common table, there is possibility that the insertion is being failed due to implicit locking of table while inserting a row.
Have you checked for the return status of the insertion, that would have been a great pointer to proceed with.

If the problem has been downsized due to locking of table simultaneously and insertion failing due to that, then increase the lock time wait period.

hope this helps.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to optimize the loop to load parallelly

Hi, I'm trying to load the huge amount of records in the database. I did the successful load but it took more time to load as numbers are huge. Here what I have - 1. create a database table (t) with 2 columns- Not an issue 2. create a script to load huge amount of data - Here I would... (2 Replies)
Discussion started by: Mannu2525
2 Replies

2. Shell Programming and Scripting

To execute scripts parallelly

Hi I have set two set of scripts sets in a file which perform similar operations but with different script names for e.g.: 1st set of script1.txt: 1.sh 2.sh 3.sh 4.sh 2nd set of script2.txt: 1_1.sh 2_1.sh 3_3.sh 4_4.sh I want to execute these set of scripts parallelly in such... (16 Replies)
Discussion started by: rohit_shinez
16 Replies

3. Shell Programming and Scripting

Executes scripts parallelly based on their success

Hi Team , I have one Master.sh file which call X,Y,Z scripts , but here X may call again some sub scripts X_sub1.sh , X_sub2.sh Y calls Y_sub1.sh,Y_sub2.sh and similarly Z script also . Now requirement is Both X and Y should execute parallel bcz X and Y are independent... (9 Replies)
Discussion started by: chandini
9 Replies

4. Shell Programming and Scripting

Running scripts from a list

I am writing a bash script to run test some scripts. The names scripts of the scripts to tests are stored in an array. scptArr='chcksfrd.bash' scptArr='compute-misfit.bash' scptArr='compute-travel-times.bash' scptArr='create-data-tinv.bash' scptArr='create-docs.bash' ... (3 Replies)
Discussion started by: kristinu
3 Replies

5. Homework & Coursework Questions

Help running scripts in 1 file.

1. The problem statement, all variables and given/known data: Running different parts of the assignment together in 1 script 2. Relevant commands, code, scripts, algorithms: awk, nawk, bash, cp, cut, echo, expr, grep, join, mkdir, paste, rm, sort, sed, test, tr, true and false. 3. The... (0 Replies)
Discussion started by: bigubosu
0 Replies

6. Shell Programming and Scripting

Running scripts within scripts from cron

Hi all, I have set up a cron job which calls another shell script shell script which in turn calls a Java process. The cron tab looks so. 0,30 7-18 * * 1-5 /u01/home/weblogic/brp/bin/checkstatus.sh >> /u01/home/weblogic/logs/checkstatus.log The checkstatus.sh scripts looks like this. ... (4 Replies)
Discussion started by: sirbrian
4 Replies

7. Shell Programming and Scripting

Running scripts via su

Hi All, Am using the below command to start my application using the root user su - bin -c "/home/bin/test/start.sh" but am getting the error becaue i have set some environment varibales in bin .profile when i execute the command start.sh by logging directly into bin account it's... (8 Replies)
Discussion started by: ravi.sri24
8 Replies

8. UNIX for Dummies Questions & Answers

Automatically Running Scripts

Can someone advise me how to get started automatically running scripts? I believe it has something to do with cron? (4 Replies)
Discussion started by: jeffreydavisjr
4 Replies

9. Shell Programming and Scripting

Running scripts unattended

Hi guys just wondering how i could make one of my scripts run unattended without the use of cron? (3 Replies)
Discussion started by: musicmancanora
3 Replies

10. Shell Programming and Scripting

Running scripts through cronjob.

Hello everybody, I'm trying to run a shell script in crontab file. But anyhow it's not getting executed. Following is the command that I've used in crontab. 30 07 * * * . ./.cronprofile;/om/reports/reportscripts/jitu/prod/prd_pre_to_post.sh 35 11 * * * .... (3 Replies)
Discussion started by: jitu.jk
3 Replies
Login or Register to Ask a Question