Retention of Variable Value when a script is called by different processes in parallel- Linux 2.6.9
Hi,
I have a generic FTP script which will be called by 28 different processes in parallel (through a GUI tool) may or may not be at the exact moment (there could be a delay of about a minute or so).
This script after importing file from remote m/c inserts a record for that particular file in an Oracle table (see Fig 2). The "ID" column takes value from 1 ... 28. Column "SEQ" takes value from Oracle Sequence generator (so its unique). Column "TABLE_RECORD_COUNT" is inserted with '0'."Column "FILE_STATUS_FLAG" will have default value of 'A' (arrived) while inserting.
Fig 2 (INSERT)
At the end of the process (which loads data from the file to a table) again a Unix script will be called which will update the record inserted by the FTP script.
Now the updating script some how should know which record to update? And then it will update the table with values as below:
Fig 3 (UPDATE)
The script has updated column "FILE_STATUS_FLAG" to 'P' (processed) and column "TABLE_RECORD_COUNT" by executing "SELECT COUNT(1) FROM TABLE". Now I wonder if there's a way of remebering SEQ value till one process gets complete. Even if another process has kicked off the FTP script. Please suggest.
In a korn shell script, how can I run several processes in parallel at the same time?
For example, I have 3 processes say p1, p2, p3
if I call them as
p1.ksh
p2.ksh
p3.ksh
they will run after one process finishes. But I want to run them in parallel and want to display "Process p1... (3 Replies)
There are two files one is shell script (sample.sh) and another is configuration file (sampl_conf.cfg)
configuration file contains one variable $FTP_HOME. the value of this variable vaires for user to user. If user is say jadoo then value is /home/jadoo/ftp/, for user1 - /home/user1/ftp. The... (0 Replies)
Please help me on below..
https://www.unix.com/shell-programming-scripting/141533-retrieve-value-environment-variable-shell-script-called-crontab.html#post302442024
I'm still here. I can still see you! (0 Replies)
There are two files one is shell script (sample.sh) and another is configuration file (sampl_conf.cfg)
configuration file contains one variable $FTP_HOME. the value of this variable vaires for user to user. If user is say jadoo then value is /home/jadoo/ftp/, for user1 - /home/user1/ftp. The... (4 Replies)
Hi,
I have a shell script that creates 2 parallel processes. When I press ctrl+c, i want the parallel process to get killed as well.
#!/bin/bash
cmd1="script1.py"
cmd2="script2.py"
${cmd1} &
pid1=$!
echo ${pid1}
${cmd2} &
pid2=$! (7 Replies)
Hi guys,
I am struggling with adapting my script to increase the performance.
I created a ksh script to process a lot of files in parallel.
I would like to know how can I do in such a way that a constant number of processes is always up (until all is finished).
What I have is (not actual... (8 Replies)
Hi,
I am calling a Perl script in my shell script. When Perl script is executed it asks for a answer to be entered by user from terminal. How can i pass that value from my shell script ??
I know I can change perl script to default the answer but i dont have access to do that so only option i... (5 Replies)
Hi all,
Warm regards!
I am in a difficult situation here. I have been trying to create a shell script which calls another shell script inside. Here is a simplified version of the same.
Calling Script.
#!/bin/ksh
# want to run as a different process... (6 Replies)
I want to make a config file which contain all the paths.
i want to read the config file line by line and pass as an argument on my below function.
Replace all the path with reading config path line by line and pass in respective functions.
how can i achieve that?
Kindly guide.
... (6 Replies)
Hello all,
I tried to parralise my treatments but after a while 'ps -ef' display all child process <defunct> (zombie)
Parent bash script to process all files (>100000) in directory:
for filename in /Data/*.txt; do
./child_pprocess.sh $filename &
done
exit(0)I understand that the... (1 Reply)
Discussion started by: namnetes
1 Replies
LEARN ABOUT LINUX
startpar
STARTPAR(8) System Manager's Manual STARTPAR(8)NAME
startpar - start runlevel scripts in parallel
SYNOPSIS
startpar [-p par] [-i iorate] [-t timeout] [-T global_timeout] [-a arg] prg1 prg2 ...
startpar [-p par] [-i iorate] [-t timeout] [-T global_timeout] -M [ boot|start|stop]
DESCRIPTION
startpar is used to run multiple run-level scripts in parallel. The degree of parallelism on one CPU can be set with the -p option, the
default is full parallelism. An argument to all of the scripts can be provided with the -a option. Processes block by pending I/O will
weighting by the factor 800. To change this factor the option -i can be used to specify an other value.
The output of each script is buffered and written when the script exits, so output lines of different scripts won't mix. You can modify
this behaviour by setting a timeout.
The timeout set with the -t option is used as buffer timeout. If the output buffer of a script is not empty and the last output was timeout
seconds ago, startpar will flush the buffer.
The -T option timeout works more globally. If no output is printed for more than global_timeout seconds, startpar will flush the buffer of
the script with the oldest output. Afterwards it will only print output of this script until it is finished.
The -M option switches startpar into a make(1) like behaviour. This option takes three different arguments: boot, start, and stop for
reading .depend.boot or .depend.start or .depend.stop respectively in the directory /etc/init.d/. By scanning the boot and runlevel direc-
tories in /etc/init.d/ it then executes the appropriate scripts in parallel.
FILES
/etc/init.d/.depend.boot
/etc/init.d/.depend.start
/etc/init.d/.depend.stop
SEE ALSO init.d(7), insserv(8), startproc(8).
COPYRIGHT
2003,2004 SuSE Linux AG, Nuernberg, Germany.
2007 SuSE LINUX Products GmbH, Nuernberg, Germany.
AUTHOR
Michael Schroeder <mls@suse.de>
Takashi Iwai <tiwai@suse.de>
Werner Fink <werner@suse.de>
Jun 2003 STARTPAR(8)