Sponsored Content
Top Forums Shell Programming and Scripting Help needed on restart-from-point-of-failure in Parallel Processing Post 302995497 by rbatte1 on Thursday 6th of April 2017 12:22:27 PM
Old 04-06-2017
As a quick first pass, I'd suggest that your line that ends with || exit -1 & will actually put an exit -1 into the background if the data_process call fails (returns non-zero) but doesn't cause the overall call to data_process code to run in the background.

Have I got that wrong?

You might want this:-
Code:
(/path/to/product/script/data_process "${fileLines}" || exit -1) &

It might be simpler to have a directory called 'Running' that you create a marker file in when you start a job and only remove when you successfully exit. That way, you could write something to read the directory contents for a restart.

Would that logic help?



Robin
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to do parallel processing??

Hi All, I am working on solaris 8 sparc machine with 2 cpu. I am trying to run my application which generates files. I run multiple instance of the application, but the results don't seem to show as if it were runing parallely. When i run the application once it takes 12 secs to generate a... (1 Reply)
Discussion started by: zing
1 Replies

2. UNIX for Dummies Questions & Answers

Restart on power failure

How do I configure my workstation (Solaris 9) to restart and perform any check disk automatically if there is a power failure? Thanks. (1 Reply)
Discussion started by: here2learn
1 Replies

3. Shell Programming and Scripting

parallel processing

Hi I want to run two shell script files parallely. These two scripts are interacting with the database. can any body help on this Pls Regards Audippa naidu.M (3 Replies)
Discussion started by: audippa
3 Replies

4. Shell Programming and Scripting

Need Help With Parallel Processing

Hi I am looking for some kind of feature in unix that will help me write a script that can invoke multiple processes in parallel. And make sure that the multiple parallel processes complete successfully before I proceed to the next step. Someone suggested something called timespid or... (6 Replies)
Discussion started by: imnewtothis23
6 Replies

5. Shell Programming and Scripting

parallel processing

hi i am preparing a set of batches for a set of files sequentially There is a folder /xyz where all the files reside now all the files starting with 01 - will be appended for one below other to form a batch batch01 then all the files starting with 02 - will be appended for one below other to... (7 Replies)
Discussion started by: mad_man12
7 Replies

6. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log... (0 Replies)
Discussion started by: Samb95
0 Replies

7. Shell Programming and Scripting

script parallel processing

How to write script which run multiple scripts parllely, i have script called A,which has to execute B,C,D,E scripts parllely.. (2 Replies)
Discussion started by: machpee
2 Replies

8. Shell Programming and Scripting

Re run the script from the point of failure

Hello I have a shell script with multiple sections in it. Like, verify pre-requisites, ch co version, stop services , install product , post migration steps, start services, send status email. If the script fails at certain step, (like after product installation) it can't be re-run since the... (2 Replies)
Discussion started by: mo12
2 Replies

9. Shell Programming and Scripting

Parallel processing

I have 10,000 + files, each of which I need to zip using bzip2. Is ti possible to use bash to create 8 parallel streams sending a new file to be processed from the list when one of the others has finished? (1 Reply)
Discussion started by: garethsays
1 Replies
reposync(1)															       reposync(1)

NAME
reposync - synchronize yum repositories to a local directory SYNOPSIS
reposync [options] DESCRIPTION
reposync is used to synchronize a remote yum repository to a local directory, using yum to retrieve the packages. OPTIONS
-h, --help Display a help message, and then quit. -c CONFIG, --config=CONFIG Config file to use (defaults to /etc/yum.conf). -a ARCH, --arch=ARCH Act as if running the specified arch (default: current arch, note: does not override $releasever. x86_64 is a superset for i*86.). --source Also download .src.rpm files. -r REPOID, --repoid=REPOID Specify repo ids to query, can be specified multiple times (default is all enabled). -t, --tempcache Use a temp dir for storing/accessing yum-cache. -p DESTDIR, --download_path=DESTDIR Path to download packages to: defaults to current directory. -g, --gpgcheck Remove packages that fail GPG signature checking after downloading. exit status is '1' if at least one package was removed. -u, --urls Just list urls of what would be downloaded, don't download. -l, --plugins Enable yum plugin support. -n, --newest-only Download only newest packages per-repo. -q, --quiet Output as little information as possible. EXAMPLES
Sync all packages from the 'updates' repo to the current directory: reposync --repoid=updates Sync only the newest packages from the 'updates' repo to the current directory: reposync -n --repoid=updates Sync packages from the 'updates' and 'extras' repos to the current directory: reposync --repoid=updates --repoid=extras Sync all packages from the 'updates' repo to the repos directory: reposync -p repos --repoid=updates Sync all packages from the 'updates' repo to the repos directory excluding x86_64 arch. Edit /etc/yum.conf adding option exclude=*.x86_64. Then: reposync -p repos --repoid=updates FILES
reposync uses the yum libraries for retrieving information and packages. If no configuration file is specified, the default yum configura- tion will be used. /etc/yum.conf /etc/yum/repos.d/ SEE ALSO
yum.conf (5) http://yum.baseurl.org/ AUTHORS
See the Authors file included with this program. BUGS
There are of course no bugs, but should you find any, you should first consult the FAQ section on http://yum.baseurl.org/wiki/Faq and if unsuccessful in finding a resolution contact the mailing list: yum-devel@lists.baseurl.org. To file a bug use http://bugzilla.redhat.com for Fedora/RHEL/Centos related bugs and http://yum.baseurl.org/report for all other bugs. 27 April 2007 reposync(1)
All times are GMT -4. The time now is 12:59 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy