[BASH] Script to manage background scripts (running, finished, exit code)


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting [BASH] Script to manage background scripts (running, finished, exit code)
Prev   Next
# 1  
Old 10-16-2014
[BASH] Script to manage background scripts (running, finished, exit code)

Heyas,

Since this question (similar) occur every now and then, and given the fact i was thinking about it just recently (1-2 weeks) anyway, i started to write something Smilie

The last point for motivation was How to run scripts parallely inside shell script?
Where I've posted a screen-shot from my very first (and small) approach.

Now i want to write a script that will work for/with:
  • 'any' amount of scripts passed,
  • provides a limiter, so only X scripts are running simultaneously
  • Prints the status code of each of the scripts ran

So I had it running and working, but then figured, I've only tested 4 scripts (sleep [5-30secs), but the LIMIT was 5, so I reduced the limit to 2, now i cant figure why its not working.
Actually, it wont even run (properly) with the default LIMIT of 5 even when only 4 scripts are passed Smilie
And the previous code no longer works neither, since I've renamed some of the variables, for a better 'sort'.

My approach is:
  • scripts_remains = array of arguments (the scripts passed)
  • scripts_start = array is filled only temporary, as long the counter scripts_running is less than the LIMIT.
  • While filling the scripts_start, i remove the according array element from scripts_remains.
  • scripts_todo = array that gets filled as soon the scripts_start entry is started. (and afterwards removed from scripts_start)
  • scripts_id = array which holds the PID of the script of the same ID of scripts_todo
When the script no longer finds the PID, it moves the element from scripts_todo/scripts_id to done_scripts, and fills done_ret, both with the same array id.
(this part works still/again)

But the starting array gets only the first script and not more... however, it does list as many entries as the LIMIT allows, but all contain the first script and only 1 entry does actually show the proper PID.
scripts_remains still holds all array elements, which confuses me, furthermore scripts_todo holds only 1 array element. but lists as many entries as the LIMIT allows.

NOTE: This script is(will be) part of my TUI (text user interface) package, therefore all those tui-* commands ARE available and 'valid' - on my system at least.

Please see the screen-shot on how it outputs, and the code segment that is faulty.
Acknowledge, that the error referring to line 332 is due to the wrong set / missing array values.

I have a small script, that is working, but since i want/need to have some handlers and argument handling around it,
it does in no way refer the issues i experience.

I'm asking if you either see a 'wrong'-code, in the part visible, or if you would have an advice for another approach/method to achieve my goal?
Thank you in advance

EDIT:
It seems that the first script (only one loaded to array) is started/executed as many times as the limit is set to, without continuing to the next array element.. Smilie
But i cant pinpoint it.

If you need the full code, i'd happily share it, just since it wont run (unless you have TUI installed) i thought its not really helpfull anyway.

EDIT:
Done the 'no limit' part, which works:
Code:
			while [[ ! -z "${scripts_remains[@]}" ]]
				do	# Start the script:
					script="${scripts_remains[$counter_start]}"
					scripts_todo[$counter_start]="$script"
					
					# Generate the command
					[[ [./] = "${script:0:1}" ]] && PRE="" || PRE="./"
					cmd="${PRE}\"$script\" ; echo \$? > \"$TEMP/$script.ret\""
					#doLog "Executing: $cmd"
					
					# Get PID to array
					( eval $cmd ) &
					scripts_id[$counter_start]="$!"
					
					# Remove it from array, and move to next entry
					unset scripts_remains[$counter_start]
					((counter_start++))
				done

So I need to get this code segment working with a LIMIT factor, so only LIMIT amount of scripts are started as long scripts_running is smaller than the LIMIT - see the main post -

Screen-shot *1*small : the non-working part
Screen-shot *2*small : the working no-limit part

EDIT3:
I'm now 100% sure, I've had somewhere screwed up with the arrays, but atm I'm too blind...
[BASH] Script to manage background scripts (running, finished, exit code)-tui-bg-scripts-1_smalljpg
[BASH] Script to manage background scripts (running, finished, exit code)-tui-bg-scripts-2_smalljpg

Last edited by rbatte1; 10-17-2014 at 07:35 AM.. Reason: Added LIST tags
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Terminal running bash/rsync script does not close with exit (MacOS High SIerra)

Hello, I am running a bash script to do an rsync back on a computer running MacOS High Sierra. This is the script I am using, #!/bin/bash # main backup location, trailing slash included backup_loc="/Volumes/Archive_Volume/00_macos_backup/" # generic backup function function backup {... (12 Replies)
Discussion started by: LMHmedchem
12 Replies

2. Shell Programming and Scripting

Problems running scripts in the background

Hi Could someone offer some help on this problem I've got with running a background process. As part of a script that does a stop/start/status for a piece of software called SAS, the following extract is from part of the start step. My issue is that when the script is run, the control... (0 Replies)
Discussion started by: GavP
0 Replies

3. Shell Programming and Scripting

Running scripts in background

Hi, below is my master script wihch inturn runs 2 scripts in background #master_script.sh ./subscript1.sh & ./subscript2.sh & executed the master_script.sh from unix command prompt $ ./master_script.sh it is executing the subscripts and they are completing fine, however master_script.sh is... (2 Replies)
Discussion started by: JSKOBS
2 Replies

4. Shell Programming and Scripting

Bash Question: HowTo Exit Script with User Input While Process is Running Mid-Loop?

Hi, I have written a script that allows me to repetitively play a music file $N times, which is specified through user input. However, if I want to exit the script before it has finished looping $N times, if I use CTRL+c, I have to CTRL+c however many times are left in order to complete the loop.... (9 Replies)
Discussion started by: hilltop_yodeler
9 Replies

5. Shell Programming and Scripting

Catch exit code of specific background process

Hi all, i hava a specific backgroud process. I have de PID of this process. At some time, the process finish his job, is there any way to catch the exit code? I use "echo $?" normally for commands. Thanks! (2 Replies)
Discussion started by: Xedrox
2 Replies

6. Shell Programming and Scripting

Capturing the exit status of the script running in background

Hi All, I have a scenario where I am executing some child shell scripts in background (using &)through a master parent script. Is there a way I can capture the exit status of each individual child script after the execution is completed. (2 Replies)
Discussion started by: paragkalra
2 Replies

7. Shell Programming and Scripting

Issues with exit after running jobs in background

I have the following sample script to run a script the jobs with the same priority(in this case field3) in parallel; wait for the jobs to finish and run the next set of jobs in parallel.When all the lines are read exit the script. I have the following script which is doing evrything I want... (1 Reply)
Discussion started by: hyennah
1 Replies

8. UNIX for Dummies Questions & Answers

background job finished notification

In my last job someone gave me the command to put in my .profile that let me know when a job I had running in the background finished. It was a word about 5 char long. I can't remember it! (4 Replies)
Discussion started by: nkeller
4 Replies

9. Shell Programming and Scripting

exit status of Invoking two or more scripts in background

I have a sript which is going to trigger other 3 scripts in background simultaneously for eg: Main Script:(main.sh) ----------- sh a.sh & sh b.sh & sh c.sh & How to catch the exit status and store it in a variable for all those three scripts in main script. Is there any other way of... (4 Replies)
Discussion started by: Omkumar
4 Replies
Login or Register to Ask a Question