Help with a loop


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with a loop
# 1  
Old 05-16-2014
Help with a loop

I have 2 servers syncing some directories with an rsync script. They are in different countries. The rsync script is executed on Server#1. I am using 'fswatch' to execute the script automatically, when the directory is modified.

Here is where I am looking for help:

After 'fswatch' see's a directory change, it triggers my rsync script on Server#1. I need the rsync script to look at the Server#2 and check a file which contains the string "open" or "closed". If it says "closed", I want the rsync to script to execute. If it says "open", I don't want the rsync script to execute, but rather wait x seconds and check the file again (the file will eventually change to "closed", allowing the script to run).

Any insight on structuring this is greatly appreciated, I haven't figured out how to setup the loop of 'check file/don't execute/wait/check again' logic.

---------- Post updated at 08:06 PM ---------- Previous update was at 06:44 PM ----------

I think I found the logic. Can somebody tell me how to get this to time out after say 100 tries?

Code:
STATUSFILE=/Users/patrick/Desktop/temp/remoteserverstatus
until grep -q closed "$STATUSFILE"; do
echo ‘waiting for sever to finish’; sleep 3
done
echo ‘running script’


Last edited by sudo; 05-16-2014 at 09:25 PM.. Reason: Removing code
# 2  
Old 05-16-2014
You didn't say what shell or operating system you're using. With any shell that accepts POSIX standard shell syntax, you could try the following simple change to your script:
Code:
STATUSFILE=/Users/patrick/Desktop/temp/remoteserverstatus
n=0
until grep -q closed "$STATUSFILE"; do
        n=$((n + 1))
        if [ $n -ge 100 ]
        then    echo 'server unavailable'
                exit 1
        fi
        echo 'waiting for sever to finish'
        sleep 3
done
echo 'running script'

Note the changes to the quotes used on your echo commands in addition to the added code.
This User Gave Thanks to Don Cragun For This Post:
# 3  
Old 05-16-2014
Wrap the until in a for loop 1 .. 100, and write sleep x after until done inside for loop
And if the status is closed, give a break to exit out of the for loop
This User Gave Thanks to SriniShoo For This Post:
# 4  
Old 05-16-2014
I got the impression from reading your posting that the status file (the one containing "closed" or "open") was on the remote server. If so, then the "grep" command of a local file won't help.

If the status file IS local to the server running the script, then Don Cragun's script looks good. But for some reason I think you're trying to check a status file on the remote end before starting the "rsync" locally?
This User Gave Thanks to cnamejj For This Post:
# 5  
Old 05-17-2014
Quote:
Originally Posted by cnamejj
I got the impression from reading your posting that the status file (the one containing "closed" or "open") was on the remote server. If so, then the "grep" command of a local file won't help.

If the status file IS local to the server running the script, then Don Cragun's script looks good. But for some reason I think you're trying to check a status file on the remote end before starting the "rsync" locally?
You are correct. The script initially checks the remote file and creates a local copy which is used for authorizing rsync in the until loop. I know, its an extra step I should probably optimize by looking straight at the server.

---------- Post updated at 12:34 AM ---------- Previous update was at 12:23 AM ----------

Quote:
Originally Posted by Don Cragun
You didn't say what shell or operating system you're using. With any shell that accepts POSIX standard shell syntax, you could try the following simple change to your script:
Code:
STATUSFILE=/Users/patrick/Desktop/temp/remoteserverstatus
n=0
until grep -q closed "$STATUSFILE"; do
        n=$((n + 1))
        if [ $n -ge 100 ]
        then    echo 'server unavailable'
                exit 1
        fi
        echo 'waiting for sever to finish'
        sleep 3
done
echo 'running script'

Note the changes to the quotes used on your echo commands in addition to the added code.
Don, I like this a lot. I'm going to deploy it on Monday in my test environment but based on the test I've done so far, this works great. Thanks!

BASH/MACOSX10.7
# 6  
Old 05-17-2014
Quote:
Originally Posted by sudo
You are correct. The script initially checks the remote file and creates a local copy which is used for authorizing rsync in the until loop. I know, its an extra step I should probably optimize by looking straight at the server.

---------- Post updated at 12:34 AM ---------- Previous update was at 12:23 AM ----------



Don, I like this a lot. I'm going to deploy it on Monday in my test environment but based on the test I've done so far, this works great. Thanks!

BASH/MACOSX10.7
Unless there is something external to the script I gave you that updates /Users/patrick/Desktop/temp/remoteserverstatus when the remote server status changes, the script I gave you will never succeed if the remote server is busy when the loop starts.
This User Gave Thanks to Don Cragun For This Post:
# 7  
Old 05-17-2014
Basically, these servers are both running this program. The folders that are being synced are AFP share points that are used by people to upload files over a network. The idea is each country has a local repository of data, for performance measures.

The program reaches out to the far server and grabs the status, and uses that for rsync authentication. This is just to prevent synonymous syncing, which is problematic when large files upload to afp. The server will start the rsync before the file is finished uploading to the AFP share point, causing this chain reaction of syncing partly uploaded files between both servers.

i REALLY wanted to simply have the rsync wait until any AFP upload is done, but fswatch triggers the rsync when a change is made to the folder, including the start of the upload. I didn't see a way to have the script identify if a file was still uploading (there is nothing unique about a file upload-in-progress to use as a conditional for the script?)

Code:
n=0
until
    ssh user@servaddress 'cat /Users/admin/localserv/localserverstatus' 1> $REMOTESTAT && grep -q Closed "$REMOTESTAT"; do
        n=$((n + 1))
        if [ $n -ge 1000 ]
        then    echo 'server unavailable'
        exit 1
        fi
    echo 'waiting for sever to finish'
done
echo 'Open' 1> $LOCALSTAT
rsync -rvza --delete-after --progress $LOCALFOLDER $REMOTEFOLDER
echo 'Closed' 1> $LOCALSTAT

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

For loop or while loop from a text file

Hi all, i developed a script to measure the uptime of a process in a Solaris 10/11 environments. All is well, but i came across a situation where there are multiple processes of the same name. Basically i have the following result file: beVWARS 13357 19592122 beVWARS 14329 19591910... (4 Replies)
Discussion started by: nms
4 Replies

2. Shell Programming and Scripting

awk loop using array:wish to store array values from loop for use outside loop

Here's my code: awk -F '' 'NR==FNR { if (/time/ && $5>10) A=$2" "$3":"$4":"($5-01) else if (/time/ && $5<01) A=$2" "$3":"$4-01":"(59-$5) else if (/time/ && $5<=10) A=$2" "$3":"$4":0"($5-01) else if (/close/) { B=0 n1=n2; ... (2 Replies)
Discussion started by: klane
2 Replies

3. Shell Programming and Scripting

Reset while loop to loop same file multiple times

Hi, I want to read file multiple times. Right now i am using while loop but that is not working. ex. While read line do while read line2 do echo stmt1 #processing some data based on data., done < file2.txt done < file1.txt # This will have 10... (4 Replies)
Discussion started by: tmalik79
4 Replies

4. Shell Programming and Scripting

Array Variable being Assigned Values in Loop, But Gone when Loop Completes???

Hello All, Maybe I'm Missing something here but I have NOOO idea what the heck is going on with this....? I have a Variable that contains a PATTERN of what I'm considering "Illegal Characters". So what I'm doing is looping through a string containing some of these "Illegal Characters". Now... (5 Replies)
Discussion started by: mrm5102
5 Replies

5. Shell Programming and Scripting

My for loop decides to become an infinite loop?

Hi, I was debating if I should put this in the dummies or scripts section, I apologize in advance if I chose poorly. Fairly new to Unix and BASH scripting but I thought I made it fairly well given my limited understanding. However, the output indicates that it's looping and I'm ending up with a... (5 Replies)
Discussion started by: gotreef
5 Replies

6. Shell Programming and Scripting

S# in a for loop - concatenate $(loop counter)

Hi, hope I am posting in the right section. My problem is that I have 2 or more arguments passed and I want to check if the arguments passed exists or not. The first argument should not exist and the remaining others should exist. example: ./shells.sh argument1 argument2 argument3 ... (5 Replies)
Discussion started by: fight4love
5 Replies

7. Shell Programming and Scripting

BASH loop inside a loop question

Hi all Sorry for the basic question, but i am writing a shell script to get around a slightly flaky binary that ships with one of our servers. This particular utility randomly generates the correct information and could work first time or may work on the 12th or 100th attempt etc !.... (4 Replies)
Discussion started by: rethink
4 Replies

8. Shell Programming and Scripting

Null Handling in Until loop. . .loop won't stop

Hi Im running this script, which is supposed to find the max value build some tables and then stop running once all the tables are built. Thing is , it keeps assigning a null value to $h and then $g is null so it keep building tables i.e. testupdateNUL. How can I stop this? Here is what I have: ... (4 Replies)
Discussion started by: brandono66
4 Replies

9. Shell Programming and Scripting

Using variables created sequentially in a loop while still inside of the loop [bash]

I'm trying to understand if it's possible to create a set of variables that are numbered based on another variable (using eval) in a loop, and then call on it before the loop ends. As an example I've written a script called question (The fist command is to show what is the contents of the... (2 Replies)
Discussion started by: DeCoTwc
2 Replies

10. Shell Programming and Scripting

Is there a better way I could have run this loop. (For loop with two variables)

Sorry for such a dreadful title, but I'm not sure how to be more descriptive. I'm hoping some of the more gurutastic out there can take a look at a solution I came up with to a problem, and advice if there are better ways to have gone about it. To make a long story short around 20K pieces of... (2 Replies)
Discussion started by: DeCoTwc
2 Replies
Login or Register to Ask a Question