Sponsored Content
Top Forums UNIX for Beginners Questions & Answers rsync a file as it gets created and after 3 minutes old Post 303033812 by malaika on Friday 12th of April 2019 12:11:28 AM
Old 04-12-2019
rsync a file as it gets created and after 3 minutes old

- run a backup job
- The jobs creates partial files one after the other, about 2 minutes interval.

What i want to do is that while the job is still running or while a file was last modified or created 3 minutes ago, the
file should be rsync to a remote server untill the last file has been created and 3 minutes old.

I am learning how to script.
I have tried different options but no success
The closest i got was that the files were copied up to the current last file created and the script exited without waiting for the subsequent files to be created.
In other words i could not get the script to loop until it picked up all the files before exiting.
In my test i used ' echo " nohup rsync -a --inplace /mara/backup/mala$filename mara@tronic9922:/mara/backup/mara/ $ " >> thejobs ' instead of doing rsync dynamically.

But what i really need is to use rsync, to i can send each file to the remove server as it is created and its is 3 minutes old.

Hopefully someone can fix this for me or come up with a new script all together.
- see bottom for the files that get created.
Thanks


Code:
#!/bin/ksh

for filename in `find . -mmin -3 -type f|grep bkup`;
do
BKPPROCCNT=`ps -ef |grep "/royal/current/bin/_muller runbkup"|grep -v  grep |wc -l` echo $filename
if [[  $BKPPROCCNT -eq 1 ]] || [[ -s $filename ]];
then
 nohup rsync -a  --inplace /home/backup/mala/$filename  mala@tronic9922:/home/backup/mala/ $ 
else
fi
sleep 3
done

Code:
#!/bin/ksh


for filename in `find . -mmin +2 -type f|grep bkup`;
do
BKPPROCCNT=`ps -ef |grep "/royal/current/bin/_muller runbkup"|grep -v  grep |wc -l`

echo $filename

if [[  $BKPPROCCNT -eq 1 ]] && [[ -s $filename ]];
then
 nohup rsync -a  --inplace /home/backup/mala$filename  mala@tronic9922:/home/backup/mala/ $ 
else
echo "backup ended or no file found"
fi
sleep
done


TRYING TO USE A WHILE LOOP AS THE BACKUP JOB IS RUNNING - this i could not figure it out.

Code:
#!/bin/ksh


set BKPID = `ps -ef |grep "/royal/current/bin/_muller runbkup"|awk '{print $2}'|head -1`
while ("$BKID" != "")

do
if [ test `find /vpas/backup/mala  -name bkup* -mmin +5` ] then
then
---
nohup rsync -a  --inplace /home/backup/mala$filename  mala@tronic9922:/home/backup/mala/ $ 
else
echo "backup ended or no file found"
fi
sleep 3
done



cd /home/backup/mala

ls -lrt

-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:50 bkup1
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:51 bkup2
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:52 bkup3
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:53 bkup4
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:55 bkup5
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:56 bkup6
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:57 bkup7
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:57 bkup8
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:58 bkup9
-rw-rw-r--    1 mala     dev      7516081152 Apr 11 19:59 bkup10
-rw-rw-r--    1 mala     dev      3943402496 Apr 11 19:59 bkup11

Moderator's Comments:
Mod Comment Please do wrap your codes or samples in CODE TAGS as per forum rules.

Last edited by RavinderSingh13; 04-12-2019 at 02:02 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How can i search a file which has been created or modified in last five minutes

Hi Can some one please help me How can i search a file which has been created or modified in last five minutes I have used the command find . -mmin -5 and it does not work i get an error -mmin is bad option Please help Much regards Tarun (2 Replies)
Discussion started by: tarundeepdhawan
2 Replies

2. Shell Programming and Scripting

find files created within 30 minutes

find . -name *.txt -mmin -30 This is working in Redhat but not in Solaris.. What is the equivalent option in Solaris? (1 Reply)
Discussion started by: tene
1 Replies

3. Shell Programming and Scripting

Ftp get files created in last 30 minutes

Is it possible in an ftp script to get remote files based on whether they have been created in the last 30 minutes? (5 Replies)
Discussion started by: gefa
5 Replies

4. Shell Programming and Scripting

Check how many minutes ago the last file created

Hi , I need help in getting how many minutes ago the last file, matching some pattern in file name, was created in a folder. Thanks in advance. (8 Replies)
Discussion started by: Anupam_Halder
8 Replies

5. Shell Programming and Scripting

How to send a file in UNIX through email which is created only 15 minutes before the current time?

I wanted to send an email to the client whenever there is failed record created in a /feed/HR-76/failed folder after processing of feed file. I can find out with the help of below script that what is the new file created but that file didn't make just 15 minutes before. ... (1 Reply)
Discussion started by: puneetkhullar
1 Replies

6. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

7. UNIX for Beginners Questions & Answers

How to convert days hours minutes seconds to minutes?

Hi, please help with below time conversion to minutes. one column values: 2 minutes 16 seconds 420 msec 43 seconds 750 msec 0 days 3 hours 29 minutes 58 seconds 480 msec 11 seconds 150 msec I need output in minutes(total elapsed time in minutes) (2 Replies)
Discussion started by: ramu.badugula
2 Replies

8. Shell Programming and Scripting

Grep a log file for the last 5 minutes of contents every 5 minutes

Hi all, System Ubuntu 16.04.3 LTS i have the following log INFO 2019-02-07 15:13:31,099 module.py:700] default: "POST /join/8550614e-3e94-4fa5-9ab2-135eefa69c1b HTTP/1.0" 500 2042 INFO 2019-02-07 15:13:31,569 module.py:700] default: "POST /join/6cb9c452-dcb1-45f3-bcca-e33f5d450105... (15 Replies)
Discussion started by: charli1
15 Replies

9. Shell Programming and Scripting

Check file creation Time minutes and if file older then 5 minutes execute some stuff

Hello all, Info: System RedHat 7.5 I need to create a script that based on the creation time, if the file is older then 5 minutes then execute some stuff, if not exit. I thought to get the creation time and minutes like this. CreationTime=$(stat -c %y /tmp/test.log | awk -F" " '{ print... (3 Replies)
Discussion started by: charli1
3 Replies

10. UNIX for Beginners Questions & Answers

Find if create time of last created file in a directory is older than 5 minutes

A process xyz is running and creating file1, file2, file3, .... filen. how do i know if the process has stopped and createtime of the last file (filen) is older than 5 minutes? OS is AIX (3 Replies)
Discussion started by: malaika
3 Replies
All times are GMT -4. The time now is 01:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy