rsync, which files where moved?


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers rsync, which files where moved?
# 1  
Old 02-10-2008
rsync, which files where moved?

Hello,
I am using rsync to make sure that my folder "local" mirrors the remote directory "remote". When a file is copied from "remote" to "local", I need to apply a bash script to it. What would be a neat way to do that?

Thanks

ps: is there a way to edit the title of the thread (I am a bit ashamed of the "where" instead of "were"?

Last edited by JCR; 02-10-2008 at 12:20 PM..
# 2  
Old 02-10-2008
Ok, I follow you right, you want to mirror all the files from remote to local (not sure if changes to local need to go remote though). After you rsync you want to (do something) to all the files individually that had been changed (lets say perhaps you want to dos2unix them). Well obviously after you dos2unix them, and you run rsync again your going to mirror all those files again since you changed them which is a problem.

Assuming you know this and are copying the files elsewhere after being proicessed, rather that using rsync's --out-format or --log-format and then grinding on that you can simply something akin to this, as long as the timestamps aren't being copied over and your just using size/crc to do the mirror.

Code:
touch TEMPFILE
rsync --opts SOURCE TARGET
find TARGET -type f --newer TEMPFILE --exec BASHSCRIPT "{}" ";"
rm TEMPFILE


Last edited by Yogesh Sawant; 12-10-2010 at 05:16 AM.. Reason: added code tags
# 3  
Old 02-10-2008
Java Copying files to remote machine using rsync

sciprtfile | tee filename.log

this will copy the output into a file

or

scriptfile | mail -s "backup files" user@domain.com

Last edited by balapobi; 02-10-2008 at 02:55 PM..
# 4  
Old 02-10-2008
Quote:
Originally Posted by balapobi
Hi there is an another script, create a ssh-key and import that key in remote machine, run this script in local machine. Your files get copied in remote machine.

$RSYNC -az -e "$SSH -i $KEY" $RUSER@$RHOST:$RPATH $LPATH

run this script...
Copying doesn't seem to be the issue, processing the changes is.
# 5  
Old 02-11-2008
HPAVC,

Thanks for the idea. I added a sleep 1 between the creation of the temp file and the rsync call because it seems to me that the -newer means strictly newer.
# 6  
Old 02-11-2008
Quote:
Originally Posted by JCR
HPAVC,

Thanks for the idea. I added a sleep 1 between the creation of the temp file and the rsync call because it seems to me that the -newer means strictly newer.
Yeah, the find syntax and my tired mind was probably an issue too.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Rsync and Move files

I Have a requirement where i have to sync two directories one on source location server A and other on destination location server B as i do not have ssh access from server A----------->B I am doing rsync from server B, The Requirement is as follows Two directories on the source and... (4 Replies)
Discussion started by: James0806
4 Replies

2. Shell Programming and Scripting

How to count the number of files moved?

I'm writing a script for searching substring in file content and then moving found files. So far I've wrote script shown below grep -lir 'stringtofind' $1 | xargs mv -t $2 How can i count number of files moved? (4 Replies)
Discussion started by: Kadikis
4 Replies

3. Linux

Possible Cause of Files Not Being Moved?

Hi ULF, Good day! I'm working on a LINUX Suse server and I have an entry in CRON which looks like this below: 0 5 * * * /usr/bin/find /opt/nsfw/var/partition-all/ -name "RCV_SASN*" -exec mv '{}' /opt/nsfw/var/rcv-archive/ \; This tool runs everyday at 5am and it will just move the files... (7 Replies)
Discussion started by: rymnd_12345
7 Replies

4. Shell Programming and Scripting

rsync copy files once

Hi This is my situation I have files on the left which I want to copy to the right. Once the files are copied to the right, they are processed and then deleted. The next time rsync runs I dont want it to copy the same files again, it should only copy any new files to the right. I have been... (4 Replies)
Discussion started by: duonut
4 Replies

5. Shell Programming and Scripting

Column comparison between two files: moved from another post

I have two files as follows: Pval.txt ID Pvalue 91500 0.004 91700 0.007 91800 0.12 91900 0.05 92000 0.99 Freq.txt ID Frequency 90000 56 91500 29 91600 78 91700 60 91800 77 91900 66 92000 70 92100 50 92200 60I need to compare 1st... (19 Replies)
Discussion started by: cs_novice
19 Replies

6. Shell Programming and Scripting

List moved files in text file

Hi. I am actually doing all of this on OSX, but using unix apps and script. I have built my own transparent rsync/open directory/mobility/etc set of scripts for the firm I work at, and it is all almost complete except for ONE THING. I have the classic problem with rsync where if a user... (0 Replies)
Discussion started by: Ashtefere
0 Replies

7. UNIX for Advanced & Expert Users

How to know the user who moved the files to other dir

Hi, I want to know the user ID who moved a file from one directory to another Directory. Example: File1 created by user A is present in dirA then some one has moved it to dirB using "mv" command I want to know the user ID who moved the file to dirB. As far as i know "ls -lrt" command... (1 Reply)
Discussion started by: srilaxmi
1 Replies

8. Solaris

files updated in last 10 hours should be moved

Hi, I would like to move all files that are updated in last 10 hrs. to some temporary folder. Please help. (3 Replies)
Discussion started by: sanjay1979
3 Replies

9. UNIX for Dummies Questions & Answers

Showing Moved Files

Hi everyone, In a directory I have files with various extensions. I would like to move all the files ending in .L2 into a directory: ~/test. But I would also like to show which files are being moved. Of course I could type: $ ls *.L2 $ mv *.L2 ~/test Is there a way I can combine these two... (5 Replies)
Discussion started by: msb65
5 Replies

10. Shell Programming and Scripting

Getting a list of filenames of moved files

I'm moving a list of files of some extension and I wish to output the moved filenames into a text file, I tried using the command below, but after all the files are moved, I got a blank file. find /abc/temp -type f -mtime +365 \( -name "*.bak" -o -name "*.log" \) -exec mv -f {} /junk \; >>... (3 Replies)
Discussion started by: chengwei
3 Replies
Login or Register to Ask a Question