Sponsored Content
Top Forums UNIX for Dummies Questions & Answers rsync, which files where moved? Post 302166034 by HPAVC on Sunday 10th of February 2008 01:11:53 PM
Old 02-10-2008
Ok, I follow you right, you want to mirror all the files from remote to local (not sure if changes to local need to go remote though). After you rsync you want to (do something) to all the files individually that had been changed (lets say perhaps you want to dos2unix them). Well obviously after you dos2unix them, and you run rsync again your going to mirror all those files again since you changed them which is a problem.

Assuming you know this and are copying the files elsewhere after being proicessed, rather that using rsync's --out-format or --log-format and then grinding on that you can simply something akin to this, as long as the timestamps aren't being copied over and your just using size/crc to do the mirror.

Code:
touch TEMPFILE
rsync --opts SOURCE TARGET
find TARGET -type f --newer TEMPFILE --exec BASHSCRIPT "{}" ";"
rm TEMPFILE


Last edited by Yogesh Sawant; 12-10-2010 at 05:16 AM.. Reason: added code tags
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Getting a list of filenames of moved files

I'm moving a list of files of some extension and I wish to output the moved filenames into a text file, I tried using the command below, but after all the files are moved, I got a blank file. find /abc/temp -type f -mtime +365 \( -name "*.bak" -o -name "*.log" \) -exec mv -f {} /junk \; >>... (3 Replies)
Discussion started by: chengwei
3 Replies

2. UNIX for Dummies Questions & Answers

Showing Moved Files

Hi everyone, In a directory I have files with various extensions. I would like to move all the files ending in .L2 into a directory: ~/test. But I would also like to show which files are being moved. Of course I could type: $ ls *.L2 $ mv *.L2 ~/test Is there a way I can combine these two... (5 Replies)
Discussion started by: msb65
5 Replies

3. Solaris

files updated in last 10 hours should be moved

Hi, I would like to move all files that are updated in last 10 hrs. to some temporary folder. Please help. (3 Replies)
Discussion started by: sanjay1979
3 Replies

4. UNIX for Advanced & Expert Users

How to know the user who moved the files to other dir

Hi, I want to know the user ID who moved a file from one directory to another Directory. Example: File1 created by user A is present in dirA then some one has moved it to dirB using "mv" command I want to know the user ID who moved the file to dirB. As far as i know "ls -lrt" command... (1 Reply)
Discussion started by: srilaxmi
1 Replies

5. Shell Programming and Scripting

List moved files in text file

Hi. I am actually doing all of this on OSX, but using unix apps and script. I have built my own transparent rsync/open directory/mobility/etc set of scripts for the firm I work at, and it is all almost complete except for ONE THING. I have the classic problem with rsync where if a user... (0 Replies)
Discussion started by: Ashtefere
0 Replies

6. Shell Programming and Scripting

Column comparison between two files: moved from another post

I have two files as follows: Pval.txt ID Pvalue 91500 0.004 91700 0.007 91800 0.12 91900 0.05 92000 0.99 Freq.txt ID Frequency 90000 56 91500 29 91600 78 91700 60 91800 77 91900 66 92000 70 92100 50 92200 60I need to compare 1st... (19 Replies)
Discussion started by: cs_novice
19 Replies

7. Shell Programming and Scripting

rsync copy files once

Hi This is my situation I have files on the left which I want to copy to the right. Once the files are copied to the right, they are processed and then deleted. The next time rsync runs I dont want it to copy the same files again, it should only copy any new files to the right. I have been... (4 Replies)
Discussion started by: duonut
4 Replies

8. Linux

Possible Cause of Files Not Being Moved?

Hi ULF, Good day! I'm working on a LINUX Suse server and I have an entry in CRON which looks like this below: 0 5 * * * /usr/bin/find /opt/nsfw/var/partition-all/ -name "RCV_SASN*" -exec mv '{}' /opt/nsfw/var/rcv-archive/ \; This tool runs everyday at 5am and it will just move the files... (7 Replies)
Discussion started by: rymnd_12345
7 Replies

9. Shell Programming and Scripting

How to count the number of files moved?

I'm writing a script for searching substring in file content and then moving found files. So far I've wrote script shown below grep -lir 'stringtofind' $1 | xargs mv -t $2 How can i count number of files moved? (4 Replies)
Discussion started by: Kadikis
4 Replies

10. Shell Programming and Scripting

Rsync and Move files

I Have a requirement where i have to sync two directories one on source location server A and other on destination location server B as i do not have ssh access from server A----------->B I am doing rsync from server B, The Requirement is as follows Two directories on the source and... (4 Replies)
Discussion started by: James0806
4 Replies
LSYNCD(1)							      Lsyncd								 LSYNCD(1)

NAME
lsyncd - a daemon to continuously synchronize directory trees SYNOPSIS
config file *lsyncd* [OPTIONS] CONFIG-FILE default rsync behaviour *lsyncd* [OPTIONS] -rsync SOURCEDIR TARGET ... default rync+ssh bevahiour (moves and deletes through ssh) *lsyncd* [OPTIONS] -rsyncssh SOURCEDIR TARGETHOST TARGETDIR ... default direct bevahiour (local file operations/rsync) *lsyncd* [OPTIONS] -direct SOURCEDIR TARGETDIR ... DESCRIPTION
Lsyncd(1) watches local directory trees through an event monitor interface (inotify, fsevents). It aggregates and combines events for a few seconds and then spawns one or more processes to synchronize the changes. By default this is rsync(1). Lsyncd is thus a light-weight asynchronous live mirror solution that is comparatively easy to install not requiring new filesystems or blockdevices and does not hamper local filesystem performance. Rsync+ssh is an advanced action configuration that uses a SSH(1) to act file and directory moves directly on the target instead of retransmitting the move destination over the wire. Fine-grained customization can be achieved through the CONFIG-FILE. Custom action configs can even be written from scratch in cascading layers ranging from shell scripts to code written in the LUA(1) language. This way simplicity can be balanced with powerfulness. See the online manual for details on the CONFIG-FILE http://code.google.com/p/lsyncd/wiki/Lsyncd20Manual Note that under normal configuration Lsyncd will delete pre-existing files in the target directories that are not present in the respective source directory. OPTIONS
-delay SECS Overrides the default delay times. -help Show a help message. -insist Continues startup even if a startup rsync cannot connect. -log LEVEL Controls which kind of events are logged. By default Lsyncd logs Normal and Error Messages. -log scarce will make Lsyncd log Error messages only. -log all will log all debug messages. -log Category Turns on a specific debug message. E.g. -log Exec will log all processes as they are spawned. -nodaemon Lsyncd will not detach from the invoker and log as well to stdout/err. -pidfile FILE Lsyncd will write its process ID in FILE. -runner FILE Makes the Lsyncd core load the part of Lsyncd written in Lua from FILE. -version Writes version information and exits. EXIT STATUS
0 Terminated on a TERM signal(7) -1 Failure (syntax, unrecoverable error condition, internal failure) SEE ALSO
Online Manual: http://code.google.com/p/lsyncd/wiki/Lsyncd2 VERSION
This man page is for lsyncd(1) version 2.0.5 AUTHOR
Axel Kittenberger, <axkibe@gmail.com> 2010-2011 COPYING
Copyright (C) 2010-2011 Axel Kittenberger. Free use of this software is granted under the terms of the GNU General Public License (GPL) version 2, or any later version. Free redistrubition of this Documentation (/doc directory) is granted under the terms of the Creative Commons 3.0 Attribution License (CC-3.0-BY). Lsyncd 2.0.6 August 2011 LSYNCD(1)
All times are GMT -4. The time now is 08:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy