rsync copy files once


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting rsync copy files once
# 1  
Old 10-13-2011
rsync copy files once

Hi
This is my situation

I have files on the left which I want to copy to the right. Once the files are copied to the right, they are processed and then deleted. The next time rsync runs I dont want it to copy the same files again, it should only copy any new files to the right.

I have been googleing around for ages and cant seem to find any solution to this.
# 2  
Old 10-13-2011
Why don't you use the "right" directory as the hold forever directory?

In other words:

1) Files arrive in the "left" directory.
2) Files are processed in the "left" directory.
3) After being processed, they are moved to the "right" directory and deleted from the "left" directory.
# 3  
Old 10-13-2011
unfortunately I am unable to delete files on the left.

When the files are copied over they are processed and sent into a database. If the files on the right are not deleted then they will just get processed again.
so I need to delete the files and then only copy over new files from the left.
# 4  
Old 10-13-2011
You'll have to keep a list of files that have been copied and feed them into rsync with --exclude-from=FILENAME.

this is kind of subverting rsync's purpose, though. It's supposed to synchronize two directories. It may not be the right tool for the job. Do you have ssh access?
# 5  
Old 10-13-2011
Both directories are on the same system. The left directory is a cifs mount from another server and the right is just a local drive.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Copy local files to single remote host but multiple folders using rsync

I'm trying to copy a file myfile.scr from my local Linux server to multiple folders on remote AiX server using single rsync command. Below command helps me copy the file "myfile.scr" from my localhost to a remote host folder "/app/deployment/tmpfiles" rsync --delay-updates -F --compress... (1 Reply)
Discussion started by: mohtashims
1 Replies

2. Ubuntu

Rsync - not copy certain files

I use this rsync --progress -r -u /media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/* /home/andy/Ubuntu_18.04_Programs/Is there a way to have it not copy files such as these? 2019-02-25_11:04 I found this but can not figure out what it's doing. 3. Exclude a specific file To exclude a... (5 Replies)
Discussion started by: drew77
5 Replies

3. Shell Programming and Scripting

Rsync - how to copy hidden folder or hidden files when using full path

Hello. I use this command : rsync -av --include=".*" --dry-run "$A_FULL_PATH_S" "$A_FULL_PATH_D"The data comes from the output of a find command. And no full source directories are in use, only some files. Source example... (2 Replies)
Discussion started by: jcdole
2 Replies

4. UNIX for Beginners Questions & Answers

Rsync added new folders after copy?

Hi guys, Don't really know much about unix or anything, just starting to mess around a little bit to have more understanding in general. So, I tried using rsync to copy my macbook pro backup/clone from an external drive I have to another external drive. I ended up using... "sudo rsync -a... (1 Reply)
Discussion started by: cbjeebs
1 Replies

5. Shell Programming and Scripting

Rsync to copy specific subfolders and files to new directory

RootFolderI: RootFolderI/FolderA/Subfolder1/Subsub1/JPG1.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/Subsub1/JPG2.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/Subsub2/JPG3.jpg . . . RootFolderI/FolderB/Subfolder1/Subsub1/JPG4.jpg -> want this jpg ... (1 Reply)
Discussion started by: blocnt
1 Replies

6. SCO

Rsync sometimes fails to copy

Hello I tried rsync (version 3.0.7) on OpenServer 5.0.7. Compile the version of samba.org and use of aljex.com. Both versions do not work reliably, sometimes show errors and stop copying (sometimes works) The OSR5.0.7 I'm using VirtualBox, I do not think the problem is in virtualization, but... (0 Replies)
Discussion started by: flako
0 Replies

7. UNIX for Dummies Questions & Answers

Rsync copy files if dont exist

I have a setup where I have two drives. TV TVbackup For what ever reason, I have a lot of content on my TVbackup drive which isn't on my TV drive. I want to copy all the files across which are on TVbackup but are not currently on TV. If there is a file with the same name but a... (2 Replies)
Discussion started by: Spadez
2 Replies

8. UNIX for Advanced & Expert Users

Using remote rsync, but copy locally?

I'm looking to use rsync to compare remote files and to copy the diff to a local directory, rather than transfer over the net. The net connection is not fast enough to transfer these files (~1.8TB) and I'd like to sneakernet them instead. Possible? (4 Replies)
Discussion started by: dfbills
4 Replies

9. Solaris

Using RSYNC to copy files locally

Has anyone ever used rsync to copy files locally on one server? (in this case from one SAN volume to another). I am familiar with using rsync to copy files between servers, but not locally, I would usually use cp or or tar or something. Is rsync slower? Does it use additional overhead of the... (4 Replies)
Discussion started by: BG_JrAdmin
4 Replies
Login or Register to Ask a Question