rsync: taking advantage of files in different directory other than destination Post: 302191897

Sponsored Content

Top Forums UNIX for Advanced & Expert Users rsync: taking advantage of files in different directory other than destination Post 302191897 by rssrik on Monday 5th of May 2008 09:38:04 AM

05-05-2008

Registered User

rsync: taking advantage of files in different directory other than destination

Dear Folks,

I have to backup pgsql database dump everynight on a routine. The database dump actually contains sql(text) statements. The actual size of the database dump is aroung 800 MB. Between two days backup, only few lines of statements are modified/added/deleted.

I dont want to do incremental backup. Instead, I want everyday's full dump to be stored on to a folder named DD-MM-YY(ex: 01-05-08). Everyday there will be a folder created with name DD-MM-YY and the dump will be stored there.

Since the difference between the two day's backup are pretty minimal, I dont want to resend the 800 MB files everyday.

Suppose,

1. I have taken yesterdays dump in a folder named 04-05-08 in database server
2. I have rsynced the folder 04-05-08 to the backup server.
3. I have taken today's dump in folder named 05-05-08 in database server.
4. Now while doing rsync, I want rsync to compare the <database server's 05-05-08/dump file> with the <04-05-08/dump file> which already exists in backup server. (then eventually, I want rsync to send only the differences and store the output in folder 05-05-08).

Typicaly I want to take advantage of yesterday's file which already present in a different folder.

Can anyone suggest a working method to implement this ? (I tried --copy-dest / --compare-dest .. but couldnt get it to work)

Any response in this regard is most appreciated.

Regards,
rssrik

rssrik

View Public Profile for rssrik

Find all posts by rssrik

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

[BASH] rsync - error on destination

Hi everyone, and thanks to all for your assistance. I have a problem with the rsync command. I want to make a backup of a "source" directory in a "destination" directory. I want to specify: "absolute path of destination" (identified by a ~): ~/Destination or a "relative path of...

2. Shell Programming and Scripting

recursive searching for files in directory that matches a particular name - taking care of links

Hi, I am writing a shell script that finds all files named <myFile> in a directory <dir> or any of its subdirectories, recursively. I also need to take care of symbolic links that may form cycles, to avoid infinite loops. I started writing the code but got stuck. I thought using recursion...

3. UNIX for Advanced & Expert Users

How to rsync or tar directory trees, with hidden directory, but without files?

I want to backup all the directory tress, including hidden directories, without copying any files. find . -type d gives the perfect list. When I tried tar, it won't work for me because it tars all the files. find . -type d | xargs tar -cvf a.tar So i tried rsync. On my own test box, the...

4. Shell Programming and Scripting

Move all files from source to destination directory based on the filename

Move all files starting with a specific name to different directory. This shell script program should have three parameters File Name Source Directory Destination Directory User should be able to enter �AB_CD*' in file name parameter. In this case all the files starting with AB_CD will...

5. Shell Programming and Scripting

Rsync not deleting files on destination

I've got a rsync script that backups file from disk1 to disk3. This works great however if there are extra files on disk3 they do not get deleted by the sync. I'm syncing all folders from F-J rsync --progress -v --delete --delete-excluded -av --recursive /home/disk1/Files/*...

6. UNIX for Advanced & Expert Users

Rsync error while running from destination to source

hi All, i have 2 server setup now for Rsync, i configured Rsync on both of the server and it worked well when i did run from source to destination. and while running back from destination to source it produced this error: bash-3.2$ ksh rsync_bravo_db.ksh usa0300uz1247.apps.mc.xerox.com...

7. UNIX for Dummies Questions & Answers

Rsync not deleting destination files/folders

Hi All, I want delete all files from destination folder. I am trying below commands rsync -avFF --delete-after /home/vizion/source/ /home/vizion/destination/ I need to be delete all file/fodders from destination Any body have idea ? Please correct me.

8. UNIX for Dummies Questions & Answers

How to move gz files from one source directory to destination directory?

Hi All, Daily i am doing the house keeping in one of my server and manually moving the files which were older than 90 days and moving to destination folder. using the find command . Could you please assist me how to put the automation using the shell script . ...

9. UNIX for Advanced & Expert Users

Rsync - delete extra files in Destination without synchronising directories

I have a script that synchronises a directory to a DR server, but to improve the time, I actually use rsync to transfer files * in one batch and also * in another batch - both batches run from the same script and run in the background. My problem is that there isn't much space on the...

LEARN ABOUT DEBIAN

sequel

sequel(1)						      General Commands Manual							 sequel(1)

NAME

       sequel - The Database Toolkit for Ruby

SYNOPSIS

       sequel <uri|path> [options]

DESCRIPTION

       Sequel is a lightweight database access toolkit for Ruby.

OPTIONS

       -C, --copy-databases
	       Copy one database to another

       -d, --dump-migration
	       Print database migration to STDOUT

       -D, --dump-migration-same-db
	       Print database migration to STDOUT without type translation

       -e, --env ENV
	       Use environment config for database

       -l, --log logfile
	       Log SQL statements to log file

       -L, --load-dir DIR
	       Loads all *.rb under specified directory

       -m, --migrate-directory DIR
	       Run the migrations in directory

       -M, --migrate-version VER
	       Migrate the database to version given

       -N, --no-test-connection
	       Do not test the connection

       -t, --trace
	       Output the full backtrace if an exception is raised

       -?, -h, --help
	       Show this message

       -v, --version
	       Show version

SEE ALSO

       This  program is shipped as part of the lisequel-ruby1.8 library package, you can check its corresponding documentation can be found in the
       libsquel-ruby-doc package.

AUTHOR

       This manual page was written by Deepak Tripathi <apenguinlinux@gmail.com>, based on the command-line output of this program, for the Debian
       GNU/Linux system (but may be freely used by others).

								   May 25, 2010 							 sequel(1)