Sponsored Content
Top Forums Shell Programming and Scripting Best way to diff two huge directory trees Post 302224286 by danmero on Tuesday 12th of August 2008 06:55:13 PM
Old 08-12-2008
Try rsync, you can google for rsync incremental backup.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to look in directory for files with diff date

What kind of command can i use to search a directory and subdirectories for all files that do not have the same date? i want to find any files that do not match a date of Sep 13, 2002? Or that have a different owner or group? Any help appreciated! (2 Replies)
Discussion started by: kymberm
2 Replies

2. Programming

what is diff b/w near ,far and huge pointers

helo, can u tell me what is exact difference among near,far and huge pointer Amit (1 Reply)
Discussion started by: amitpansuria
1 Replies

3. UNIX for Advanced & Expert Users

How to rsync or tar directory trees, with hidden directory, but without files?

I want to backup all the directory tress, including hidden directories, without copying any files. find . -type d gives the perfect list. When I tried tar, it won't work for me because it tars all the files. find . -type d | xargs tar -cvf a.tar So i tried rsync. On my own test box, the... (4 Replies)
Discussion started by: fld2007
4 Replies

4. Shell Programming and Scripting

Diff - filename and directory name are same

Hi, I have in the one folder file and directory that have same name. I need make diff from first directory where exists file in folder FOLDER/filename and second file where not exist folder, but FOLDER is filename. I use -N switch for create new file. Scripts report: Not a directory Sample:... (2 Replies)
Discussion started by: tomix
2 Replies

5. Shell Programming and Scripting

Fine Tune - Huge files/directory - Purging

Hi Expert's, I need your assitance in tunning one script. I have a mount point where almost 4848008 files and 864739 directories are present. The script search for specific pattern files and specfic period then delete them to free up space. The script is designed to run daily and its taking around... (19 Replies)
Discussion started by: senthil.ak
19 Replies

6. Shell Programming and Scripting

Checking whether the file exists under a directory and doing a diff

Hi Everyone, I am writing a shell script for the below needs and would like your suggestions and advices. I have a lot of scripting files(Shell Scripts) under the directory: /home/risk_dev/dev I have another directory which has a lot of shell scripts under the directory: ... (2 Replies)
Discussion started by: filter
2 Replies

7. Shell Programming and Scripting

How to copy very large directory trees

I have constant trouble with XCOPY/s for multi-gigabyte transfers. I need a utility like XCOPY/S that remembers where it left off if I reboot. Is there such a utility? How about a free utility (free as in free beer)? How about an md5sum sanity check too? I posted the above query in another... (3 Replies)
Discussion started by: siegfried
3 Replies

8. Shell Programming and Scripting

ksh - Checking directory trees containing wild cards

Hi Can somebody please show me how to check from within a KSH script if a directory exists on that same host when parts of the directory tree are unknown? If these wildcard dirs were the only dirs at that level then ... RETCODE=$(ls -l /u01/app/oracle/local/*/* | grep target_dir) ... will... (4 Replies)
Discussion started by: user052009
4 Replies

9. UNIX for Beginners Questions & Answers

Need help with listing file name and modified date on a huge directory

hi, We have a huge directory that ha 5.1 Million files in it. We are trying to get the file name and modified timestamp of the most recent 3 years from this huge directory for a migration project. However, the ls command (background process) to list the file names and timestamp is running for... (2 Replies)
Discussion started by: subbu
2 Replies
MRB(8)							      System Manager's Manual							    MRB(8)

NAME
mrb - manage incremental snapshots with rsync/make. SYNOPSIS
mrb command DESCRIPTION
mrb is a simple aid to creating efficient incremental snapshots of a set, or sets, of directories whenever that may be required. It may be used as part of a regular automated backup regime, or for manually checkpointing changes at convenient points in time. COMMANDS
The following commands are recognised (where 'MODULE' is the name of one of your snapshot definitions): new-MODULE Create a skeleton definition for a new snapshot 'MODULE'. dest-MODULE Create the destination dir for 'MODULE'. This directory must exist to create a snapshot. snap-MODULE Create a snapshot of 'MODULE'. sync Create snapshots of all defined modules. If run as root this may be configured to include the modules of other users too (see MRB_SYNC_USERS in ~/.mrb/defaults). help Show mrb's own help text. CONFIGURATION FILES
Per-user configuration The following files may be used to specify global and local configuration options. /etc/default/mrb system default configuration. ~/.mrb/defaults per-user configuration. Per-user options The following options control behaviour for all of a user's modules. MRB_SNAPSHOT_LOG An optional file path where transfer details will be recorded. If unset these details will not be logged. MRB_SYNC_USERS A space separated list of users whose modules should be included in a sync. This is mostly only useful for root, as mrb will assume the identity of each user before creating snapshots of their modules. If unset, only the invoking user's modules will be sync'ed. MRB_CONFDIR An space separated list of the directories to search for module definition (*.mrc) files. They will be searched in the order given, with new modules added by default to the last one listed. There should be few reasons to change the default value. Per-module configuration The default MRB_CONFDIR value will search for module definitions in: /etc/mrb/*.mrc ~/.mrb/*.mrc Those created by new-MODULE will be placed in this latter location by default. Per-module options In each case module below is the name of the particular module that the value set should apply to. These options should be defined in a file named module.mrc. module_SRC A space separated list of the files and (top level) directories to include in the snapshots for this module. module_DEST The directory root where snapshots of module should be stored. module_INCLUDE An optional list of rsync(1) include patterns. module_EXCLUDE An optional list of rsync(1) exclude patterns. module_FILTER An optional list of rsync(1) filter patterns. module_FILTER_FILE An optional filename for rsync(1) dir-merge filtering support. module_RSYNC_OPTIONS Optional additional rsync(1) options to pass verbatim when it is invoked. module_PRECOMMAND An optional shell command to invoke just prior to creating a new snapshot. If the command does not return a successful exit status, then the snapshot creation will be aborted before it begins. It may be used to mount removable media or similar. module_POSTCOMMAND An optional shell command to execute after making the snapshot. It will not be called if the snaphot creation failed at an earlier stage, and its return status may halt a sync operation if it fails with more modules still to process. It may be used, for example, to unmount removable media again. module_USER An optional user name to check that mrb is running as before performing a snapshot. This can be used to ensure you have the correct permisson to access the files being mirrored before you get too far. SEE ALSO
rsync(1), make(1). AUTHOR
mrb was written by Ron <ron@debian.org>. May 9, 2006 MRB(8)
All times are GMT -4. The time now is 08:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy