Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Best unix incremental backup utility? Post 302314400 by choogendyk on Friday 8th of May 2009 08:04:07 AM
Old 05-08-2009
Quote:
Originally Posted by nottrobin
Could someone let me know what is the best Unix program for this purpose?
This is going to be open to a lot of opinion. But it also depends on more detailed information about your environment and needs. It's not clear from your message whether you are talking about a single system that needs backing up or a network of systems. It can also be affected by the type and flow of work, the volume of data, the frequency of data change, and so on. And there are questions about how paranoid you are about losing the data, how much replication of backup you want, how fast you need recoveries to be, whether it should be off site....

If you want to explore and learn, check out Curtis Preston's book "Backup and Recovery" published by O'Reilly -- Backup & Recovery | O'Reilly Media, or the companion web site that takes off from there -- Backup Central - Home.

Depending on your needs, my recommendation might be to look at rsync for simple regular replication of a single directory or machine, backuppc for multiple system deduplication, or Amanda for a general network backup program with a lot of options and flexibility.

rsync

BackupPC: Open Source Backup to disk

Amanda Open Source Backup
Main Page - The Open Source Backup Wiki (Amanda, MySQL Backup, BackupPC)
Quick start - The Open Source Backup Wiki (Amanda, MySQL Backup, BackupPC)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to reinvent incremental backup in bash?

I want to backup two important files everytime they are modified. How would I write a bash script that would check the dates of my zip files and my data files and only create a new zip file if the zip file is older than the two data files? Thanks, Siegfried (1 Reply)
Discussion started by: siegfried
1 Replies

2. Shell Programming and Scripting

tar - incremental backup

Hello everyone! I'm trying to make incremental tar archives of a folder for an example. On the box I use is UNIX AIX installed. I tried some sample codes I found on several web pages but with no success. Don't know what I'm doing wrong. Please write some sample code to make incremental tar... (0 Replies)
Discussion started by: Funky_ass
0 Replies

3. UNIX for Dummies Questions & Answers

incremental backup

Hi All.. i am trying to write a script which will give the incremental tar backup of all files with latest timestam. i tried with find -mmin -2 but if it takes half on hour or something to creat the tar itself, then no meaning in using the above command. so please help me to find the... (2 Replies)
Discussion started by: Usha Shastri
2 Replies

4. Shell Programming and Scripting

[bash] Simple backup (cp) script but incremental

Hi all, I would need a rather simple bash backup script that loops throught the (local) users and for each users backs up (cp!) its /home/username folder. About the functionalities: The script has to run every 2 hours (that's cron, so don't mind about that) and the files should be copied to... (12 Replies)
Discussion started by: laurens
12 Replies

5. Shell Programming and Scripting

Incremental backup

Hi, I would like to create a daily incremental backup of a directory with all of the files within and add a timestamp (year-month-day) to the tar.gz file. I have the following, but it doesn't backup the inside files of the directory. #!/bin/bash tar -czf... (1 Reply)
Discussion started by: agasamapetilon
1 Replies

6. Windows & DOS: Issues & Discussions

Incremental Backup

I have a folder /root/test in a centos 5.3 system. I want to take an incremental backup of the contents of the folder in the C:\Downloads folder of a windows system present in the same lan as the linux system. What are the ways of executing this plan? Kindly help (0 Replies)
Discussion started by: proactiveaditya
0 Replies

7. UNIX for Advanced & Expert Users

Do incremental backup without tar files up

I'm trying to do a incremental backup for a big NFS. Since space is not an issue, I don't want to compress them or end up with a big tarball for full backup( and a series of small tarballs for incremental backup). Basically I want the TAR backup/restore functionality but not TAR files up.... (3 Replies)
Discussion started by: overmindxp
3 Replies

8. UNIX for Dummies Questions & Answers

incremental and full backup.. please help me

Hi, i'm new here(and a newbie) and i need some help with a project. I need to write a script for an incremental backup (this must be executed every day at 24:00) and a full backup (executed once a month) for etc/var/home directories. Can someone please help me with this? And a small explanation of... (9 Replies)
Discussion started by: bender-alex
9 Replies

9. Homework & Coursework Questions

incremental or full backup ???

Hi. Can someone tell me if the following script that i have made is a script for INCREMENTAL BACKUP or FULL BACKUP. My teacher told me that is doing an FULL BACKUP. • find /etc /var /home -newer /backups/.backup_reference > /backups/.files_to_archive • touch /backups/.backup_reference • tar... (1 Reply)
Discussion started by: bender-alex
1 Replies

10. Shell Programming and Scripting

Incremental Backup using tar for more than one path

Hi everyone; I need to create a shell script for full and incremental backup purposes. for incremental backup only for one folder (test1) located in /home/test1 syntax below works fine and have no problem: tar -cvf /home/backup/backup-0.tar.gz -g /home/test1/test.snar /home/test Problem is here... (5 Replies)
Discussion started by: momed131
5 Replies
DUMP(8) 						    BSD System Manager's Manual 						   DUMP(8)

NAME
dump -- filesystem backup SYNOPSIS
dump [-0123456789cnu] [-B records] [-b blocksize] [-d density] [-f file] [-h level] [-s feet] [-T date] filesystem dump [-W | -w] (The 4.3BSD option syntax is implemented for backward compatibility, but is not documented here.) DESCRIPTION
Dump examines files on a filesystem and determines which files need to be backed up. These files are copied to the given disk, tape or other storage medium for safe keeping (see the -f option below for doing remote backups). A dump that is larger than the output medium is broken into multiple volumes. On most media the size is determined by writing until an end-of-media indication is returned. On media that cannot reliably return an end-of-media indication (such as some cartridge tape drives) each volume is of a fixed size; the actual size is determined by the tape size and density and/or block count options below. By default, the same output file name is used for each volume after prompting the operator to change media. The following options are supported by dump: -0-9 Dump levels. A level 0, full backup, guarantees the entire file system is copied (but see also the -h option below). A level number above 0, incremental backup, tells dump to copy all files new or modified since the last dump of the same or lower level. The default level is 9. -B records The number of dump records per volume. This option overrides the calculation of tape size based on length and density. -b blocksize The number of kilobytes per dump record. -c Modify the calculation of the default density and tape size to be more appropriate for cartridge tapes. -d density Set tape density to density. The default is 1600BPI. -f file Write the backup to file; file may be a special device file like /dev/rmt12 (a tape drive), /dev/rdisk1s3 (a disk drive), an ordinary file, or '-' (the standard output). Multiple file names may be given as a single argument separated by commas. Each file will be used for one dump volume in the order listed; if the dump requires more volumes than the number of names given, the last file name will used for all remaining volumes after prompting for media changes. If the name of the file is of the form ``host:file'', or ``user@host:file'', dump writes to the named file on the remote host using rmt(8). -h level Honor the user ``nodump'' flag only for dumps at or above the given level. The default honor level is 1, so that incremental backups omit such files but full backups retain them. -n Whenever dump requires operator attention, notify all operators in the group ``operator'' by means similar to a wall(1). -s feet Attempt to calculate the amount of tape needed at a particular density. If this amount is exceeded, dump prompts for a new tape. It is recommended to be a bit conservative on this option. The default tape length is 2300 feet. -T date Use the specified date as the starting time for the dump instead of the time determined from looking in /etc/dumpdates. The format of date is the same as that of ctime(3). This option is useful for automated dump scripts that wish to dump over a specific period of time. The -T option is mutually exclusive from the -u option. -u Update the file /etc/dumpdates after a successful dump. The format of /etc/dumpdates is readable by people, consisting of one free format record per line: filesystem name, increment level and ctime(3) format dump date. There may be only one entry per filesystem at each level. The file /etc/dumpdates may be edited to change any of the fields, if necessary. -W Dump tells the operator what file systems need to be dumped. This information is gleaned from the files /etc/dumpdates and /etc/fstab. The -W option causes dump to print out, for each file system in /etc/dumpdates the most recent dump date and level, and highlights those file systems that should be dumped. If the -W option is set, all other options are ignored, and dump exits immedi- ately. -w Is like W, but prints only those filesystems which need to be dumped. Dump requires operator intervention on these conditions: end of tape, end of dump, tape write error, tape open error or disk read error (if there are more than a threshold of 32). In addition to alerting all operators implied by the -n key, dump interacts with the operator on dump's control terminal at times when dump can no longer proceed, or if something is grossly wrong. All questions dump poses must be answered by typing ``yes'' or ``no'', appropriately. Since making a dump involves a lot of time and effort for full dumps, dump checkpoints itself at the start of each tape volume. If writing that volume fails for some reason, dump will, with operator permission, restart itself from the checkpoint after the old tape has been rewound and removed, and a new tape has been mounted. Dump tells the operator what is going on at periodic intervals, including usually low estimates of the number of blocks to write, the number of tapes it will take, the time to completion, and the time to the tape change. The output is verbose, so that others know that the terminal controlling dump is busy, and will be for some time. In the event of a catastrophic disk event, the time required to restore all the necessary backup tapes or files to disk can be kept to a min- imum by staggering the incremental dumps. An efficient method of staggering incremental dumps to minimize the number of tapes follows: o Always start with a level 0 backup, for example: /sbin/dump -0u -f /dev/nrst1 /usr/src This should be done at set intervals, say once a month or once every two months, and on a set of fresh tapes that is saved forever. o After a level 0, dumps of active file systems are taken on a daily basis, using a modified Tower of Hanoi algorithm, with this sequence of dump levels: 3 2 5 4 7 6 9 8 9 9 ... For the daily dumps, it should be possible to use a fixed number of tapes for each day, used on a weekly basis. Each week, a level 1 dump is taken, and the daily Hanoi sequence repeats beginning with 3. For weekly dumps, another fixed set of tapes per dumped file system is used, also on a cyclical basis. After several months or so, the daily and weekly tapes should get rotated out of the dump cycle and fresh tapes brought in. FILES
/dev/rmt8 default tape unit to dump to /etc/dumpdates dump date records /etc/fstab dump table: file systems and frequency /etc/group to find group operator SEE ALSO
restore(8), rmt(8), dump(5), fstab(5) DIAGNOSTICS
Many, and verbose. Dump exits with zero status on success. Startup errors are indicated with an exit code of 1; abnormal termination is indicated with an exit code of 3. BUGS
Fewer than 32 read errors on the filesystem are ignored. Each reel requires a new process, so parent processes for reels already written just hang around until the entire tape is written. Dump with the -W or -w options does not report filesystems that have never been recorded in /etc/dumpdates, even if listed in /etc/fstab. It would be nice if dump knew about the dump sequence, kept track of the tapes scribbled on, told the operator which tape to mount when, and provided more assistance for the operator running restore. HISTORY
A dump command appeared in Version 6 AT&T UNIX. 4th Berkeley Distribution May 1, 1995 4th Berkeley Distribution
All times are GMT -4. The time now is 06:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy