Rsync for back up, external HD


 
Thread Tools Search this Thread
Operating Systems OS X (Apple) Rsync for back up, external HD
# 1  
Old 06-20-2013
Rsync for back up, external HD

Hello all!


I am quite unsure with all options of rsync. Here my backup configuration: I am on Mac X (10.8) and want an exact copy of my HD to an external HD. I formatted the new USB drive with Mac OS extended (Journaled, Encrypted) and made in my shell the following command and got the following errors:
Code:
sudo rsync -a / /Volumes/backup_2013/
Password:
rsync: opendir "/dev/fd/3" failed: Bad file descriptor (9)
file has vanished: "/Users/mstep/Library/Saved Application State/com.apple.DiskUtility.savedState/data.data"
file has vanished: "/Users/mstep/Library/Saved Application State/com.apple.DiskUtility.savedState/window_1.data"
file has vanished: "/Users/mstep/Library/Saved Application State/com.apple.DiskUtility.savedState/window_2.data"
file has vanished: "/Users/mstep/Library/Saved Application State/com.apple.DiskUtility.savedState/windows.plist"
rsync error: some files could not be transferred (code 23) at /SourceCache/rsync/rsync-42/rsync/main.c(992) [sender=2.6.9]

I think, this is due to the fact, that I was working while this very long backup was running. And probably there were some temporary files of the format just before I run the backup ...

My questions:

1. Is this the good option (rsync -a) for the first backup?
2. Is for the following backups `rsync -a --delete HD/ backup` right?
3. Is it possible to make the backup bootable (it is password protected)?

Thank you for your hints!


marek - greetings from very hot Munich

Last edited by vbe; 06-20-2013 at 12:07 PM.. Reason: code tags...
# 2  
Old 06-21-2013
Well Marek I suppose the lack of response comes from the usage you make of rsync... designed for remote copy...
And so most of us to do what you do would use cpio (or even tar...) or dd for exact copies
As to your Q3, with rsync like that you can forget about it... but I would give a try with dd ( your external disk must be same size or bigger, only if bigger, the difference will be lost...) I cant promise anything since I only did this on scsi devices almost identical or same standards... but it be worth trying ( but will it damage your external disk??). For if it works you would have an exact copyand then you could try to boot from it, if this works, you can return to your rsync for following backups I suppose

My 2 cents...
# 3  
Old 06-21-2013
Hi.

For backup of files, I use rsnapshot, possibly in your repositories, more information at rsnapshot . It uses rsync as part of a larger organization process. I have used it for more than a year, it allows recovery of individual files, and uses hard-links to create a very compact backup, yet still "addressable" by date-time of collection. You can set up cron jobs to do hourly, daily, weekly, monthly backups from the remote gathering computer. I backup at 4-hour intervals.

For a very quick backup of everything, I often used a tar.gz file -- it quickly restores my files to updated, and newly installed systems with no trouble (although you may not want every old file).

For cloning to create a bootable image, I suggest you look at Clonezilla - About -- it will use dd as a last resort, but will first check to see if it can copy by omitting unused sectors. (I use software RAID, which causes a dd copy.)

Always experiment before you commit important data.

Best wishes ... cheers, drl
# 4  
Old 06-23-2013
Thank you vbe and del for your hints!


Sorry for answering so late. I have had to read tons of manual pages of rsync, cp, dd, cpio, tar, rsnapshot.

My question was concerning an exact backup of my HD on a USB-HD and how to do it incrementally.

@drl

Off course rsync is also a tool for external HDs not only over network.

If I am right the command I will use in future is the following to make a incremental backup - you may still prevent a catastrophe with some helpful hints:

Code:
sudo rsync -tavu --delete / /Volumes/backup_2013/

The option -t preserves modification times. -a archive mode. -v verbose. -u update (only newer files are transferred - this switch I was looking for). --delete means all files which are deleted on the source HD are deleted on the destination too. Because I asked for an exact copy of my actual HD, this is the option I was looking for.

To make the external HD bootable (MacOS Lion) I have to make some researches again ... It is for a later post. (I am not sure, whether it will possible with an encrypted HD).


marek

---------- Post updated at 03:52 PM ---------- Previous update was at 02:23 PM ----------

To make the external HD bootable (only to make this thread complete for some MacOS X users):

First try: I opened the HD Utility in the Utilities folder. I was hoping to find something like "Make Disk Bootable", but no help. I will not claim, that there is no such "button". I simply did not find it.

I have no Install MacOS X Disk Image in my Applications Folder. My idea was, to run the installer over the external HD to make it bootable. But to download this large installer file over the App Store, just to make an external HD bootable, I thought that this is overkill. So I decided to try the following and it worked:

The old version of CCC (Carbon Copy Cloner), which is now payable, is working! I just have had to run a copy of the HD over the external HD ...

I expected from this forum, to help me to find the right switches for rsync, and perhaps tell me, how to make an external HD bootable over the Shell. Disappointed!


Hope this helps somebody out there


marek
# 5  
Old 06-25-2013
Wanted to thank you for your contribution!
As I already said rsync wasnt what it was supposed to be for that is why you have so little feed back, as for rsync making something bootable, that certainly cant be done the only standard unix tool to my knowlege able to do so is dd for you will have to create a bootstrap and that no ordinary copy command can do..that is why backup utilities that are able to create bootable tapes use dd to write at the beginning of tape then pass to tar... I might give a try when I have time and a bit $$ to spend on an extra external usb disk and see what happens with dd from a MacOS at home (my laptop in my bedroom...)
# 6  
Old 06-25-2013
Quote:
Originally Posted by vbe
Well Marek I suppose the lack of response comes from the usage you make of rsync... designed for remote copy...
It can just as easily do local copy. More easily, since daemons and authentication aren't involved.

Code:
rsync dir1 dir2

# 7  
Old 06-25-2013
You could use Apple's proprietary tool asr which can clone your operating system using block copy. The version of rsync Apple supplies is horribly hack. I'm not going to get into the details. If you want to use rsync to create a clone then roll your own by downloading the latest version of rsync (3.0.9) and applying the patches fileflags, crtimes, and hfs-compression. You'll find a list of files that should be excluded from the clone at the following link- Some files and folders are automatically excluded from a backup task / Backup and archiving settings / Knowledge Base - Bombich Software Support

Finally, you need to "bless" the clone (see man bless) so it can boot.
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

2. UNIX for Dummies Questions & Answers

External HDD

I need to get an external HDD for a SUN server running Solaris 10. The Western Digital that I have will not recognize and when I went looking for drivers WD only has them for MAC and Windows. Is there a External HDD that is known to work with Unix? (24 Replies)
Discussion started by: SIFT3R
24 Replies

3. Shell Programming and Scripting

Bash script to back up with rsync

I'm trying to write a script to back up with rsync, the script I am posting below: nomServer="shiva horus isis" dirshiva="/etc /faturamento" shivaListExc="/usr/local/bin/shivaListExclRsync" dumpDir="$dumpFile/Shiva" dateBkp=`date +%A` for nServer in ${nomServer} do ... (3 Replies)
Discussion started by: ajmoreti
3 Replies

4. IP Networking

Back-to-Back Connection using HBAs

Hi every body, Is it possible to connect two servers Back-to-Back (Point-to-Point) using HBA adapters & using Fiber. Note it is direct connection & there is no switches between the servers. I'm concern about using HBA adapters, it is possible or not. Thanks in advance. :) (3 Replies)
Discussion started by: aldowsary
3 Replies

5. Shell Programming and Scripting

Rsync to an external list of URLs

I'm going to have a text file formatted something like this: some_name http://www.someurl.com/ another_name http://www.anotherurl.com/ third_name http://www.thirdurl.com/ I need to write a script that can rsync from a file path I'll set, to each URL in the list. Any ideas? (8 Replies)
Discussion started by: ibsen
8 Replies

6. AIX

back to back printing in UNIX

Hi , Can you suggest me how to back to back printing in UNIX? Is there any way? Kindly advise. Regards Vijaya Amirtha Raj (3 Replies)
Discussion started by: amirthraj_12
3 Replies

7. UNIX for Dummies Questions & Answers

rsync back?

Hi, I am in the process of developing backup script using rsync, my code is bellow: EXCLUDE_DIR="/home/kannanpg/mscdr/src/ex1" rsync -az -e ssh -v --exclude $EXCLUDE_DIR --delete $HOSTTOBACKUP:$SOURCE $DR_BACKUP_DIR/daily.0 >$tempfile 2>&1 even my exclude dir is coping.. what is wrong in... (1 Reply)
Discussion started by: redlotus72
1 Replies

8. Solaris

External USB

Is it possible to install Solaris 10 on an external USB drive? I'd like to dual boot Linux and Solaris 10. Thanks! (2 Replies)
Discussion started by: otterit
2 Replies
Login or Register to Ask a Question