Start copying large file while its still being restored from tape


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Start copying large file while its still being restored from tape
# 8  
Old 07-15-2011
I'd still recommend some way to verify the entire file made it across, like an md5 sum on both sides.

Read-behind-write is fraught with lots of chances to not get the entire file. You pretty much have to know that your entire software stack is set up properly. Even in the sleep-then-cat example, and even if the network is supposedly guaranteed to be slower than the tape, any hiccup reading the tape - or in the data path from tape to disk - could allow the cat to catch up with the file end.

Never mind what happens if you run into a restore process that sets the file length prior to actually writing out the data....
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Copying large files in a bash script stops execution

Hello, I'm new to this forum and like to first of all say hello to everyone. I've got a really annoying problem at the moment. I'm trying to rsync some files (about 200MB with one file of 120MB) from a Raspberry PI with raspbian to a debian server via rsync. This procedure is stored in a... (3 Replies)
Discussion started by: wex_storm
3 Replies

2. UNIX for Dummies Questions & Answers

Copying tape-to-tape on UNIX

I am using a 4mm tape to backup my Unix system. However, I wanted to make a copy all of the files and archive headers (or just the archive headers if that's possible) created on one of my tapes to another 4mm tape. I only have one tape drive. Is there a command that will complete such task? ... (1 Reply)
Discussion started by: acoco
1 Replies

3. Shell Programming and Scripting

Copying number by looking a large file

Hi All, I have a big file which looks like this: abc 34.32 cdf 343.45 computer 1.34 ladder 2.3422 I have some 100000 .TXT files which look like this: computer cdf align I have to open each of the text files and read the words from the text files. Then I have to look into that... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies

4. UNIX for Dummies Questions & Answers

Copying a Large File

I have a large file that I append entries to the end of every few seconds. Its grown to >150MB. Its basically a log file but a perl script is writing to it. I need to make a copy of it to a new directory. I realize the latest entries occuring while the copy is taking place will not be recorded... (1 Reply)
Discussion started by: lforum
1 Replies

5. Shell Programming and Scripting

Copying of large files fail

Hi, I have a process which duplicates files for different environments. As the files arrive, my script (korn shell) makes copies of them (giving a unique name) and then renames the original file so that my process won't get triggered again. I don't like it either, but it's what we were told to... (4 Replies)
Discussion started by: GoldenEye4ever
4 Replies

6. UNIX for Dummies Questions & Answers

Copying large file problem on SVR4 Unix

We have 3 Unix servers all running SVR4 Unix 1.4. I have no problems copying files to and from 2 of the servers using either the rcp command or ftp but when i come to transfer large files to the third server the copy gives up part way through and crashes this server. Copying smaller files using RCP... (7 Replies)
Discussion started by: coatesd
7 Replies

7. AIX

Copying to tape drive throws error

Hi All I am trying to copy files present in a partition (server 2) which is mounted to a different server (server 1) as tape drive is connected to it. I ran the below command to copy files within a partition: svr01:root:/sunfileserver> tar -cvf * a <foldername>/<filename>/<filename> a... (4 Replies)
Discussion started by: vathsan
4 Replies

8. UNIX for Dummies Questions & Answers

Writing large files to tape

I have a zipped file that is ~ 10GB. I tried tarring it off to a tape, but I receive: tar: <filename> too large to archive. Use E function modifier. The file is stored on a UFS mount, so I was unable to use ufsdump. What other options do I have? (I don't have a local file system large... (3 Replies)
Discussion started by: FredSmith
3 Replies

9. Filesystems, Disks and Memory

Strange difference in file size when copying LARGE file..

Hi, Im trying to take a database backup. one of the files is 26 GB. I am using cp -pr to create a backup copy of the database. after the copying is complete, if i do du -hrs on the folders i saw a difference of 2GB. The weird fact is that the BACKUP folder was 2 GB more than the original one! ... (1 Reply)
Discussion started by: 0ktalmagik
1 Replies

10. UNIX for Dummies Questions & Answers

copying a large filesystem

Hi there In my organisation we have a solaris network with /home being automounted from /export/home on a central file server (usual stuff) however, the guy who originally set this up only allocated 3gb to /export/home and now we are really struggling for space. I have a new 18gb disk installed... (3 Replies)
Discussion started by: hcclnoodles
3 Replies
Login or Register to Ask a Question
READ_TAPE(8)						       AFS Command Reference						      READ_TAPE(8)

NAME
read_tape - Reads volume dumps from a backup tape to a file SYNOPSIS
read_tape -tape <tape device> -restore <# of volumes to restore> -skip <# of volumes to skip> -file <filename> [-scan] [-noask] [-label] [-vheaders] [-verbose] [-help] DESCRIPTION
read_tape reads an OpenAFS backup tape and prompts for each dump file to save. This command does not require any OpenAFS infrastructure. This command does not need an OpenAFS client or server to be available, which is not the case with the backup(8) command. The dump files will be named for the Read/Write name of the volume restored. After saving each dump file, vos restore or restorevol can be used to restore the volume into AFS and non-AFS space respectively. read_tape reads the tape while skipping the specified number of volumes. After that, it restores the specified number of volumes. read_tape doesn't rewind the tape so that it may be used multiple times in succession. OPTIONS
-tape <tape device> Specifies the tape device from which to restore. -restore <# of volumes to restore> Specifies the number of volumes to restore from tape. -skip <# of volumes to skip> Specifies the number of volumes to skip before starting the restore. -file <filename> Specifies an alternate name for the restored volume dump file rather than the default of the volume name. -scan Scans the tape. -noask Doesn't prompt for each volume. -label Displays the full dump label. -vheaders Displays the full volume headers. -verbose Produces on the standard output stream a detailed trace of the command's execution. If this argument is omitted, only warnings and error messages appear. -help Prints the online help for this command. All other valid options are ignored. EXAMPLES
The following command will read the third through fifth volumes from the tape device /dev/tape without prompting: % read_tape -tape /dev/tape -skip 2 -restore 3 -noask PRIVILEGE REQUIRED
The issuer must have access to read and write to the specified tape device. SEE ALSO
backup(8), restorevol(1), vos_restore(1) COPYRIGHT
Copyright 2007 Jason Edgecombe <jason@rampaginggeek.com> This documentation is covered by the BSD License as written in the doc/LICENSE file. This man page was written by Jason Edgecombe for OpenAFS. OpenAFS 2012-03-26 READ_TAPE(8)