06-08-2012
No problem with running such a copy as root. We need the root ulimit for this size of file transfer.
Hmm. 10 hours to copy 15 Gb suggests something like a 4 Mbits/sec leased line rather than say a Gigabit local LAN connection. Maintaining a 100% reliable WAN connection across a leased line for 10 hours is a dream. The rsync command across a slow link is a lot better at dealing with network glitches than scp .
Have you considered a local (relatively quick) backup followed by a slow secondary backup of that backup to the remote site utilising rsync?
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
In Unix, I am having one file getting copied to some directory. Which command will help me ensure, that file is not completely copied to the disk? (2 Replies)
Discussion started by: videsh77
2 Replies
2. Shell Programming and Scripting
I wanna check whether a file is being copied ,i.e the file size is increasing.
Thanks for your help (2 Replies)
Discussion started by: anhkeen
2 Replies
3. UNIX for Dummies Questions & Answers
We have a text/csv file (4mb) sitting on a Unix box. The PC belongs to a retail store and they're asking me to bring the file over to Windows so they can import the file.
Can a file be copied to an rs232 port? If so how? The idea is that I'll hook up a null modem cable to the Unix com port,... (2 Replies)
Discussion started by: alivebyscience
2 Replies
4. Solaris
Hi all,
If i wanted to copy file within different folders or different servers, how do i determine the copied file is absolutely correct :confused:
Is it using cmp and chksum command enough?
Anyway that i can make further checking?
Thanks in advance for reading & anyone who reply the... (7 Replies)
Discussion started by: beginningDBA
7 Replies
5. UNIX for Dummies Questions & Answers
I want to copy a folder and all its contents of ~700GB from a computer to another. I've tried sudo scp -r directory/ admin@host:directory but the result is that the copied folder is about 2GBs smaller than the original.
I checked the shell for errors and found some "file doesn't exist" errors.... (2 Replies)
Discussion started by: MJH
2 Replies
6. Shell Programming and Scripting
Dear all,
I am trying to extract a number from a line in one file (task 1), duplicate another file (task 2) and replace all instances of the strings 300, in duplicated with the extracted number (task 3). Here is what I have tried so far:
for ((k=1;k<4;k++)); do
temp=`sed -n "${k}p"... (2 Replies)
Discussion started by: mnaqvi
2 Replies
7. Shell Programming and Scripting
hi,
I have a script which copy files by using scp command. when i run that script, i can see the process meter but I want to know how many files have been copied.
suppose, by using scp 10 files is being copied and I can see process meter for all 10 files. but i also want to see ... that 10... (0 Replies)
Discussion started by: anshu ranjan
0 Replies
8. Linux
Hi Guys,
I have an issue whereby I package up an rpm and when I deploy it, the binary filesizes differ from what I packaged up from the SOURCE directory.
from source - -rwxrwxr-x 1 user group 685156 Sep 26 15:50 cybAgent.bin
after install - -rwxr-xr-x 1 user group 683388 Oct 16 11:10... (4 Replies)
Discussion started by: gazza-o
4 Replies
9. Shell Programming and Scripting
Hi,
I have a requirement to create below script:
Script must run infinitely in background.
It will check a particular type of file to be copied in specific folder of server
Script must wait till any file gets fully copied ..(important) and then
It will read that file
Experts please... (4 Replies)
Discussion started by: Vikash163
4 Replies
10. UNIX for Dummies Questions & Answers
I have two Linux machines, Linux1 and Linux2. They both have two NFS mounts. We'll call them /scratch1 and /scratch2. And they both reside on the same NetApp filer. If I copy a 512Mb file from /scratch1 to /scratch2 while logged on Linux1 it takes 40s. However if I scp this file from... (1 Reply)
Discussion started by: crimso
1 Replies
LEARN ABOUT DEBIAN
backup-manager-upload
BACKUP-MANAGER-UPLOAD(8) backup-manager-upload BACKUP-MANAGER-UPLOAD(8)
NAME
backup-manager-upload - Multiprotocol uploader for backup-manager.
SYNOPSIS
backup-manager-upload [options] date
DESCRIPTION
backup-manager-upload will upload all the archives generated on the given date to the specified host with either ftp or scp. It's also
possible to use this program for uploading data to an Amazon S3 account. Some metadates are available like "today" or "yesterday".
REQUIRED ARGS
--mode=transfer-mode
Select the transfer mode to use : ftp, scp, or s3.
--host=hostname1,hostname2,...,hostnameN
Select a list of remote hosts to connect to.
--user=username
Select the user to use for connection.
OPTIONAL ARGS
--password=password
Select the ftp user's password (only needed for ftp transfers).
--key=path_to_private_key
Select the ssh private key file to use when opening the ssh session for scp transfer. Obviously, this is only needed for scp transfer
mode. If you don't specify a key file, the user's default private key will be used.
--directory=directory
Select the location on the remote host where files will be uploaded. Default is /backup/uploads.
--bucket=bucket
Sets the bucket name for the Amazon S3 service backup into.
--root=directory
Select the local directory where files are. Default is /var/archives
--gpg-recipient=gpg-recipient
Select the gpg public key for encryptiong the archives when uploading with the method ssh-gpg. This can be a short or long key id or a
descriptive name. The precise syntax is described in the gpg man page.
--list
Just list the files to upload.
--ftp-purge
Purge the remote directory before uploading files in FTP mode.
--s3-purge
Purge the remote directory before uploading files in FTP mode.
--ssh-purge
Purge the remote directory before uploading files in SSH mode.
--verbose
Flag to enable verbose mode.
date
Date pattern to select some files to upload, can be a valid date (YYYYMMDD) or 'today' or 'yesterday'.
ERROR CODES
If something goes wrong during an upload, backup-manager-upload will exit with a non null value. In such a case every error messages are
sent to STDERR.
Here are the possible error codes:
bad command line (wrong arguments) : 10
FTP transfer failure : 20
SCP transfer failure : 21
S3 transfer failure : 22
Unknown upload method: 23
SEE ALSO
backup-manager(3)
AUTHORS
Alexis Sukrieh - main code and design
Brad Dixon - Amazon S3 upload method
Jan Metzger - ssh-gpg upload method
perl v5.14.2 2012-05-09 BACKUP-MANAGER-UPLOAD(8)