Sponsored Content
Operating Systems Linux Red Hat Difference in file sizes being copied by scp. HELP! Post 302653387 by methyl on Friday 8th of June 2012 05:57:09 PM
Old 06-08-2012
No problem with running such a copy as root. We need the root ulimit for this size of file transfer.

Hmm. 10 hours to copy 15 Gb suggests something like a 4 Mbits/sec leased line rather than say a Gigabit local LAN connection. Maintaining a 100% reliable WAN connection across a leased line for 10 hours is a dream. The rsync command across a slow link is a lot better at dealing with network glitches than scp .

Have you considered a local (relatively quick) backup followed by a slow secondary backup of that backup to the remote site utilising rsync?
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to find File copied completely or else ...

In Unix, I am having one file getting copied to some directory. Which command will help me ensure, that file is not completely copied to the disk? (2 Replies)
Discussion started by: videsh77
2 Replies

2. Shell Programming and Scripting

How to check file is being copied

I wanna check whether a file is being copied ,i.e the file size is increasing. Thanks for your help (2 Replies)
Discussion started by: anhkeen
2 Replies

3. UNIX for Dummies Questions & Answers

Can A File Be Copied to an RS232 Port on Unix?

We have a text/csv file (4mb) sitting on a Unix box. The PC belongs to a retail store and they're asking me to bring the file over to Windows so they can import the file. Can a file be copied to an rs232 port? If so how? The idea is that I'll hook up a null modem cable to the Unix com port,... (2 Replies)
Discussion started by: alivebyscience
2 Replies

4. Solaris

Check copied file

Hi all, If i wanted to copy file within different folders or different servers, how do i determine the copied file is absolutely correct :confused: Is it using cmp and chksum command enough? Anyway that i can make further checking? Thanks in advance for reading & anyone who reply the... (7 Replies)
Discussion started by: beginningDBA
7 Replies

5. UNIX for Dummies Questions & Answers

Using sudo scp -r – can't get everything copied though

I want to copy a folder and all its contents of ~700GB from a computer to another. I've tried sudo scp -r directory/ admin@host:directory but the result is that the copied folder is about 2GBs smaller than the original. I checked the shell for errors and found some "file doesn't exist" errors.... (2 Replies)
Discussion started by: MJH
2 Replies

6. Shell Programming and Scripting

Extract a number from a line in a file and sed in another copied file

Dear all, I am trying to extract a number from a line in one file (task 1), duplicate another file (task 2) and replace all instances of the strings 300, in duplicated with the extracted number (task 3). Here is what I have tried so far: for ((k=1;k<4;k++)); do temp=`sed -n "${k}p"... (2 Replies)
Discussion started by: mnaqvi
2 Replies

7. Shell Programming and Scripting

no of files copied by scp command

hi, I have a script which copy files by using scp command. when i run that script, i can see the process meter but I want to know how many files have been copied. suppose, by using scp 10 files is being copied and I can see process meter for all 10 files. but i also want to see ... that 10... (0 Replies)
Discussion started by: anshu ranjan
0 Replies

8. Linux

Difference in binary file sizes after deploying package via yum/rpm

Hi Guys, I have an issue whereby I package up an rpm and when I deploy it, the binary filesizes differ from what I packaged up from the SOURCE directory. from source - -rwxrwxr-x 1 user group 685156 Sep 26 15:50 cybAgent.bin after install - -rwxr-xr-x 1 user group 683388 Oct 16 11:10... (4 Replies)
Discussion started by: gazza-o
4 Replies

9. Shell Programming and Scripting

Wait for file to get copied in server path and then proceed

Hi, I have a requirement to create below script: Script must run infinitely in background. It will check a particular type of file to be copied in specific folder of server Script must wait till any file gets fully copied ..(important) and then It will read that file Experts please... (4 Replies)
Discussion started by: Vikash163
4 Replies

10. UNIX for Dummies Questions & Answers

Cp via NFS vs. scp yields unexpected difference

I have two Linux machines, Linux1 and Linux2. They both have two NFS mounts. We'll call them /scratch1 and /scratch2. And they both reside on the same NetApp filer. If I copy a 512Mb file from /scratch1 to /scratch2 while logged on Linux1 it takes 40s. However if I scp this file from... (1 Reply)
Discussion started by: crimso
1 Replies
BACKUP-MANAGER-UPLOAD(8)				       backup-manager-upload					  BACKUP-MANAGER-UPLOAD(8)

NAME
backup-manager-upload - Multiprotocol uploader for backup-manager. SYNOPSIS
backup-manager-upload [options] date DESCRIPTION
backup-manager-upload will upload all the archives generated on the given date to the specified host with either ftp or scp. It's also possible to use this program for uploading data to an Amazon S3 account. Some metadates are available like "today" or "yesterday". REQUIRED ARGS
--mode=transfer-mode Select the transfer mode to use : ftp, scp, or s3. --host=hostname1,hostname2,...,hostnameN Select a list of remote hosts to connect to. --user=username Select the user to use for connection. OPTIONAL ARGS
--password=password Select the ftp user's password (only needed for ftp transfers). --key=path_to_private_key Select the ssh private key file to use when opening the ssh session for scp transfer. Obviously, this is only needed for scp transfer mode. If you don't specify a key file, the user's default private key will be used. --directory=directory Select the location on the remote host where files will be uploaded. Default is /backup/uploads. --bucket=bucket Sets the bucket name for the Amazon S3 service backup into. --root=directory Select the local directory where files are. Default is /var/archives --gpg-recipient=gpg-recipient Select the gpg public key for encryptiong the archives when uploading with the method ssh-gpg. This can be a short or long key id or a descriptive name. The precise syntax is described in the gpg man page. --list Just list the files to upload. --ftp-purge Purge the remote directory before uploading files in FTP mode. --s3-purge Purge the remote directory before uploading files in FTP mode. --ssh-purge Purge the remote directory before uploading files in SSH mode. --verbose Flag to enable verbose mode. date Date pattern to select some files to upload, can be a valid date (YYYYMMDD) or 'today' or 'yesterday'. ERROR CODES
If something goes wrong during an upload, backup-manager-upload will exit with a non null value. In such a case every error messages are sent to STDERR. Here are the possible error codes: bad command line (wrong arguments) : 10 FTP transfer failure : 20 SCP transfer failure : 21 S3 transfer failure : 22 Unknown upload method: 23 SEE ALSO
backup-manager(3) AUTHORS
Alexis Sukrieh - main code and design Brad Dixon - Amazon S3 upload method Jan Metzger - ssh-gpg upload method perl v5.14.2 2012-05-09 BACKUP-MANAGER-UPLOAD(8)
All times are GMT -4. The time now is 11:08 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy