04-14-2008
Quote:
Originally Posted by
vijaykrc
Thank you for the help...
I may be moving around 5000 files and i cannot tar them... i need to send individually...
I am benefiting around 3 hrs if i send then at a time using the * and if i send then individually its taking that 3-4 hrs more for the 5000 files.
The way I would approach this if the contents of the source directory were likely to change while the copy process is running is to create a shell function to copy one individual file and then to delete it if the copy was successful. I would then start the process by creating a list of all the current files, passing them one by one to the function. This will ensure that only files that were copied correctly get deleted. I know that this will take extra time and resources as each individual file will require a new connection to be set up, but it is, in my opinion the safest way. Of course you will need to set up key authorisation rather than password auth as that would be tedious in the extreme for 5000 files.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I need to transfer multiple files using SCP between two solaris machines. Can somebody explain how to achieve that ? (3 Replies)
Discussion started by: parthum
3 Replies
2. Shell Programming and Scripting
Hi Frdz
I have a problem like.
I need to transfer a file from source to destination (different systems with different IPs) using "scp" command and before transfer the file i have to check the file is available in destination or not, if it is there no need to transfer, otherwise we have to... (5 Replies)
Discussion started by: KiranKumarKarre
5 Replies
3. UNIX for Dummies Questions & Answers
I have a shell script which uses SCP command to transfer the files from one server to another server. The files are getting transferred successfully, but the problem is the files transferred to the destination server didnot have the permissions as that of the files on the source server.
Command... (5 Replies)
Discussion started by: kumarm
5 Replies
4. UNIX for Advanced & Expert Users
I am not able to throw a file from server173 to server067
i.e.
wlsuser@server173> scp /tmp/harsha.txt wlsuser@server067:/tmp
fails
However, I am able to pull a file from server173 onto server067's /tmp dir
wlsuser@server067> scp wlsuser@server173:/tmp/harsha.txt /tmp... (2 Replies)
Discussion started by: shifahim
2 Replies
5. UNIX for Advanced & Expert Users
Whenever I transfer file through SCP between two server it gives below given message.....Is there a way to avoid it....
Target server : newyork
$ scp ABC27801.iue newyork:./iABC/x0017801.iue
Message
=====
This system is for the use of authorized users only. Individuals using this... (1 Reply)
Discussion started by: Pash
1 Replies
6. UNIX for Advanced & Expert Users
I have 3 AIX server namely - Server 1 , Server 2 and Server 3.
And have done SCP setup between Server 1 and Server 2 so that i dont have to give password when i transfer file from Server 1 to Server 2 by setting public key between the server.
Q1. If the unix password of the target server... (3 Replies)
Discussion started by: Pash
3 Replies
7. UNIX for Advanced & Expert Users
On unix AIX server, when I am trying to transfer file from one directory to another directory on the same server through a program(where i call the script) it gives error "Lost Connection". (5 Replies)
Discussion started by: Pash
5 Replies
8. AIX
I am testing the following command to transfer a file from my server (AIX 5.2) to another server. I was able to generate the keys and sent them the public key.
scp -v -P 4030 /home/lawson/.ssh/jimtest.txt someuser@some.ftpsite.net:/Inbound/jimtest.txt > jimtest_out.txt 2>&1
Based on... (3 Replies)
Discussion started by: jyoung
3 Replies
9. Shell Programming and Scripting
I am trying to transfer a zip file of around 30 MB in my automation script using scp from system A to B.
When I manually do scp, file is complete transferred but when automation shell script runs it, zip file is not completely transferred.
Stack Trace while doing manual :
Executing:... (1 Reply)
Discussion started by: Shaishav Shah
1 Replies
10. UNIX for Beginners Questions & Answers
Hi All,
Need some help regarding file transfer between server.
Suppose we have system-A and system-B. To transfer file from system-A to system-B we usually share the
public keys of system-A to system-B and do scp/sftp to transfer a file.
Is it possible that public key of system-B can be... (3 Replies)
Discussion started by: abhi_123
3 Replies
uuto(1) General Commands Manual uuto(1)
NAME
uuto, uupick - public UNIX system to UNIX system file copy
SYNOPSIS
[options] source-files destination
system]
DESCRIPTION
sends source-files to destination. uses the facility to send files (see uucp(1)), while allowing the local system to control the file
access. A source-file name is a path name on your machine. Destination has the form:
where system is taken from a list of system names that knows about (see in uucp(1) manual entry). user is the login name of someone on the
specified system.
recognizes the following options:
Copy the source file into the spool directory immediately,
and send the copy.
Send mail to the requester when the copy is complete.
The files (or sub-trees if directories are specified) are sent to PUBDIR on system, where PUBDIR is the UUCP public directory Specifically
the files are sent to
PUBDIR
The recipient is notified by electronic mail when the files arrive.
accepts or rejects the files transmitted to the recipient. Specifically, searches PUBDIR for files destined for the user. For each entry
(file or directory) found, the following message is printed on the standard output:
file-name] dirname]
then reads a line from the standard input to determine the disposition of the file:
<new-line> Go on to next entry.
Delete the entry.
Move the entry to named directory
dir (current directory is default). Note that, if the current working directory is desired for dir, do specify any
parameter with A construction such as is erroneous, and results in loss of data.
Same as except move all the files sent from system.
Print the contents of the file.
Stop.
EOT (control-D) Same as
Escape to the shell to execute
command.
Print a command summary.
invoked with the option searches only the PUBDIR for files sent from system.
WARNINGS
To send files that begin with a dot (such as the filename must contain a corresponding dot. For example: and are correct, whereas and are
incorrect.
FILES
PUBDIR public directory
SEE ALSO
mail(1), uuclean(1M), uucp(1), uustat(1), uux(1).
Tim O'Reilly and Grace Todino,
O'Reilly & Associates, Inc. USA.
Grace Todino and Dale Dougherty,
O'Reilly & Associates, Inc. USA.
STANDARDS CONFORMANCE
uuto(1)