08-18-2011
Quote:
Originally Posted by
Naga06
I have a requirement to ftp a 220GB backup file to a remote backup server.
I wrote a script for this purpose.
But it takes more than 8 hours to transfer this file.
Is there any other method to do it in less time???
If there was a special 'go faster' data transfer method, most things would be using it already.
The main risk of corruption in transferring something that huge is network blips and timeouts, which can be reduced by reducing the size of what you're sending. In that regard, compression may
reduce your risks of corruption.
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
how to compare file size which has been received through ftp get from a remote location with local copy available any clue
regards (5 Replies)
Discussion started by: sathiya
5 Replies
2. UNIX for Dummies Questions & Answers
I have an ftp process which runs every 10 minutes between Unix and an NT box.
Normally it works, but when the script tries to get a file from NT that has a length of 0, the ftp process hangs (as if it is still waiting for the end of the file).
This is the script... (3 Replies)
Discussion started by: mheinrich
3 Replies
3. Shell Programming and Scripting
Is possible if I want to campare file size on source and destination after ftp transfer?
If anybody know, please explain to me. (1 Reply)
Discussion started by: icemania
1 Replies
4. UNIX for Advanced & Expert Users
Hello,
I am using IXOS 3rd party utility to maintain invoices (images) in my client's SAP system. We have a DR (Disaster Recovery) setup & for that I need to synchronize my /ixos filesystem (with size more than 50 GB) between two servers say x182 & x050.
Initially I thought to tar the... (4 Replies)
Discussion started by: vishal_ranjan
4 Replies
5. Shell Programming and Scripting
Hi
I am doing a FTP process through which I am copying a file from my local server to Remote server. After this I want to check the size of the file
Below is my program:
LOCALDIR=/batch/ediprocess
REMOTESERVER=test.appl.com
REMOTEPATH=batch/ftpTest
LOGIN=px
PASSWORD=abcd
ftp -n... (3 Replies)
Discussion started by: shanth_chandra
3 Replies
6. Shell Programming and Scripting
I have file which contains around 5000 lines.
The lines are fixed legth but having no delimiter.Each line line contains nearly 3000 characters.
I want to delete the lines
a> if it starts with 1 and if 576th postion is a digit i,e 0-9
or
b> if it starts with 0 or 9(i,e header and footer)
... (4 Replies)
Discussion started by: millan
4 Replies
7. Shell Programming and Scripting
Hi Experts,
I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised... (7 Replies)
Discussion started by: manishkomar007
7 Replies
8. HP-UX
I have 2 files; one file (say, details.txt) contains the details of employees and another file (say, emp.txt) has some selected employee names. I am extracting employee details from details.txt by using emp.txt and the corresponding code is:
while read line
do
emp_name=`echo $line`
grep -e... (7 Replies)
Discussion started by: arb_1984
7 Replies
9. AIX
Hi,
I need to transfer 2000 files from one host to another..
I modified /etc/security/limits to -1 and ulimit -f, ulimit -s, ulimit -a..
Even then only 700 files are transferred.
Could You please help me to sort out this issue..
I think some configuration related to memory is... (3 Replies)
Discussion started by: Priya Amaresh
3 Replies
10. UNIX for Advanced & Expert Users
Hi AM using unix Aix Ksh
I need to clarify regarding sending the zero size file to another server.
VAL=ftp.sh -c put souce_file Dest_file $1 $2 $3 $4 $5
$VAL 2 > $ERR
When am Sending the Zero Size File getting alerts netout write returned Zero.
But i would like to know $VAL... (4 Replies)
Discussion started by: Venkatesh1
4 Replies
LEARN ABOUT CENTOS
xferlog
XFERLOG(5) File Formats Manual XFERLOG(5)
NAME
xferlog - ProFTPD server logfile
DESCRIPTION
The xferlog file contains logging information from the FTP server daemon, proftpd(8). This file usually is found in /var/log but can be
located anywhere by using a proftpd(8) configuration directive. Each server entry is composed of a single line of the following form, with
all fields being separated by spaces.
current-time transfer-time remote-host file-size filename transfer-type special-action-flag direction access-mode
username service-name authentication-method authenticated-user-id completion-status
current-time is the current local time in the form "DDD MMM dd hh:mm:ss YYYY". Where DDD is the day of the week, MMM is the month,
dd is the day of the month, hh is the hour, mm is the minutes, ss is the seconds, and YYYY is the year.
transfer-time is the total time in seconds for the transfer.
remote-host is the remote host name.
file-size is the size of the transferred file in bytes.
filename is the name of the transferred file. If the filename contains any spaces or control characters, each such character is
replaced by an underscore ('_') character.
transfer-type is a single character indicating the type of transfer. Can be one of:
a for an ascii transfer
b for a binary transfer
special-action-flag is one or more single character flags indicating any special action taken. Can be one or more of:
C file was compressed
U file was uncompressed
T file was tar'ed
_ no action was taken
direction is the direction of the transfer. Can be one of:
o outgoing
i incoming
d deleted
access-mode is the method by which the user is logged in. Can be one of:
a (anonymous) is for an anonymous guest user.
r (real) is for a local authenticated user.
username is the local username, or if guest, the ID string given.
service-name is the name of the service being invoked, usually FTP.
authentication-method
is the method of authentication used. Can be one of:
0 none
1 RFC931 Authentication
authenticated-user-id
is the user id returned by the authentication method. A * is used if an authenticated user id is not available.
completion-status is a single character indicating the status of the transfer. Can be one of:
c complete transfer
i incomplete transfer
FILES
/var/log/xferlog
AUTHORS
ProFTPD is written and maintained by a number of people, full credits can be found on http://www.proftpd.org/credits.html
SEE ALSO
proftpd(8)
Full documentation on ProFTPD, including configuration and FAQs, is available at http://www.proftpd.org/
For help/support, try the ProFTPD mailing lists, detailed on http://www.proftpd.org/lists.html
Report bugs at http://bugs.proftpd.org/
XFERLOG(5)