sending larger files via ftp


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users sending larger files via ftp
# 1  
Old 05-23-2006
sending larger files via ftp

[solaris 5.9]

hi all,

i am looking for ways to make ftp efficient by tuning the parameters

currently,
tcp_max_buf is 1 MB
tcp_xmit_hiwat is 48 KB

say to transmit multiple 2 gb files from unix server to mainframe sys,
will increasing the window size or the send buffer size of the current TCP/IP configuration have an effect on the time taken to tranmit the file from unix server to mainframe sys ?

upon setting new values to conf, is a reboot required ?

is there any maximum file size limit that can be transmitted via ftp?

else or there any other ways to effectively transmit larger files from unix server to mainframe sys.

1) one thing could be compression, but i am not sure of an uncompress binary constructed on the same adaptive Lempel-Ziv coding and available there in the mainframe system.

2) setting the same buffer size for send and receive would avoid unnecessary fragmentation across network prior sending it. But no control can be exercised over the receive buffer size of the mainframe system.

Thanks,
Mad.
# 2  
Old 05-23-2006
What speed are you getting now?

If the link is slow, no amount of tuning will make it faster. If the link is fast, tuning won't make much difference either. So, yeah. Make the link faster.
# 3  
Old 05-23-2006
Quote:
Originally Posted by Corona688
What speed are you getting now?

If the link is slow, no amount of tuning will make it faster. If the link is fast, tuning won't make much difference either. So, yeah. Make the link faster.

currently,

766 Kbytes/s (approx)
# 4  
Old 05-23-2006
Over what kind of link? 10baseT?
# 5  
Old 05-23-2006
If it's 10baseT, you're getting pretty close to the practical maximum, the theoretical one is one megabyte per second. 100baseT would be ten times faster.
# 6  
Old 05-24-2006
Its a t1 fiber link.

even with that wont i able to tune the parameters and maximize the throughput?
# 7  
Old 05-24-2006
T1 maxes out at 150 kilobytes per second, so 766KBytes/s is actually... pretty good. Or maybye you have something else. Not to mention, the point of fiber is often distance and noise-immunity rather than bandwidth. So you still haven't really given much info on what your connection's rated for, sadly.

I'm guessing compression wouldn't help much unless the file is very repetetive, or the transmitting system very fast CPU-wise. However I have found compression useful under some situations(generally in combination with the udpcast multicast tool, with which I've been able to achieve 99% of rated speed on a TCP/IP link -- at the expense of all other traffic on the link however Smilie). lzop in particular is designed to be realtime compression.

this thread on google groups shows a few tips. Window size is apparently important.

Last edited by Corona688; 05-24-2006 at 12:05 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Help with Expect script for pulling log files size larger than 500Mb;

I am new at developing EXPECT scripts. I'm trying to create a script that will automatically connect to a several UNIX (sun solaris and HPUX) database server via FTP and pull the sizes of the listener/alert log files from specified server directory on the remote machines. 1. I want the script... (7 Replies)
Discussion started by: mikebantor
7 Replies

2. UNIX for Beginners Questions & Answers

Need to select files larger than 500Mb from servers

I need help modifying these two scripts to do the following: - print files in (MB) instead of (KB) - only select files larger than 500MB -> these will be mailed out daily - Select all files regardless of size all in (MB) -> these will be mailed out once a week this is what i have so far and... (5 Replies)
Discussion started by: donpasscal
5 Replies

3. UNIX for Dummies Questions & Answers

Split larger files into smaller ones with Column names

Hi, I have one large files of 100000 rows with header column. Eg: Emp Code, Emp Name 101,xxx 102,YYY 103,zzz ... ... I want to split the files into smaller files with only 30000 rows each..File 1,2 and 3 must have 30000 rows and file 4 must contain 10000 rows. But the column... (1 Reply)
Discussion started by: Nivas
1 Replies

4. Shell Programming and Scripting

Backingup larger files with TAR command

I need to backup my database but the files are very large and the TAR command will not let me. I searched aids and found that I could do something with the mknod, COMPRESS and TAR command using them together. I appreciate your help. (10 Replies)
Discussion started by: frizcala
10 Replies

5. UNIX for Dummies Questions & Answers

7z command for files larger than 4GB ( unzip doesn't work)

My unzip command doesn't work for files that are greater than 4GB. Consider my file name is unzip -p -a filename.zip, the command doesn't work since the size of the file is larger. I need to know the corresponding 7z command for the same. This is my Unix shell script program: if then ... (14 Replies)
Discussion started by: chandraprakash
14 Replies

6. UNIX for Dummies Questions & Answers

Using UNIX Commands with Larger number of Files

Hello Unix Gurus, I am new to Unix so need some help on this. I am using the following commands: 1) mv -f Inputpath/*. outputpath 2) cp Inputpath/*. outputpath 3) rm -rf somepath/* 4) Find Inputpath/*. Now I get the following error with... (18 Replies)
Discussion started by: pchegoor
18 Replies

7. AIX

Tar files larger than 2GB

Hi, Does anyone know if it is possible to tar files larger than 2GB? The reason being is they want me to dump a single file (which is around 20GB) to a tape drive and they will restore it on a Solaris box. I know the tar have a limitation of 2GB so I am thinking of a way how to overcome this.... (11 Replies)
Discussion started by: depam
11 Replies

8. HP-UX

Ftp cannot put file larger than 64kb

Hi gurus, I have a problem with ftp access. The first 2 test e.g. Test A & Test B was successful with the file size 64kb (800++ numbers). The third test with file size 120kb was failed. The error is "Netout :Connection reset by peer". No password entered manually since the test run from the... (3 Replies)
Discussion started by: yeazas
3 Replies

9. Shell Programming and Scripting

FTP repeat sending files

Hi everyone. I wrote a ftp script for sending files. while read FNAME do # Begin ftp ftp -i -n $HOST << END user $USER $PASSWD put $FNAME $FNAME quit END # End ftp done < ftp_sending_list.dat HOST, USER and PASSWD are my account data. This script quits ftp for many times and this is... (1 Reply)
Discussion started by: Euler04
1 Replies

10. UNIX for Dummies Questions & Answers

Sending email w/ ftp log as attachment

Can this be done? Code samples welcome and encouraged. (2 Replies)
Discussion started by: idesaj
2 Replies
Login or Register to Ask a Question