sending larger files via ftp Post: 302074440

Sponsored Content

Top Forums UNIX for Advanced & Expert Users sending larger files via ftp Post 302074440 by matrixmadhan on Tuesday 23rd of May 2006 10:39:26 AM

05-23-2006

Registered User

sending larger files via ftp

[solaris 5.9]

hi all,

i am looking for ways to make ftp efficient by tuning the parameters

currently,
tcp_max_buf is 1 MB
tcp_xmit_hiwat is 48 KB

say to transmit multiple 2 gb files from unix server to mainframe sys,
will increasing the window size or the send buffer size of the current TCP/IP configuration have an effect on the time taken to tranmit the file from unix server to mainframe sys ?

upon setting new values to conf, is a reboot required ?

is there any maximum file size limit that can be transmitted via ftp?

else or there any other ways to effectively transmit larger files from unix server to mainframe sys.

1) one thing could be compression, but i am not sure of an uncompress binary constructed on the same adaptive Lempel-Ziv coding and available there in the mainframe system.

2) setting the same buffer size for send and receive would avoid unnecessary fragmentation across network prior sending it. But no control can be exercised over the receive buffer size of the mainframe system.

Thanks,
Mad.

matrixmadhan

View Public Profile for matrixmadhan

Find all posts by matrixmadhan

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Sending email w/ ftp log as attachment

Can this be done? Code samples welcome and encouraged.

2. Shell Programming and Scripting

FTP repeat sending files

Hi everyone. I wrote a ftp script for sending files. while read FNAME do # Begin ftp ftp -i -n $HOST << END user $USER $PASSWD put $FNAME $FNAME quit END # End ftp done < ftp_sending_list.dat HOST, USER and PASSWD are my account data. This script quits ftp for many times and this is...

3. HP-UX

Ftp cannot put file larger than 64kb

Hi gurus, I have a problem with ftp access. The first 2 test e.g. Test A & Test B was successful with the file size 64kb (800++ numbers). The third test with file size 120kb was failed. The error is "Netout :Connection reset by peer". No password entered manually since the test run from the...

4. AIX

Tar files larger than 2GB

Hi, Does anyone know if it is possible to tar files larger than 2GB? The reason being is they want me to dump a single file (which is around 20GB) to a tape drive and they will restore it on a Solaris box. I know the tar have a limitation of 2GB so I am thinking of a way how to overcome this....

5. UNIX for Dummies Questions & Answers

Using UNIX Commands with Larger number of Files

Hello Unix Gurus, I am new to Unix so need some help on this. I am using the following commands: 1) mv -f Inputpath/*. outputpath 2) cp Inputpath/*. outputpath 3) rm -rf somepath/* 4) Find Inputpath/*. Now I get the following error with...

6. UNIX for Dummies Questions & Answers

7z command for files larger than 4GB ( unzip doesn't work)

My unzip command doesn't work for files that are greater than 4GB. Consider my file name is unzip -p -a filename.zip, the command doesn't work since the size of the file is larger. I need to know the corresponding 7z command for the same. This is my Unix shell script program: if then ...

7. Shell Programming and Scripting

Backingup larger files with TAR command

I need to backup my database but the files are very large and the TAR command will not let me. I searched aids and found that I could do something with the mknod, COMPRESS and TAR command using them together. I appreciate your help.

8. UNIX for Dummies Questions & Answers

Split larger files into smaller ones with Column names

Hi, I have one large files of 100000 rows with header column. Eg: Emp Code, Emp Name 101,xxx 102,YYY 103,zzz ... ... I want to split the files into smaller files with only 30000 rows each..File 1,2 and 3 must have 30000 rows and file 4 must contain 10000 rows. But the column...

9. UNIX for Beginners Questions & Answers

Need to select files larger than 500Mb from servers

I need help modifying these two scripts to do the following: - print files in (MB) instead of (KB) - only select files larger than 500MB -> these will be mailed out daily - Select all files regardless of size all in (MB) -> these will be mailed out once a week this is what i have so far and...

10. UNIX for Beginners Questions & Answers

Help with Expect script for pulling log files size larger than 500Mb;

I am new at developing EXPECT scripts. I'm trying to create a script that will automatically connect to a several UNIX (sun solaris and HPUX) database server via FTP and pull the sizes of the listener/alert log files from specified server directory on the remote machines. 1. I want the script...

LEARN ABOUT SUSE

elvtune

ELVTUNE(8)						      System Manager's Manual							ELVTUNE(8)

NAME

       elvtune - I/O elevator tuner

SYNOPSIS

       elvtune [-r r_lat] [-w w_lat] [-b b_max] device...
       elvtune -h
       elvtune -v

DESCRIPTION

       elvtune	allows	to  tune the I/O elevator per blockdevice queue basis. The tuning can be safely done at runtime. Tuning the elevator means
       being able to change disk performance and interactiveness. In the output of elvtune the address of the queue tuned will be shown and it can
       be  considered  as  a queue ID.	For example multiple partitions in the same harddisk will share the same queue and so tuning one partition
       will be like tuning the whole HD.

OPTIONS

       -r r_lat
	      set the max latency that the I/O scheduler will provide on each read.

       -w w_lat
	      set the max latency that the I/O scheduler will provide on each write.

       -b b_max
	      max coalescing factor allowed on writes when there are reads pending in the queue.

       -h     help.

       -v     version.

NOTE

       Actually the only fields tunable are those relative to the IO scheduler. It's not possible to select a one-way or two-way elevator yet.

       For logical blockdevices like LVM the tuning has to be done on the physical devices. Tuning the queue of the LVM logical device is useless.

RETURN VALUE

       0 on success and 1 on failure.

HISTORY

       Ioctls for tuning elevator behaviour were added in Linux 2.3.99-pre1.

AUTHORS

       Andrea Arcangeli <andrea@suse.de> SuSE

AVAILABILITY

       The elvtune command is part of the util-linux-ng package and is available from ftp://ftp.kernel.org/pub/linux/utils/util-linux-ng/.

Version 1.0							   14 March 2000							ELVTUNE(8)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Sending email w/ ftp log as attachment

Discussion started by: idesaj

2. Shell Programming and Scripting

FTP repeat sending files

Discussion started by: Euler04

3. HP-UX

Ftp cannot put file larger than 64kb

Discussion started by: yeazas

4. AIX

Tar files larger than 2GB

Discussion started by: depam