01-19-2012
Depending on the situation, I send to a filename that has a bang (!) as the last character. When the transfer is done, I rename the file to remove the bang. Same effect as creating a marker file, but less things in the directory to track. I also think it's easier to quickly see how many 'in progress' files exist. If I am really concerned about correctness, I send a 'done file' that contains the checksum of the data file and use the bang technique on both files. The receiving process then can verify that there were no errors in transmission and/or writing the file to disk.
Another technique that I use, when able, is to have the sender schedule the process on the remote host that will process the file after it believes the file has been sent successfully. No renaming or done files needed, and when I schedule the process, I can give it a checksum to verify that the file was received without error.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi
I'm using Shell script which will ftp (download) a file from a host. I need to check whether the file has been transfered completley or not.
Can anyone tell me how to do that?
Thanks
Ben (1 Reply)
Discussion started by: abrd600
1 Replies
2. Solaris
Hi ....I'm trying to ftp 2 pkgs SUNWqlc & SUNWqlcx since they were accidentally deleted from my servers. For one reaseon or the other my server is not loading the cdrom, so I mounted the cdrom on a differernt server & ftp's to it.
I tried to get this pkg using the bin & I get an error message... (3 Replies)
Discussion started by: Remi
3 Replies
3. Shell Programming and Scripting
Hi !
I created a similar script as shown below to automate an FTP transfer and encountered errors. Appreciate any advice to resolve this issue.
The script:
#!/usr/bin/ksh
ftp 'IP ADD' << cmd
user 'user' 'pass'
lcd /home/data
get 'FileA' FileB
quit
cmd
Connected to 'IP_ADD'.... (3 Replies)
Discussion started by: cosec
3 Replies
4. Shell Programming and Scripting
Hi All,
I am very new to shell scripting,I have some doubts how we can do a file transfer using ftp
I wanted to transfer files using non_secure ftp and secure ftp(sftp) mode,
for secure ftp i am using following code
verbose="verbose"
ftp="/usr/bin/ftp"
user="ABC"
pass="123"... (1 Reply)
Discussion started by: sudhi
1 Replies
5. Shell Programming and Scripting
Hi Guys,
I wanted to transfer files from FTP machine to Linux Machine.
In this, I need to create a batch file that will connect to the Linux Machine and Transfer the files specified as the parameter to the files.
Ex : transferfiles Product Time Geography
Here transferfiles shld contain... (4 Replies)
Discussion started by: Swapna173
4 Replies
6. Shell Programming and Scripting
I am going to transfer file from UNIX directory to remote windows location and i wrote the script but i am getting the error as 'FTP: not found' or i am getting this error 'The file path is not found'.
Please help me to resolve this problem as early as possible.(urgent).
my script is,
... (6 Replies)
Discussion started by: praka
6 Replies
7. Shell Programming and Scripting
Frdz, i have scenorio like i have to open ftp connection in a for loop and connect to the other server and upload the file again and again till the for loop ends but i am getting problem when i use the following code.
for i in `ls ${SOURCE_DIR}/`
do
FOLDER_NAME=`basename $i`
for j in `ls... (4 Replies)
Discussion started by: KiranKumarKarre
4 Replies
8. UNIX for Dummies Questions & Answers
Hey all,
I'm trying to upload a file to my ftp server through an automated batch program. I will be uploading a file that's name changes according to you IP Address, so I am using the variable %ip% to represent the file's name. The problem occurs when it transfers over to the ftp portion of the... (2 Replies)
Discussion started by: piking
2 Replies
9. Shell Programming and Scripting
Hi guys,
I am using slurm to send file to make calculation on a server at my university.
The time limit for these calculation is 5 days but sometimes it is not enough. For this reason I need a clean up function that before the calculation ends copy the unfinished calculation file ( in order to... (5 Replies)
Discussion started by: gbengasi
5 Replies
10. UNIX for Beginners Questions & Answers
How to see the status of all the ftp put & get files logs and curent ftp transfer status if any active ftp running in the background ? (2 Replies)
Discussion started by: i4ismail
2 Replies
netrc(5) File Formats Manual netrc(5)
Name
netrc - file used by ftp auto-login procedure (.netrc)
Description
The file contains frequently needed options for transfers. The file resides in the owner's home directory on the machine from which the
owner initiates the file transfer. If the file includes passwords, set permissions on the file with so that only the owner has read per-
mission.
The file uses the following format:
o Each line of the file defines options for a specific machine.
o A line in the file can be either a machine line or a default line.
o The default line must be the first line in the file if it is present.
o Fields in a default line appear in this order: default, default machine name.
o Fields in a machine line appear in this order: machine, machine name, options.
o Fields on each line are separated by spaces or tabs.
The following are valid options for a machine line:
-------------------------------------------------------------------
Option Parameter Default Description
-------------------------------------------------------------------
machine machine name none Identifies a remote
machine name
login name local name Identifies user on the
remote machine
password password none Password for remote
login name
account password none Additional account password
macdef macro name none Defines a macro like the
ftp macdef command
-------------------------------------------------------------------
Example
This is an example of a file:
machine cactus login smith
machine nic.ddn.mil login anonymous password anonymous
machine palm.stateu.edu login smith password ualonerwelcome
macdef byenow
quit
macdef ls
dir
The first line allows to log Smith into the machine after prompting for and receiving Smith's password, as shown in this example:
$ ftp cactus
Connected to cactus.tech.edu
FTP server ready.
Password required for SMITH.
User logged in
ftp>
The second line of the file allows the user to perform an anonymous transfer after typing this command:
$ ftp nic.ddn.mil
See for a description of anonymous FTP transfers.
The third line allows Smith to log into the machine Smith will not be prompted for a password because this machine line includes password
information. Because the file includes password information, the file must not have read permission set for world and group.
The lines are macro definitions, which operate much like shell aliases. A blank line must follow each macro definition to signal the end
of the macro. The first macro definition defines as an alias for the command.
See Also
ftp(1c)
netrc(5)