When a FTP download is completed


 
Thread Tools Search this Thread
Operating Systems Linux SuSE When a FTP download is completed
# 8  
Old 06-16-2005
First of all, thanks for the answers

I have tested all this solutions but by now, I'm not able to get if the file is complete downloaded.

The command 'lsof' doesn't show the file that the 'vsftpd' process is writting. I get the same problem with 'fuser'.

I have made a C program that lock in exclusive mode the file. I thought that If I am able to lock the file then the file is not open by another process. But It doesn't work, the program is able to lock the file although the file is downloading.

The real problem appear to be that, nowhere in the Linux system reside information about the files than the vsftpd daemon is working with ...

My system receive files from a lot of external different systems, so I can't request to all this systems ( some of them, another companies ) a second file to confirm that the first one is completed.
# 9  
Old 06-16-2005
Quote:
Originally Posted by Javi
First of all, thanks for the answers

I have tested all this solutions but by now, I'm not able to get if the file is complete downloaded.

The command 'lsof' doesn't show the file that the 'vsftpd' process is writting. I get the same problem with 'fuser'.

I have made a C program that lock in exclusive mode the file. I thought that If I am able to lock the file then the file is not open by another process. But It doesn't work, the program is able to lock the file although the file is downloading.

The real problem appear to be that, nowhere in the Linux system reside information about the files than the vsftpd daemon is working with ...

My system receive files from a lot of external different systems, so I can't request to all this systems ( some of them, another companies ) a second file to confirm that the first one is completed.
Why dont you check the size of the downloaded file's size in an interval of say 30 secs, if they are same, it is inferred the FTP is completed.
# 10  
Old 06-16-2005
Quote:
Originally Posted by Javi
The command 'lsof' doesn't show the file that the 'vsftpd' process is writting. I get the same problem with 'fuser'.

I have made a C program that lock in exclusive mode the file. I thought that If I am able to lock the file then the file is not open by another process. But It doesn't work, the program is able to lock the file although the file is downloading.

The real problem appear to be that, nowhere in the Linux system reside information about the files than the vsftpd daemon is working with ...
Re paragraph 1: I find it very hard to believe that lsof can't do this. Your lsof could be broken, more more likely you are doing something wrong. Since you haven't mentioned stuff like precisely what command you used or precisely what result you got there's no way to tell. Could you take a bug report like: "'lsof' doesn't show the file" and do anything with it?

Re paragraph 2: "exclusive locks" are the only kind that exist. If you want a mandatory lock, read mandatory.txt. But this won't help much. If you do it correctly, you will succeed, and vxftpd will experience failed writes. It will probably detect this and inform the ftp client of the error.

Re paragraph 3: I wonder how the data gets to the file?

I looked at the source code for vsftpd. I see it has a logging option. Turn that on and parse the log to see if the file is finished.
# 11  
Old 06-16-2005
I wonder if this is a vfstpd bug or not. Hard to belive that an open file in UNIX does not have a "flag" soemwhere.
Have you tried /proc/<pid>/fd? That must be of help. Tom
# 12  
Old 06-20-2005
Here is the ouput during the download of the file. You can notice how the size between the first and the last command is different, however, lsof neither fuser has shown any result that indicate that the file is open.

Perhaps I'm not using these commands correctly ... but I've followed the SuSe documentation and appears to be correctly.

Thanks

-------

javides@emm:~/apsv/javi/test> dir
-rw-r--r-- 1 javides javides 10048645 2005-06-15 14:11 javiarchivo
javides@emm:~/apsv/javi/test> fuser javiarchivo
javides@emm:~/apsv/javi/test> lsof |grep javiarchivo
javides@emm:~/apsv/javi/test> lsof javiarchivo
javides@emm:~/apsv/javi/test> echo $?
1
javides@emm:~/apsv/javi/test> fuser javiarchivo
javides@emm:~/apsv/javi/test> echo $?
1
javides@emm:~/apsv/javi/test> dir
-rw-r--r-- 1 javides javides 10058605 2005-06-15 14:12 javiarchivo
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

FTP File download

Hi, I have few files at FTP location and have written a script to download the same from ftp based on the sysdate - 1, however with the below code I am unable to download the files from FTP. x=`TZ=CST+24 date +%Y%m%d` mget Daily_BIH_$x_NEW.tar.gz can anyone please help me in... (10 Replies)
Discussion started by: rramkrishnas
10 Replies

2. Shell Programming and Scripting

Download files every one second using ftp script

Our main Server "Srv1" is used to generate text files based on specified criteria and it is also connected to two clients (pc1 and pc2) which are responsible for getting the files from Srv1 as it follows: 1. pc1 ( which represents my UNIX machine ) uses shell script to copy the files from Srv1 2.... (3 Replies)
Discussion started by: arm
3 Replies

3. Shell Programming and Scripting

Download data from ftp.

Dear all, I am beginner to shell scripting. I have to download more than 1k files from ftp site. link is below ftp://ftp.ncbi.nih.gov/genomes/Bacteria/ Earlier i was using wget url, for download but the problem is some times folder names get changed, i don't know how to move in directories... (4 Replies)
Discussion started by: admax
4 Replies

4. Windows & DOS: Issues & Discussions

Download patches using FTP client

Hi all, I want to download patches using any FTP client by connecting to updates.oracle.com site on windows platform.Please advice me on this. I am using windows xp operating system Thanks in advance (0 Replies)
Discussion started by: William1482
0 Replies

5. UNIX for Dummies Questions & Answers

cURL Active FTP Download

Hello, I know this is probably a very silly question for most but how to do I force curl to do active FTP downloads? Thank you Dallas (2 Replies)
Discussion started by: Dallasbr
2 Replies

6. Shell Programming and Scripting

download specified file from ftp server

Hi all, I'm having problems downloading files from ftp server. I have to download only those files that name starts with YYYYMMDD.But file comes like the format "20080624221035.TXT".Also how i can get list of all file names with in specified folder. Here i paste my code ftp -vn... (1 Reply)
Discussion started by: vaskarbasak
1 Replies

7. UNIX for Dummies Questions & Answers

FTP Download username and password

I am trying to download from ftp server (rsync and postfix). But every time I connect to the ftp server, it prompts for USER and PASS but I don't know which username and and password to use. And I am using command based UNIX OS. (2 Replies)
Discussion started by: kumarrana
2 Replies

8. Shell Programming and Scripting

Cron Jobs for FTP download

Dear All, Please to be inform you,I have posted one thread on this forum last 5 days back. I was not getting suggestions for my thread. So i am creating a new thread with detailed of my R&D. I am new in Shell Scripts, Perl and Cron Jobs. I have one requirement in Cron jobs for FTP Download.... (5 Replies)
Discussion started by: moorthygs
5 Replies

9. HP-UX

ftp download problem

from windows ftp tool even you are not root user you can delete root files (8 Replies)
Discussion started by: mkhsy
8 Replies

10. HP-UX

Ftp Download Problem

FROM WINDOWS , WHILE GETTING DATA FROM HP-UNIX SERVER USING FTP, I AM ABLE TO GET DATA ONLY LESS THAN 4GB FILE, PLZ HELP ME HOW TO GET MORE MORE THAN 4GB FILE. (4 Replies)
Discussion started by: niranjan
4 Replies
Login or Register to Ask a Question