getting only new files from FTP


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting getting only new files from FTP
# 1  
Old 01-04-2011
Java getting only new files from FTP

iam using mget *.* too get all files in FTP
iam checking the FTP Server every day for the new files(there are 100s every day) and iam doing *.*
by doing so iam getting the old files also(it overwriting the old files) ......
how can i get only the new files...... from FTP
# 2  
Old 01-04-2011
No simple solution

Because you also say 100's of new files each day, the timing will be important. Suggest something like the following:

log on to the server
move all files to sub-directory called /toget
now ftp mget from that /toget folder
when done, move from /toget folder to a /done folder
(assuming you want to keep them)

Then, next time you connect, that main folder should only have new files.
# 3  
Old 01-04-2011
@JOEYG
i dont hav access to create a folder...
is there any way to write...like if condition....like tat
# 4  
Old 01-04-2011
Question How to know if you already got the file?

The crux of this matter is how you will determine what files you already got. So, what condition/rule would you use to select only new files?
# 5  
Old 01-04-2011
While I am always up for a scripting challenge, is rsync an option? Or perhaps something like FTPSYnc (cf) be used?

FTPSync | Download FTPSync software for free at SourceForge.net
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to see the status of all the ftp put & get files logs and curent ftp transfer status ?

How to see the status of all the ftp put & get files logs and curent ftp transfer status if any active ftp running in the background ? (2 Replies)
Discussion started by: i4ismail
2 Replies

2. Shell Programming and Scripting

Need help creating a script to FTP files to a server and then delete the files that were transfered.

I am trying to FTP files to a Windows server through my Linux machine. I have setup the file transfer with no problems but am having problem deleting those files from the Linux box. My current non-working solution is below. Any ideas, anyone?? :wall: Please be gentle, I'm fairly new to this... (4 Replies)
Discussion started by: jmalfhs
4 Replies

3. Shell Programming and Scripting

ftp files ...

Hi , I am new to shell scripting I was planning to write a script that will FTP files to destination folder..so which approach should I follow the ftp one or sftp one or scp one and which one one of them is most secure and fastest one..? (1 Reply)
Discussion started by: rahul125
1 Replies

4. Shell Programming and Scripting

FTP the files

Hi, Currenty I am transfering the files which are in list-test.txt. Below is the code for same - file_ftp () { while read inFile do #inFile=abc.arch.gz FILETYPE=$inFile ftp -in $GATEWAY1 <<! user $USERID1 $PASSWD1 lcd $PICKUPDIR cd $DROPDIR1 bin ... (1 Reply)
Discussion started by: ravigupta2u
1 Replies

5. Shell Programming and Scripting

FTP files

Hi, I have to transfer the files from one unix box to abnother. Below is the function i have written - file_ftp () { #for inFile in `cat /home/rgupta/list-test.txt` #do inFile=abc.arch.gz FILETYPE=$inFile ftp -in $GATEWAY1 <<! user $USERID1 $PASSWD1 ... (3 Replies)
Discussion started by: ravigupta2u
3 Replies

6. Shell Programming and Scripting

ftp files

Dear ALL i had a file name called test.log witch contains 300 archives log files. so how can i give the test.log as a input to the ftp script please let me know Thank you (9 Replies)
Discussion started by: paddyforum
9 Replies

7. Filesystems, Disks and Memory

Not able to FTP the files to a FTP server

Hi , We are facing a weird problem in our project. we need to send some xml & audio files to a remote FTP server from a Linux box, we are doing this in Perl script using Net::FTP->. Issue here is.. when FTPed the files using Perl scripts, only empty files ( 0 byte) are getting created on the... (2 Replies)
Discussion started by: kishorepotta
2 Replies

8. Shell Programming and Scripting

Ftp too many files.

Hi folks, Small but interesting issue. I have 15 files in a directory with the same name as discribd below. refresh_20090407045220.dat refresh_20090407051445.dat refresh_20090407052138.dat refresh_20090407064528.dat refresh_20090407064654.dat refresh_20090407065012.dat... (9 Replies)
Discussion started by: Haque123
9 Replies

9. Shell Programming and Scripting

FTP of files

Hi all, I had written the following script to transfer the files thru FTP. But it throws me some error after I run the program. I guess its throwing error because of the path. Do help me. Thanks cd /home/psv find . -name '*.ksh' -print > /home/psv/ftpbatch/onefile cd... (2 Replies)
Discussion started by: mahalakshmi
2 Replies

10. UNIX for Dummies Questions & Answers

FTP files

Hi, I am new to unix and I want to ftp files from unix to windows nt machine. My requirement is like i want to ftp files which are having system date (20050927) in between the filename. Once i get into ftp mode, I am not able to execute the unix command the get the system date and to change it... (1 Reply)
Discussion started by: gopskrish
1 Replies
Login or Register to Ask a Question