Shell Programming and Scripting

Hi guys,

I want to know how to wait for the files untill they are loaded through ftp

here the scenario is

i'm searching for the files in unix directory
/stage_area/loadfiles/telsims/test/
and there are 39 files daily i will recieve with names like *.todays_date

i.e filename.20110520

i have a script to search whether these 39 files are avaliable or not.
And my question is i have to wait untill all the 39 files are loaded in to that folder and there will no transfer of data in to that files.

how can i do this..

It would be best if your sender could include a flag to say that they were all delivered, i.e. create a zero or one byte file called *.todays_date.complete

That way you would have the confidence that the inbound ftp had completed without error (assuming that the sender does not send the 'complete' file as a separate transfer without checking for errors) which is better than just using fuser to check if the file is open.

If you know you need 39 files and they all come from different transfers, you may have to just script up something like this:-

Code:

#!/bin/ksh
cd /stage_area/loadfiles/telsims/test

todays_date=`date +%Y_%m_%d`   # Assuming that this is the format you want
until [ `ls -1 *.${todays_date}.complete | wc -l` -eq 39 ]
do
     sleep 10
done

echo "All files arrived.  Continuing with main processing."

Does that help?



Robin
Liverpool/Blackburn
UK

I'm sure you meant:

Code:

ls -1 *.${todays_date} | wc -l

I'd add extra 'sleep's, in case the files are large or the transfer is slow.

I was using the 'complete' file I described so you can be sure that the sender has completed the transfer, that's all.

The code will just loop until the criteria are met.


I hope it helps.




Robin

In case there are no files:

Code:

ls -1 *.${todays_date} 2>/dev/null | wc -l

Hi Robin,

Thanks for your reply...

the above script is ok but it will just says when 39 files are avaliable.

My question is if the file is still on process how to idetify it and wait untill it loads..

'FUSER ' it will shows which files are open..
i tried using LSOF, but ididn't get it...

can u give me an suggestion..

Once again thanks for all for giving me reply...

regards,
venkat..

The best way to avoid is , use a temporary extension (f.tmp)while ftping a file. once compeleted the ftp script can rename the file from f.tmp to f.

This is a fail proof method. And you also use fuser to check still any files are opened by the ftp user.