Shell Programming and Scripting

Hi,

I have a FTP script that check for ".done" files in the remote path and the "get" the corresponding data files. Here's how it does.....

First it list all the *.done file as below:

Code:

 
ls *.done

And then it picks one file and get the corresponding data file. After that it renames that ".done" file to ".done.done" Now the problem is that the next time when I list the ".done" file it should somehow ignore ".done.done" files. Here's something I found in this forum: https://www.unix.com/shell-programmin...ls-ignore.html

But the problem of using this is:

Code:

ls -l -I '*.done.done'

command 1

that it would also list data files which would not have ".done" files. I even tried:

Code:

ls *.done | grep -v done.done

command 2

this works fine when I do that on the local m/c path. But not sure if I can do that in the remote path. I tried and it throws error:

Code:

Couldn't stat remote file: No such file or directory
Can't ls: "/home/<dir>/" not found

in both the commands. Please suggest.

-dips

The obvious answer - name it something.done.finished or whatever.
If your written requirements state that 'done.done' must be the final result,
then name everything *.done.finished and at the end rename *.done.finished to *.done.done

However the next time your code runs you will still have the done.done problem.
The only work around for that is to connect, get a full file listing into a local file, disconnect, then parse out the files you want, reconnect and process the files in your list. Which is a lot of work compared to *.done.finished.

The other thing to note is that ls under ftp and sftp does not support all of the options you may have on the local box.

Does this help?https://www.unix.com/shell-programmin...#post302404864

Hi,

Yes jim mcnamara even I proposed the obvious; and now the design team has agreed to rename the remote .done files to .finished.

Also as this ftp script needs to be called from 28 different processes in parallel (at the exact moment) creating the full list in the local m/c and then parsing it was a tedious job. So smart thing was to change the extension :-)

Thanks to you both for your time.

-dips