This file was created using this code (your code)

Code:

while true
do
        cat /path/to/output
done > logfile

I am sure if I am following what you saying , I have tried everything you said.

Code:

 awk ... /path/to/pipe

this will not only get one batch of the data but each time it will read the same data again and again.

I can't read from fifi as I said before using

Code:

mkfifo /path/to/outputfile

Then using awk read from data file to fifo file.
Created a pipe and the size of pipe is always zero as it does not store data. I have tried to write to this file but can't write to the file.

I have tried everything you said and try to explain the results I got.

---------- Post updated 4th Jan 2012 at 05:14 PM ---------- Previous update was 3rd Jan 2012 at 11:40 PM ----------

Please ignore my last reply.

Going back to the pipe, now I have a pipe output file as shows below

Code:

prw-r--r--*** 0 Jan* 3 11:00 OutPutFile

Now I am also able to read from the data file and capture the data using the pipe.

Also using AWK code I can read from pipe to another file which stores the data. (Parsing xml)

But this continues process for example if there are 40 records in the pipe then the AWK code loops again and again without stopping and adding to the counts every time.

I tried using sleep 20 at the end oTf the code before done, but this doesn't make any difference.

Could anyone help with this?

Also if the connection between the pipe and the data file fails, will pipe keep unprocessed data be kept by the pipe until it gets process or will it clear the file?

All I want the script to do is to run for 2 minutes, do calculation for those 2 minutes then sleep for 20 seconds. After 20 seconds start again from the where it was last.