Shell Programming and Scripting

Hello,

I am writing a Log Unifier program. That is, I have a system that produces logs:
my.log, my.log.1, my.log.2, my.log.3...

I want on each iteration to store the number of lines I've read from a certain file, so that on the next iteration - I can continue reading on from that place.

The problem is that when the files are full, they roll:
The last log is deleted
...
my.log.2 becomes my.log.3
my.log.1 becomes my.log.2
my.log becomes my.log.1
and a new my.log is created

I can ofcourse keep track of them, using inodes - which are almost a one-to-one correspondence to files.

I say "almost", because I fear of the following scenario:
Between two of my iterations - some files are deleted (let's say the logging is very fast), and are then new files are created and some have inodes of files just deleted. The problem is now - that I will mistake these files as old files - and start reading from line 500 (for example) instead of 0.

So I am hoping to find a way:
1. Either another 1-to-1 correspondence other than inodes.
2. An ability to mark a file. I thought about using chmod +x to mark the file as an existing file, and for new files that don't have these permissions - I will know they are new - but if somebody were to change the permissions manually, that would confuse my program. So if you have any other way to mark.
3. I thought about creating soft links to a file that are deleted when the file is deleted. That would allow me to know which files got deleted.
4. Any way to get the "creation date"
5. Any idea that comes to mind - maybe using timestamps, atime, ctime, mtime in some clever way - all will be good, as long as they will allow me to know which files are new, or any idea creating a one-to-one correspondence to files.

Thank you

If you have a filesystem that supports extended attributes, you could use them to store information, like:

Code:

$ setfattr -n user.key -v value test
$ getfattr -n user.key test
# file: test
user.key="value"

---------- Post updated at 08:44 ---------- Previous update was at 08:42 ----------

BTW: don't forget to prefix the attribute name with "user." or you'll get an setfattr: test: Operation not supported error.