Shell Programming and Scripting

The sort command assumes you have an underscore between the text ciscostats and the date eg:

ciscostats_10032012
ciscostats_13032012

I suspect this might not be the case as your ls command just has ciscostats*, what are your actual filenames like?

Pleasse verify that the output of ls ciscostats_* | sort -t_ -k2.5r -k2.3,2.4r -k2.1,2.2r has newest file first and files appear in date order eg:

Code:

ciscostats_13032012
ciscostats_12032012
...
ciscostats_01032012
ciscostats_29022012
ciscostats_28022012

the ls lists the files perfectly in date order.

I have tried an underscore ciscostats_* with the same result

Well at this stage I'd focus on trying to prove it wrong. If you have a NEW line from the other script etc. that you feel is a genuine NEW record try and grep this in the other log files

For example we know that "NREE_CISCO3750,10,2" is new so it will appear in just 1 logfile eg:

Code:

# grep -l "^NREE_CISCO3750,10,2" ciscostat*
ciscostats_13032012

Try this for other lines you think should be new and see what turns up.

I have, I used grep -l "string" and it confirms which files the string comes from.

If I run my first script..

---------- Post updated at 04:56 AM ---------- Previous update was at 04:39 AM ----------

Chubler appreciate the help mate, but the problem with your code is there is nothing comparing the latest file with the last 3 months worth of files...

Look at post 1 script, it says compare ciscostats_20120312 with *.csv i.e everything then tell me which new lines you have.

Your code does not seem to, it also does not produce >20 line output

Sorry if I have been unclear.

Yes it does, re-read post #20.

The files are sorted into date order and the first file is the most recent so everything is compared to this.
With MATCH set to 20 it will print any lines > 20
With LOOK set as 90 (90 logfiles = 90 days, or approx 3 months).

If you want any more help you should attach your input files to a post (use the paperclip button) if you tar+zip them they wont be so big. We are both looking at the same thing and I can test more before giving up an update.