Hey Don,

The variable data can be anything really, I can save it any format necessary. and to any number of extra logs I need to be able to achieve my goal.

I can save it any format that will make it better for the over time aggregation aswell

like an exta log will save data in any way as the process goes on...
like so:

Code:

date.
hourstart 
#####
#####
#####
#####
#####
date.
hourstart2
#####
#####
#####
#####
#####
 date.
hourstart3
#####
#####
#####
#####
#####
(...)
date2
hourstart1
###
(...)

####-signs being the values colleted and it can go on to infinity really for each data set which right now I save to seperate logs, different checks go in different logs, for instance system speed one log, system space other logs and so on...

Just so you can understand better. I can save in any format and any extra number of logs that will make the aggregation and caclulstions I mentioned earlier easier.

So for instance right now I have it setup to just generate a log for the hourly checks. I am currently searching how I will approach aggregating and other calculations

The data I am saving is
1: a data set of system repsonse times
2: system related calculations
3: other data sets collected in relation to the DB software performance

all datasets will be seperate logs
the main dataset I will be collecting will be used for the aggregtion on number sets collected like so generally:

Code:

ForDateIsToday
ForEachHour
SystemResponset_to_testload1
SystemResponset_to_testload2
SystemResponset_to_testload3
SystemResponset_to_testload4
SystemResponset_to_testload5

each test load gets a result and then I save response time as a sort of system check.

Aggregating this data and doing my calculations on lets say a one month or over many months is important for me

-dates and related variables will be saved.

Don-if you can help me try to think of how I might aggregate over time and keeping in mind I can save the logs in any necessary format.

the main code I have is done and the logs I have now are ok in terms of SLAs
the aggregation and extras I mentioned are a plus point we need going forward upper management want logs that we can use for "calculations" that can tell is performance over time like avgs,speed chg rates etc.

if your confused about the logs still, just think of it as it can be anything like:

Code:

date,hourstart
-dataset relating to the logs below for the hour
#,#,#,#