Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Counting average data per hour
Top Forums Shell Programming and Scripting Counting average data per hour Post 302373023 by ghostdog74 on Thursday 19th of November 2009 08:31:57 AM
Old 11-19-2009
Python, if you have it
Code:
#!/usr/bin/env python

d={}
e={}
f=open("file")
line=f.readline()
for li in f:
    s = li.split()
    year,mth,day=s[0][:4],s[0][4:6],s[0][6:8]
    ti = s[1][:2]
    STR= day+"-"+mth+"-"+year+" "+ti
    d.setdefault(STR,[])
    e.setdefault(STR,[])
    rss,pcpu=s[7],s[8]
    d[STR].append(rss)
    e[STR].append(pcpu)
f.close()

for date,values in d.iteritems():
    print date, sum(map(int,values))/len(values), sum(map(int,e[date]))/len(e[date])

output
Code:
# python script.py 
16-11-2009 09 1682302 1403367
16-11-2009 08 1667231 1380012
16-11-2009 07 1646110 1342177

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

generating data for 1 hour

Hi Folks, The reqirement is that i need to generate 1 hr file with a time interval of five minutes.. For ex: my i/p is 0000-0000 and desired o/p is 0000-0005 0005-0010 0010-0015 0015-0020 0020-0025 0025-0030 0030-0035 0040-0045 0050-0055 0055-0100 Script neede urgent ... (0 Replies)
Discussion started by: aajan
0 Replies

2. Shell Programming and Scripting

How can i grep for an hour before data

Hi, My log file is something like this. (08/04/2009 00:27:42.179)(:) aaaaaaaaaaaa (08/04/2009 00:27:42.181)(:) bbbbbbbbbbbbbbbb (08/04/2009 01:00:42.713)(:) cd cdc d ddddsksjdkssksksj (08/04/2009 01:02:42.716)(:) raarrarararararara (08/04/2009 01:07:43.036)(:ERROR) Port... (8 Replies)
Discussion started by: rdhanek
8 Replies

3. UNIX for Advanced & Expert Users

filter last 24 hour data and put in new file

i have file server 1 (filesvr01acess.log) and disc server 1 (discsvr01acess.log) in unix box(say ip adress of the box 10.39.66.81) Similiarly i have file server 2 (filesvr01acess.log) and disc server 2(discsvr01acess.log) in another unix box(say ip adress of the box 10.39.66.82). Now my... (1 Reply)
Discussion started by: nripa1
1 Replies

4. Shell Programming and Scripting

counting word xx referred to a time period, like minute or hour

Hello, I try to insert a post because I've got a trouble to perform a unix job. But I didn't found which steps (procedure) I should follow. Could you help me? I got a log by my Application box, like following: gbosmam037:test >view Log_Server.csv ... (2 Replies)
Discussion started by: maluca68
2 Replies

5. UNIX for Dummies Questions & Answers

Load average spikes once an hour

Hi, I am getting a high load average, around 7, once an hour. It last for about 4 minutes and makes things fairly unusable for this time. How do I find out what is using this. Looking at top the only thing running at the time is md5sum. I have looked at the crontab and there is nothing... (10 Replies)
Discussion started by: sm9ai
10 Replies

6. Shell Programming and Scripting

return counting per hour percentage

We have a monitoring process for a load in unix box, during this process we are writing logs statements for each record, and during this process we are showing the counts per hour. Here is that how we are following log files statements: (just two lines printed here), these statements logged at... (1 Reply)
Discussion started by: skkuchipudi
1 Replies

7. Shell Programming and Scripting

Data counting

I have a large tab delimited text file with 10 columns for example chrM 412 A A 75 0 25 2 ..,AGAATt II chrM 413 G G 72 0 25 4 ..t,,Aag IIIH chrM 414 C C 75 0 25 4 ...a,.. III2 chrM 415 C T 75 75 25 4 TTTt,,,ATC III7 At... (4 Replies)
Discussion started by: Lucky Ali
4 Replies

8. Shell Programming and Scripting

Calculate average for repeated ID within a data

I have an awk script that gives the following output: Average end-to-end transmission delay 2.7 to 5.7 is 0.635392 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.66272 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.691712 seconds Average end-to-end transmission... (4 Replies)
Discussion started by: ENG_MOHD
4 Replies

9. Shell Programming and Scripting

Average of multiple time-stamped data every half hour

Hi All, Thank you for reading through my post and helping me figure out how I would be able to perform this task. For example: I have a list of continuous output collected into a file in the format as seen below: Date...........Time........C....A......... B ==========================... (5 Replies)
Discussion started by: terrychen
5 Replies

10. UNIX for Advanced & Expert Users

Want to get average value for each hour

I want to get CPU average value only (not required user CPU & memory) with each hours on individual date. The sample output is below | | | User |Memory| User | Date | Time |CPU %|CPU % | % |Mem % | 03/02/2015|00:00:00| 24.56| 20.66| 89.75| 63.48|... (13 Replies)
Discussion started by: Saravanan_0074
13 Replies

LEARN ABOUT DEBIAN

recins

RECINS(1)							   User Commands							 RECINS(1)

NAME

       recins - insert records in a recfile

SYNOPSIS

       recins [OPTION]... [t TYPE] [-n NUM | -e EXPR | -q STR | -m NUM] [(-f STR -v STR]|[-R RECDATA)]... [FILE]

DESCRIPTION

       Insert new records in a rec database.

       -f, --field=STR
	      field name; should be followed by a -v.

       -v, --value=STR
	      field value; should be preceded by an -f.

       -r, --record=STR
	      record that will be inserted in the file.

       --force
	      insert the record even if it is violating record restrictions.

       --no-external
	      don't use external descriptors.

       --no-auto
	      don't insert auto generated fields.

       --verbose
	      give a detailed report if the integrity check fails.

       -s, --password=STR
	      encrypt confidential fields with the given password.

       --help print a help message and exit.

       --version
	      show version and exit.

   Record selection options:
       -i, --case-insensitive
	      make strings case-insensitive in selection expressions.

       -t, --type=TYPE
	      operate on records of the specified type only.

       -e, --expression=EXPR
	      selection expression.

       -q, --quick=STR
	      select records with fields containing a string.

       -n, --number=NUM,...
	      select specific records by position, with ranges.

       -R, --random=NUM
	      select a given number of random records.

       If  no  FILE is specified then the command acts like a filter, getting the data from standard input and writing the result to standard out-
       put.

AUTHOR

       Written by Jose E. Marchesi.

REPORTING BUGS

       Report bugs to: bug-recutils@gnu.org
       GNU recutils home page: <http://www.gnu.org/software/recutils/>
       General help using GNU software: <http://www.gnu.org/gethelp/>

COPYRIGHT

       Copyright (C) 2010, 2011, 2012 Jose E. Marchesi.  License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
       This is free software: you are free to change and redistribute it.  There is NO WARRANTY, to the extent permitted by law.

SEE ALSO

       The full documentation for recins is maintained as a Texinfo manual.  If the info and recins programs are properly installed at your  site,
       the command

	      info recins

       should give you access to the complete manual.

recins 1.4.93							   January 2012 							 RECINS(1)
All times are GMT -4. The time now is 09:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy