Sponsored Content
Top Forums Shell Programming and Scripting Counting average data per hour Post 302373023 by ghostdog74 on Thursday 19th of November 2009 08:31:57 AM
Old 11-19-2009
Python, if you have it
Code:
#!/usr/bin/env python

d={}
e={}
f=open("file")
line=f.readline()
for li in f:
    s = li.split()
    year,mth,day=s[0][:4],s[0][4:6],s[0][6:8]
    ti = s[1][:2]
    STR= day+"-"+mth+"-"+year+" "+ti
    d.setdefault(STR,[])
    e.setdefault(STR,[])
    rss,pcpu=s[7],s[8]
    d[STR].append(rss)
    e[STR].append(pcpu)
f.close()

for date,values in d.iteritems():
    print date, sum(map(int,values))/len(values), sum(map(int,e[date]))/len(e[date])

output
Code:
# python script.py 
16-11-2009 09 1682302 1403367
16-11-2009 08 1667231 1380012
16-11-2009 07 1646110 1342177

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

generating data for 1 hour

Hi Folks, The reqirement is that i need to generate 1 hr file with a time interval of five minutes.. For ex: my i/p is 0000-0000 and desired o/p is 0000-0005 0005-0010 0010-0015 0015-0020 0020-0025 0025-0030 0030-0035 0040-0045 0050-0055 0055-0100 Script neede urgent ... (0 Replies)
Discussion started by: aajan
0 Replies

2. Shell Programming and Scripting

How can i grep for an hour before data

Hi, My log file is something like this. (08/04/2009 00:27:42.179)(:) aaaaaaaaaaaa (08/04/2009 00:27:42.181)(:) bbbbbbbbbbbbbbbb (08/04/2009 01:00:42.713)(:) cd cdc d ddddsksjdkssksksj (08/04/2009 01:02:42.716)(:) raarrarararararara (08/04/2009 01:07:43.036)(:ERROR) Port... (8 Replies)
Discussion started by: rdhanek
8 Replies

3. UNIX for Advanced & Expert Users

filter last 24 hour data and put in new file

i have file server 1 (filesvr01acess.log) and disc server 1 (discsvr01acess.log) in unix box(say ip adress of the box 10.39.66.81) Similiarly i have file server 2 (filesvr01acess.log) and disc server 2(discsvr01acess.log) in another unix box(say ip adress of the box 10.39.66.82). Now my... (1 Reply)
Discussion started by: nripa1
1 Replies

4. Shell Programming and Scripting

counting word xx referred to a time period, like minute or hour

Hello, I try to insert a post because I've got a trouble to perform a unix job. But I didn't found which steps (procedure) I should follow. Could you help me? I got a log by my Application box, like following: gbosmam037:test >view Log_Server.csv ... (2 Replies)
Discussion started by: maluca68
2 Replies

5. UNIX for Dummies Questions & Answers

Load average spikes once an hour

Hi, I am getting a high load average, around 7, once an hour. It last for about 4 minutes and makes things fairly unusable for this time. How do I find out what is using this. Looking at top the only thing running at the time is md5sum. I have looked at the crontab and there is nothing... (10 Replies)
Discussion started by: sm9ai
10 Replies

6. Shell Programming and Scripting

return counting per hour percentage

We have a monitoring process for a load in unix box, during this process we are writing logs statements for each record, and during this process we are showing the counts per hour. Here is that how we are following log files statements: (just two lines printed here), these statements logged at... (1 Reply)
Discussion started by: skkuchipudi
1 Replies

7. Shell Programming and Scripting

Data counting

I have a large tab delimited text file with 10 columns for example chrM 412 A A 75 0 25 2 ..,AGAATt II chrM 413 G G 72 0 25 4 ..t,,Aag IIIH chrM 414 C C 75 0 25 4 ...a,.. III2 chrM 415 C T 75 75 25 4 TTTt,,,ATC III7 At... (4 Replies)
Discussion started by: Lucky Ali
4 Replies

8. Shell Programming and Scripting

Calculate average for repeated ID within a data

I have an awk script that gives the following output: Average end-to-end transmission delay 2.7 to 5.7 is 0.635392 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.66272 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.691712 seconds Average end-to-end transmission... (4 Replies)
Discussion started by: ENG_MOHD
4 Replies

9. Shell Programming and Scripting

Average of multiple time-stamped data every half hour

Hi All, Thank you for reading through my post and helping me figure out how I would be able to perform this task. For example: I have a list of continuous output collected into a file in the format as seen below: Date...........Time........C....A......... B ==========================... (5 Replies)
Discussion started by: terrychen
5 Replies

10. UNIX for Advanced & Expert Users

Want to get average value for each hour

I want to get CPU average value only (not required user CPU & memory) with each hours on individual date. The sample output is below | | | User |Memory| User | Date | Time |CPU %|CPU % | % |Mem % | 03/02/2015|00:00:00| 24.56| 20.66| 89.75| 63.48|... (13 Replies)
Discussion started by: Saravanan_0074
13 Replies
ps(1B)						     SunOS/BSD Compatibility Package Commands						    ps(1B)

NAME
ps - display the status of current processes SYNOPSIS
/usr/ucb/ps [-aceglnrSuUvwx] [-t term] [num] DESCRIPTION
The ps command displays information about processes. Normally, only those processes that are running with your effective user ID and are attached to a controlling terminal (see termio(7I)) are shown. Additional categories of processes can be added to the display using vari- ous options. In particular, the -a option allows you to include processes that are not owned by you (that do not have your user ID), and the -x option allows you to include processes without controlling terminals. When you specify both -a and -x, you get processes owned by anyone, with or without a controlling terminal. The -r option restricts the list of processes printed to running and runnable processes. ps displays in tabular form the process ID, under PID; the controlling terminal (if any), under TT; the cpu time used by the process so far, including both user and system time, under TIME; the state of the process, under S; and finally, an indication of the COMMAND that is running. The state is given by a single letter from the following: O Process is running on a processor. S Sleeping. Process is waiting for an event to complete. R Runnable. Process is on run queue. Z Zombie state. Process terminated and parent not waiting. T Traced. Process stopped by a signal because parent is tracing it. OPTIONS
The following options must all be combined to form the first argument: -a Includes information about processes owned by others. -c Displays the command name rather than the command arguments. -e Displays the environment as well as the arguments to the command. -g Displays all processes. Without this option, ps only prints interesting processes. Processes are deemed to be uninteresting if they are process group leaders. This normally eliminates top-level command interpreters and processes waiting for users to login on free terminals. -l Displays a long listing, with fields F, PPID, CP, PRI, NI, SZ, RSS, and WCHAN as described below. -n Produces numerical output for some fields. In a user listing, the USER field is replaced by a UID field. -r Restricts output to running and runnable processes. -S Displays accumulated CPU time used by this process and all of its reaped children. -t term Lists only process data associated with the terminal, term. Terminal identifiers may be specified in one of two forms: the device's file name (for example, tty04 or term/14 ) or, if the device's file name starts with tty, just the digit identifier (for example, 04). -u Displays user-oriented output. This includes fields USER, %CPU, %MEM, SZ, RSS, and START as described below. -U Obsolete. This option no longer has any effect. It causes ps to exit without printing the process listing. -v Displays a version of the output containing virtual memory. This includes fields SIZE, %CPU, %MEM, and RSS, described below. -w Uses a wide output format (132 columns rather than 80). If the option letter is repeated, that is, -ww, uses arbitrarily wide out- put. This information is used to decide how much of long commands to print. -x Includes processes with no controlling terminal. num A process number may be given, in which case the output is restricted to that process. This option must be supplied last. DISPLAY FORMATS
Fields that are not common to all output formats: USER Name of the owner of the process. %CPU CPU use of the process. This is a decaying average over up to a minute of previous (real) time. NI Process scheduling increment (see getpriority(3C) and nice(3UCB)). SIZE The total size of the process in virtual memory, including all mapped files and devices, in kilobyte units. SZ Same as SIZE. RSS Real memory (resident set) size of the process, in kilobyte units. UID Numerical user-ID of process owner. PPID Numerical ID of parent of process. CP Short-term CPU utilization factor (used in scheduling). PRI The priority of the process (higher numbers mean lower priority). START The starting time of the process, given in hours, minutes, and seconds. A process begun more than 24 hours before the ps inquiry is executed is given in months and days. WCHAN The address of an event for which the process is sleeping (if blank, the process is running). %MEM The ratio of the process's resident set size to the physical memory on the machine, expressed as a percentage. F Flags (hexadecimal and additive) associated with the process. These flags are available for historical purposes; no meaning should be currently ascribed to them. A process that has exited and has a parent, but has not yet been waited for by the parent, is marked <defunct>; otherwise, ps tries to determine the command name and arguments given when the process was created by examining the user block. FILES
/dev/tty* /etc/passwd UID information supplier ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWscpu | +-----------------------------+-----------------------------+ SEE ALSO
kill(1), ps(1), whodo(1M), getpriority(3C), nice(3UCB), proc(4), attributes(5), termio(7I) NOTES
Things can change while ps is running. The picture ps gives is only a close approximation to the current state. Some data printed for defunct processes is irrelevant. SunOS 5.10 29 Mar 2002 ps(1B)
All times are GMT -4. The time now is 08:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy