12-23-2008
calculate the average of time series data using AWK
Hi,
I have two time series data (below) merged into a file.
t1 and t2 are in unit of second
I want to calculate the average of V1 every second and count how many times "1" in V2 is occur within a second
Input File:
t1 V1 t2 V2
10.000000 4.387413 10.139355302 1
10.100000 4.397372 10.252770182 1
10.200000 4.406951 10.398060182 1
10.300000 3.940732 10.515105302 1
10.400000 4.044359 10.645365302 1
10.500000 4.139778 10.768800182 1
10.600000 4.222087 10.929725222 1
10.700000 4.299174 11.106285302 1
10.800000 2.941378 11.216505302 1
10.900000 3.081282 11.324910182 1
11.000000 3.219284 11.626115222 1
11.100000 3.354575 11.822715302 1
11.200000 3.486347 11.968005302 1
11.300000 3.613792 12.107075222 1
11.400000 3.730119 12.233535302 1
11.500000 3.846800 12.377615222 1
11.600000 3.956768 12.494055302 1
11.700000 4.059215 12.642540182 1
11.800000 4.153333 12.742740182 1
11.900000 4.234293 12.853565222 1
12.000000 4.309844 13.093440182 1
12.100000 2.107283 13.209275222 1
12.200000 2.234828 13.343940182 1
12.300000 2.371988 13.471005302 1
12.400000 2.511328 13.635125222 1
12.500000 2.652041 13.824900182 1
12.600000 2.793317 13.955160182 1
12.700000 2.934348 14.082225302 1
12.800000 3.067364 14.185620182 1
12.900000 3.205592 14.302665302 1
13.000000 4.130738 14.421090182 1
13.100000 3.929949 14.707265222 1
13.200000 2.160613 14.828715302 1
13.300000 2.296229 14.938935302 1
13.400000 2.434470 15.114285302 1
13.500000 2.574528 15.242730182 1
13.600000 3.865811 15.485025302 1
13.700000 4.273357 15.660375302 1
13.800000 4.357861 15.895845302 1
13.900000 4.371735 16.034310182 1
14.000000 4.377158 16.150145222 1
..............
..............
Desired Output:
t1 V1 V2
10.000000 3.986053 7
11.000000 3.765453 6
12.000000 2.818793 7
13.000000 3.439529 7
...............
...............
Please, can anyone tell me AWK code for calculating this..??
Thanks
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Suppose I have 500 files in a directory and I need to Use awk to calculate average of column 3 for each of the file, how would I do that? (6 Replies)
Discussion started by: grossgermany
6 Replies
2. HP-UX
I have a question as below and i need to write a shell or perl script for this query:My Input file looks like below
RNo Marks
12 50
15 70
18 80
12 40
13 55
18 88
13 75... (4 Replies)
Discussion started by: smacherla
4 Replies
3. UNIX for Dummies Questions & Answers
I'm trying to iterate a UNIX awk script that returns min/max temperature data for each day from a monthly weather data file (01_weath.dat). The temperature data is held in $5. The temps are reported each minute so each day contains 1440 temperature enteries. The below code has gotten me as far as... (5 Replies)
Discussion started by: jgourley
5 Replies
4. Shell Programming and Scripting
Hello,
I'm hoping to get some help on calculating an average time from a list of times (hour:minute:second).
Here's what my list looks like right now, it will grow (I can get the full date or change the formatting of this as well):
07:55:31
09:42:00
08:09:02
09:15:23
09:27:45
09:49:26... (4 Replies)
Discussion started by: jaredhanks
4 Replies
5. Shell Programming and Scripting
Hi,
I have the following data in a file for example:
P1 XXXXXXX.1 YYYYYYY.1 ZZZ.1
P1 XXXXXXX.2 YYYYYYY.2 ZZZ.2
P1 XXXXXXX.3 YYYYYYY.3 ZZZ.3
P1 XXXXXXX.4 YYYYYYY.4 ZZZ.4
P1 XXXXXXX.5 YYYYYYY.5 ZZZ.5
P1 XXXXXXX.6 YYYYYYY.6 ZZZ.6
P1 XXXXXXX.7 YYYYYYY.7 ZZZ.7
P1 XXXXXXX.8 YYYYYYY.8 ZZZ.8
P2... (6 Replies)
Discussion started by: alex2005
6 Replies
6. Shell Programming and Scripting
I want to calculate the average line by line of some files with several lines on them, the files are identical, just want to average the 3rd columns of those files.:wall:
Example file:
File 1
001 0.046 0.667267
001 0.047 0.672028
001 0.048 0.656025
001 0.049 ... (2 Replies)
Discussion started by: AriasFco
2 Replies
7. Shell Programming and Scripting
I have an awk script that gives the following output:
Average end-to-end transmission delay 2.7 to 5.7 is 0.635392 seconds
Average end-to-end transmission delay 2.1 to 5.1 is 0.66272 seconds
Average end-to-end transmission delay 2.1 to 5.1 is 0.691712 seconds
Average end-to-end transmission... (4 Replies)
Discussion started by: ENG_MOHD
4 Replies
8. Programming
I have some time series data that I need to resample or downsample at some specific time intervals. The firs column is time in decimal hours. I am tryiong to resample this data every 3 minutse. So I need a data value ever 0.05. Here is the example data and as you can see, there time slot for 0.1500... (3 Replies)
Discussion started by: malandisa
3 Replies
9. Shell Programming and Scripting
Hi All,
Thank you for reading through my post and helping me figure out how I would be able to perform this task.
For example: I have a list of continuous output collected into a file in the format as seen below:
Date...........Time........C....A......... B
==========================... (5 Replies)
Discussion started by: terrychen
5 Replies
10. Shell Programming and Scripting
Hello dears,
I have a log file with records like below and want to get a average of one column based on the search of one specific keyword.
2015-02-07 08:15:28 10.102.51.100 10.112.55.101 "kevin.c" POST ... (2 Replies)
Discussion started by: Newman
2 Replies
LEARN ABOUT OPENSOLARIS
time
time(1T) Tcl Built-In Commands time(1T)
__________________________________________________________________________________________________________________________________________________
NAME
time - Time the execution of a script
SYNOPSIS
time script ?count?
_________________________________________________________________
DESCRIPTION
This command will call the Tcl interpreter count times to evaluate script (or once if count isn't specified). It will then return a string
of the form
503 microseconds per iteration
which indicates the average amount of time required per iteration, in microseconds. Time is measured in elapsed time, not CPU time.
EXAMPLE
Estimate how long it takes for a simple Tcl for loop to count to a thousand:
time {
for {set i 0} {$i<1000} {incr i} {
# empty body
}
}
SEE ALSO
clock(1T)
KEYWORDS
script, time
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+--------------------+-----------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+--------------------+-----------------+
|Availability | SUNWTcl |
+--------------------+-----------------+
|Interface Stability | Uncommitted |
+--------------------+-----------------+
NOTES
Source for Tcl is available on http://opensolaris.org.
Tcl time(1T)