Sponsored Content
Top Forums Shell Programming and Scripting calculate the average of time series data using AWK Post 302272960 by nica on Friday 2nd of January 2009 03:04:45 AM
Old 01-02-2009
Thanks summer_cherry,

But your code does not work what I expected.

Since V2 is a counter, I just want to take the highest count of V2.
for example:

1,1,1,2,3,1,2,1,1,1 = 1,1,3,2,1,1,1 (desired output for new V2)
1,2,3,4,5,6,7,1,1,1 = 7,1,1,1
1,2,3,4,1,1,1,2,1,2 = 4,1,1,2,2

Then, I want to collect the value of V1 and V2 (with highest count) which have same t1 and t2 (e.g. 10.200000 = 10.252770182 )


Input File: Desired Output:

t1 V1 t2 V2 t1 V1 V2
10.000000 4.387413 10.139355302 1
10.100000 4.397372 10.252770182 2 ------> 10.200000 4.406951 2
10.200000 4.406951 10.398060182 1 ------> 10.300000 3.940732 1
10.300000 3.940732 10.515105302 1 ------> 10.500000 4.139778 1
10.400000 4.044359 10.645365302 1
10.500000 4.139778 10.768800182 2
10.600000 4.222087 10.929725222 3 -------> 10.900000 3.081282 3
10.700000 4.299174 11.106285302 1 -------> 11.100000 3.354575 1
10.800000 2.941378 11.216505302 1
10.900000 3.081282 11.324910182 2
11.000000 3.219284 11.626115222 3
11.100000 3.354575 11.822715302 4
11.200000 3.486347 11.968005302 5 -------> 11.900000 4.234293 5
11.300000 3.613792 12.107075222 1 -------> ............
11.400000 3.730119 12.233535302 1 -------> ............
11.500000 3.846800 12.377615222 1 -------> ............
11.600000 3.956768 12.494055302 1 -------> ............
11.700000 4.059215 12.642540182 1 -------> ............
11.800000 4.153333 12.742740182 1 -------> ............
11.900000 4.234293 12.853565222 1 -------> ............
12.000000 4.309844 13.093440182 1 -------> ............ so on...
..............
..............

I hope you can understand what I expect..

Thanks
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Use awk to calculate average of column 3

Suppose I have 500 files in a directory and I need to Use awk to calculate average of column 3 for each of the file, how would I do that? (6 Replies)
Discussion started by: grossgermany
6 Replies

2. HP-UX

calculate average of multiple line data

I have a question as below and i need to write a shell or perl script for this query:My Input file looks like below RNo Marks 12 50 15 70 18 80 12 40 13 55 18 88 13 75... (4 Replies)
Discussion started by: smacherla
4 Replies

3. UNIX for Dummies Questions & Answers

Iterate a min/max awk script over time-series temperature data

I'm trying to iterate a UNIX awk script that returns min/max temperature data for each day from a monthly weather data file (01_weath.dat). The temperature data is held in $5. The temps are reported each minute so each day contains 1440 temperature enteries. The below code has gotten me as far as... (5 Replies)
Discussion started by: jgourley
5 Replies

4. Shell Programming and Scripting

Calculate average time using a script

Hello, I'm hoping to get some help on calculating an average time from a list of times (hour:minute:second). Here's what my list looks like right now, it will grow (I can get the full date or change the formatting of this as well): 07:55:31 09:42:00 08:09:02 09:15:23 09:27:45 09:49:26... (4 Replies)
Discussion started by: jaredhanks
4 Replies

5. Shell Programming and Scripting

AWK novice - calculate the average

Hi, I have the following data in a file for example: P1 XXXXXXX.1 YYYYYYY.1 ZZZ.1 P1 XXXXXXX.2 YYYYYYY.2 ZZZ.2 P1 XXXXXXX.3 YYYYYYY.3 ZZZ.3 P1 XXXXXXX.4 YYYYYYY.4 ZZZ.4 P1 XXXXXXX.5 YYYYYYY.5 ZZZ.5 P1 XXXXXXX.6 YYYYYYY.6 ZZZ.6 P1 XXXXXXX.7 YYYYYYY.7 ZZZ.7 P1 XXXXXXX.8 YYYYYYY.8 ZZZ.8 P2... (6 Replies)
Discussion started by: alex2005
6 Replies

6. Shell Programming and Scripting

Calculate Average AWK

I want to calculate the average line by line of some files with several lines on them, the files are identical, just want to average the 3rd columns of those files.:wall: Example file: File 1 001 0.046 0.667267 001 0.047 0.672028 001 0.048 0.656025 001 0.049 ... (2 Replies)
Discussion started by: AriasFco
2 Replies

7. Shell Programming and Scripting

Calculate average for repeated ID within a data

I have an awk script that gives the following output: Average end-to-end transmission delay 2.7 to 5.7 is 0.635392 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.66272 seconds Average end-to-end transmission delay 2.1 to 5.1 is 0.691712 seconds Average end-to-end transmission... (4 Replies)
Discussion started by: ENG_MOHD
4 Replies

8. Programming

Resample time series data with replacement any way to do this in awk or just bash script

I have some time series data that I need to resample or downsample at some specific time intervals. The firs column is time in decimal hours. I am tryiong to resample this data every 3 minutse. So I need a data value ever 0.05. Here is the example data and as you can see, there time slot for 0.1500... (3 Replies)
Discussion started by: malandisa
3 Replies

9. Shell Programming and Scripting

Average of multiple time-stamped data every half hour

Hi All, Thank you for reading through my post and helping me figure out how I would be able to perform this task. For example: I have a list of continuous output collected into a file in the format as seen below: Date...........Time........C....A......... B ==========================... (5 Replies)
Discussion started by: terrychen
5 Replies

10. Shell Programming and Scripting

Calculate Average time of one column

Hello dears, I have a log file with records like below and want to get a average of one column based on the search of one specific keyword. 2015-02-07 08:15:28 10.102.51.100 10.112.55.101 "kevin.c" POST ... (2 Replies)
Discussion started by: Newman
2 Replies
timed(8)						      System Manager's Manual							  timed(8)

Name
       timed - time server daemon

Syntax
       /usr/etc/timed [ -i | -n network ][ -E ][ -M ][ -t ]

Description
       The  daemon  synchronizes a host's time with the time of other machines in a local area network running It is normally invoked at boot time
       from the file.

       Servers running slow down the clocks of some machines and speed up the clocks of others to bring them all to the average network time.  The
       average	network  time is computed from measurements of clock differences with the Internet Communication Message Protocol (ICMP) timestamp
       request message.

       The service provided by is based on a master-slave scheme.  When is started on a machine, it asks the master for the network time and  sets
       the host's clock to that time.  After that, it accepts synchronization messages periodically sent by the master and calls the or routine to
       perform any corrections on the host's clock.

       It also communicates with the command to set the date globally, and with the control program, If the machine running  the  master  crashes,
       then  the  slaves  elect  a new master from among slaves running with the flag set.  The flag provides time synchronization on any attached
       networks where no current master server is detected.  Such a server propagates the time computed by the top-level  master.   At	least  one
       daemon on each network must run with the option set to allow it to become a master.

Options
       -E     Overrides  the input of slaves.  Use the flag in conjunction with the flag.  It specifies that a master should not average the times
	      of the slaves to calculate the network time but should distribute the time of its local host as the network time.  This flag  allows
	      a master to distribute time to a network while the network time is controlled by an outside agent such as the Network Time Protocol.

       [-i | -n] network

	      -i     Specifies	a  network  to ignore.	Each network that appears as an argument to the flag is added to the list of networks that
		     will ignore.  If the flag is used, accesses all networks to which the host is connected except for those  networks  specified
		     as arguments to the flag.

	      -n     Specifies a network to use.  When the is started, it gathers information about all the network devices connected to the local
		     host.  If neither the flag nor the flag is used, tries to access all the network devices connected to the	local  host.   The
		     network argument to the flag is the name of a network that should access.

		     If the switch is used, only those networks specified by the flag are accessed.

		     Do not use the and flags together.

       -M     Allows  a  slave	time  server to become a master time server if the master server crashes.  A system running the daemon without the
	      flag set remains a slave.  The daemon checks for a master time server on each network to which it is connected.	It  requests  syn-
	      chronization service from the first master server it locates.

       -t     Enables to trace the messages it receives in the file Tracing can be enabled or disabled with the program.

Restrictions
       Any  system  running with the and options set is eligible to become the master, and distribute its local time to all systems running on its
       network.  Run the Network Time Protocol daemon, instead of to prevent this behavior.

Files
       Invokes the			  daemon each time the system boots

       Tracing file for

       Log file for master

See Also
       date(1), adjtime(2), gettimeofday(2), networks(5), ntpd(8), timedc(8)
       Introduction to Networking and Distributed System Services

																	  timed(8)
All times are GMT -4. The time now is 04:02 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy