Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Calculating Running Variance Using Awk
Top Forums Shell Programming and Scripting Calculating Running Variance Using Awk Post 302665989 by Corona688 on Tuesday 3rd of July 2012 01:33:35 PM
Old 07-03-2012
It has to recalculate the entire thing every single line, so it's not a matter of which 'tool' you use, it's just storing the data and doing the work...

Code:
awk '{ D[NR]=$0; T+=$0 }
        NR==1 { print 0 ; next }
        {        V=0
                  A=T/NR
                  for(N=1; N<=NR; N++) V+=(D[N]-A)*(D[N]-A)
                  V/=(NR-1)
                  $0 = V } 1' data

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

calculating variance in perl programming

#!/usr/bin/perl -w use strict; open(FH,"$ARGV") or die; my @temp=<FH>; close FH; my $mean = Mean(\@temp); my $var = variance(\@temp); print "$var\n"; sub estimate_variance { my ($arrayref) = @_; my ($mean,$result) = (mean($arrayref),0); foreach (@$arrayref) {... (4 Replies)
Discussion started by: cdfd123
4 Replies

2. Shell Programming and Scripting

Calculating totals in AWK

Hello, With the following small script I list the size of documents belonging to a certain user by each time selecting the bytes-field of that file ($7). Now it fills the array with every file it finds so in the end the output of some users contains up to 200.000 numbers. So how can I calculate... (7 Replies)
Discussion started by: Hille
7 Replies

3. Shell Programming and Scripting

Awk total and variance

File1 0358 Not Visible ***:* NA:NA RDF1+TDEV Grp'd (M) RW 102413 0359 Not Visible ***:* NA:NA RDF1+TDEV N/Grp'd (m) RW - 035A Not Visible ***:* NA:NA RDF1+TDEV N/Grp'd (m) RW - 035B Not Visible ***:* NA:NA ... (2 Replies)
Discussion started by: greycells
2 Replies

4. Shell Programming and Scripting

Calculating an integer with awk

I would like to extract a number from $0 and calculate if it can be devided by 25. Though the number can also be less then 25 or bigger than 100. How do i extract the number and how can the integer be calculated? String: "all_results">39</span>I am looking for the number between "all_results"> ... (5 Replies)
Discussion started by: sdf
5 Replies

5. Shell Programming and Scripting

AWK way of calculating growth

Hi All, IS there any 'awk' way to manipulate following data? Fruit Date Count Apple 20/08/2011 5 Apple 27/08/2011 7 Apple 05/09/2011 11 Apple 12/09/2011 3 Apple 19/09/2011 25 . . . . Orange 20/08/2011 9 Orange 27/08/2011 20 Orange 27/08/2011 7 Orange 05/09/2011 15 Orange... (3 Replies)
Discussion started by: aniketdixit
3 Replies

6. Shell Programming and Scripting

Calculating the epoch time from standard time using awk and calculating the duration

Hi All, I have the following time stamp data in 2 columns Date TimeStamp(also with milliseconds) 05/23/2012 08:30:11.250 05/23/2012 08:30:15.500 05/23/2012 08:31.15.500 . . etc From this data I need the following output. 0.00( row1-row1 in seconds) 04.25( row2-row1 in... (5 Replies)
Discussion started by: ks_reddy
5 Replies

7. Shell Programming and Scripting

Calculating average with awk

I need to find the average from a file like: data => BW:123 M:30 RTD:0 1 0 1 0 0 1 1 1 1 0 0 1 1 0' data => BW:123 N:30 RTD:0 1 0 1 0 0 1 1 1 1 0 0 1 1 0' data => BW:123 N:30 RTD:0 1 0 1 0 0 1 1 1 1 0 0 1 1 0' data => BW:123 N:30 RTD:0 1 0 1 0 0 1 1 1 1 0 0 1 1 0' data => BW:123 N:30 RTD:0 1... (4 Replies)
Discussion started by: Slagle
4 Replies

8. Shell Programming and Scripting

AWK sample variance

I would like to calculate 1/n In awk, I wrote the following line for the sigma summation: { summ+=($1-average)^2 } Full code: BEGIN { Print "This script calculate error estimates"; sum=0 } { sum+=$1; n++ } END { average = sum/n } BEGIN { summ=0 } { summ+=($1-average)^2 } END { print... (8 Replies)
Discussion started by: chrisjorg
8 Replies

9. Shell Programming and Scripting

Calculating the running time

Hi All, I want to run a utility for all the process id that are running for more than 15 mins. I have captured process id's and the time that they were run in a file like below 1st column represnts the process ids and the 2nd one is the Time < 21014 01:00 21099 01:00 24361 01:03 24406... (5 Replies)
Discussion started by: r_t_1601
5 Replies

10. UNIX for Beginners Questions & Answers

Calculating correlations across columns in awk

Hello, I came across a previous thread "awk-calculating-simple-correlation-rows" which calculated correlations across rows in awk. Code: awk '{ a = 0; for (i = 2; i <= NF; ++i) a += $i; a /= NF-1 b = 0; for (i = 2; i <= NF; ++i) b += ($i - a) ^ 2; b = sqrt(b) if... (7 Replies)
Discussion started by: Ross
7 Replies

LEARN ABOUT DEBIAN

cdk_position

cdk_position(3) 					     Library Functions Manual						   cdk_position(3)

NAME

       cdk_position - curses widget positioning key-bindings

SYNOPSIS

       Position methods for the Cdk widgets allow the user to move the widget around the screen via the cursor/keypad keys.

DESCRIPTION

       The following key bindings can be used to move the widget around the screen.

					    +---------------------------------------------------------------+
					    |Key	       Action					    |
					    +---------------------------------------------------------------+
					    |Up Arrow	       Moves the widget up one row.		    |
					    |Down Arrow        Moves the widget down one row.		    |
					    |Left Arrow        Moves the widget left one column 	    |
					    |Right Arrow       Moves the widget right one column	    |
					    |1		       Moves  the  widget down one row and left one |
					    |		       column.					    |
					    |2		       Moves the widget down one row.		    |
					    |3		       Moves the widget down one row and right	one |
					    |		       column.					    |
					    |4		       Moves the widget left one column 	    |
					    |5		       Centers the widget both vertically and hori- |
					    |		       zontally.				    |
					    |6		       Moves the widget right one column	    |
					    |7		       Moves the widget up one	row  and  left	one |
					    |		       column.					    |
					    |8		       Moves the widget up one row.		    |
					    |9		       Moves  the  widget  up one row and right one |
					    |		       column.					    |
					    |t		       Moves the widget to the top of the screen.   |
					    |b		       Moves  the  widget  to  the  bottom  of	the |
					    |		       screen.					    |
					    |l		       Moves the widget to the left of the screen.  |
					    |r		       Moves the widget to the right of the screen. |
					    |c		       Centers	the  widget  between  the  left and |
					    |		       right of the window.			    |
					    |C		       Centers the widget between the top and  bot- |
					    |		       tom of the window.			    |
					    |Escape	       Returns the widget to its original position. |
					    |Return	       Exits  the  function  and  leaves  the  wid- |
					    |		       getwhere it was. 			    |
					    +---------------------------------------------------------------+
					    +---------------------------------------------------------------+
       The numbers 0-9 are chosen to correspond to the numeric keypad on your terminal.  Cdk does not handle the application mode  keypad  control
       sequences, since those are not defined via terminfo.  To use the numeric keypad you should ensure that it is in normal (or NumLock) mode.

SEE ALSO

       cdk(3), cdk_binding(3), cdk_display(3), cdk_screen(3)

																   cdk_position(3)
All times are GMT -4. The time now is 04:26 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy