Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Compute average ignoring outliers of different segments within a dat file using awk
Top Forums Shell Programming and Scripting Compute average ignoring outliers of different segments within a dat file using awk Post 302918000 by shamrock on Friday 19th of September 2014 04:33:56 PM
Old 09-19-2014
Quote:
Originally Posted by malandisa
and the problem I see here is if indeed val is a string created from the values of column 2each value separated by comma, how does the following part of the code work?
Code:
sum[i] -= val[i]

sum is a number and val is a string? Sorry for so many questions I am new to awk and I really want to learn it.
Good catch...it should be sum[i] -= a[k] and I did it run the modified code on "temp.txt" and it gave me no such errors...
Last edited by shamrock; 09-19-2014 at 05:41 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

[Splitting file] Extracting group of segments from one file to others

Hi there, I need to split one huge file into separate files if the condition is fulfilled according to that the position between 97 and 98 matches with “IT” at the segment MAS. There is no delimiter file is fix-width with varous line length. Could you please help me how I do split the file... (1 Reply)
Discussion started by: ozgurgul
1 Replies

2. Shell Programming and Scripting

using awk to print average and standard deviation into a file

Hi I want to use awk to print avg and st deviation but it does not go into a file for column 1 only. I can do average and # of records but i cannot get st deviation. awk '{sum+=$1} END { print "Average = ",sum/NR}' thanks (1 Reply)
Discussion started by: phil_heath
1 Replies

3. Shell Programming and Scripting

Compute the median of a set of numbers with AWK?

Is there a way in awk to compute the median of a set of numbers in a file in the following format. 34 67 78 100 23 45 67 (3 Replies)
Discussion started by: Lucky Ali
3 Replies

4. Shell Programming and Scripting

Remove interspersed headers in .dat file with AWK

Heya there, A small selection of my data is shown below. DATE TIME FRAC_DAYS_SINCE_JAN1 2011-06-25 08:03:20.000 175.33564815 2011-06-25 08:03:25.000 175.33570602 2011-06-25 ... (4 Replies)
Discussion started by: gd9629
4 Replies

5. Shell Programming and Scripting

awk based script to find the average of all the columns in a data file

Hi All, I need the modification for the below mentioned code (found in one more post https://www.unix.com/shell-programming-scripting/27161-script-generate-average-values.html) to find the average values for all the columns(but for a specific rows) and print the averages side by side. I have... (4 Replies)
Discussion started by: ks_reddy
4 Replies

6. Shell Programming and Scripting

awk command on .DAT file not working?

Hi All, I am trying to run awk command on .DAT file and it is not working. The same command is working on .txt file: Contents of the file ZZ_55555555_444444_ZZZZZZ_7777777_888_99.DAT: HEADER|ZZ_55555555_444444_ZZZZZZ_7777777_888_99.DAT... (10 Replies)
Discussion started by: sagar.cumar
10 Replies

7. Shell Programming and Scripting

Average, min and max in file with header, using awk

Hi, I have a file which looks like this: FID IID MISS_PHENO N_MISS N_GENO F_MISS 12AB43131 12AB43131 N 17774 906341 0.01961 65HJ87451 65HJ87451 N 10149 906341 0.0112 43JJ21345 43JJ21345 N 2826 906341 0.003118I would... (11 Replies)
Discussion started by: kayakj
11 Replies

8. Shell Programming and Scripting

Shell or awk script to compute average of all the points within a circle

HI Help, I have a file which looks like below --- Input file ---> 1970113.00000 3460.00000 1.09516 1970116.00000 3791.00000 1.06350 1970120.00000 4120.00000 1.07588 1970115.00000 4450.00000 1.09591 1970116.00000 4780.00000 1.09965 1970120.00000 5109.00000 1.06733 ... (7 Replies)
Discussion started by: Indra2011
7 Replies

9. Shell Programming and Scripting

Compute average based on field values

Im looking for a way to average the values in field 14 (when field 2 is equal to 2016) and fields 3 and 4 (when field 2 is equal to 2017). Any help is appreciated. 001001 2016 33.22 38.19 48.07 51.75 59.77 67.68 70.86 72.21 66.92 53.67 42.31 40.15 001001 2017 ... (10 Replies)
Discussion started by: ncwxpanther
10 Replies

10. UNIX for Beginners Questions & Answers

awk to average matching lines in file

The awk below executes and is close (producing the first 4 columns in desired). However, when I add the sum of $7, I get nothing returned. Basically, I am trying to combine all the matching $4 in f1 and output them with the average of $7 in each match. Thank you :). f1 ... (2 Replies)
Discussion started by: cmccabe
2 Replies

LEARN ABOUT OPENSOLARIS

sum

sum(1)								   User Commands							    sum(1)

NAME

       sum - print checksum and block count for a file

SYNOPSIS

       sum [-r] [file]...

DESCRIPTION

       The   sum utility calculates and prints a 16-bit checksum for the named file and the number of 512-byte blocks in the file. It is typically
       used to look for bad spots, or to validate a file communicated over some transmission line.

OPTIONS

       The following options are supported:

       -r    Use an alternate (machine-dependent) algorithm in computing the checksum.

OPERANDS

       The following operands are supported:

       file    A path name of a file.  If no files are named, the standard input is used.

USAGE

       See largefile(5) for the description of the behavior of sum when encountering files greater than or equal to 2 Gbyte ( 2^31 bytes).

ENVIRONMENT VARIABLES

       See environ(5) for descriptions of the following environment variables that affect  the	execution  of	sum:  LC_CTYPE,  LC_MESSAGES,  and
       NLSPATH.

EXIT STATUS

       The following exit values are returned.

       0     Successful completion.

       >0    An error occurred.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------------------------------------+
       |      ATTRIBUTE TYPE		    ATTRIBUTE VALUE	   |
       |Availability		      SUNWesu			   |
       |CSI			      Enabled			   |
       +-----------------------------------------------------------+

SEE ALSO

       cksum(1), sum(1B), wc(1), attributes(5), environ(5), largefile(5)

DIAGNOSTICS

       Read error is indistinguishable from end of file on most devices. Check the block count.

NOTES

       Portable applications should use cksum(1).

       sum and usr/ucb/sum (see sum(1B)) return different checksums.

SunOS 5.11							    7 Nov 1995								    sum(1)
All times are GMT -4. The time now is 06:35 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy