Get the average of lines with the same first 4 letters Post: 303021690

Sponsored Content

Top Forums Shell Programming and Scripting Get the average of lines with the same first 4 letters Post 303021690 by Don Cragun on Tuesday 14th of August 2018 07:05:02 PM

08-14-2018

Registered User

You might try something like:

Code:

awk '
function print_total() {
	printf("\nTotal Sum of %s: %d\n", last, total)
}
last != substr($1, 1, 4) {
	if(NR > 1) {
		print_total()
		printf("\n=======================\n")
	}
	last = substr($1, 1, 4)
	total = 0
}
{	print
	total += $2
}
END {	print_total()
}' hhhh

but, with the sample data you provided, I get the output:

Code:

aaa1a 1
aaa1g 2
aaa1f 3

Total Sum of aaa1: 6

=======================
baa4f 3
baa4d 4
baa4s 4

Total Sum of baa4: 11

=======================
cddg1 3
cddg3 4

Total Sum of cddg: 7

=======================
cddfg 1

Total Sum of cddf: 1

instead of what you said you wanted. The output above seems to more correctly match the title of this thread. If this isn't what you really wanted, please explain your requirements more clearly.

You should always tell us what operating system and shell you're using when you start a new thread. Otherwise, suggestions you receive might not work in your environment. In this case, if you're using a Solaris/SunOS operating system, change awk in the above suggestion to /usr/xpg4/bin/awk or nawk.

Note that using cat as you did in your sample code, eats up system resources and makes your code slower than letting awk read the file directly (as I did in my suggestion above).

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

transposing letters

Hi, I've written a shell function in bash that reads letters into an array, then outputs them in one column with: for n in "${array}"; do echo $n done I was wondering if anyone knew how i would transpose the letters that are output by the for loop. Right now my output is: aabbcc...

2. Shell Programming and Scripting

need to delete lines that start with letters

Hi, I need to remove all lines from a file that do not start with numbers For instance, if the first three characters on any line are not numbers, delete those lines I've tried to do it with awk and it's not working, any ideas ? Thanks

3. UNIX for Advanced & Expert Users

Add letters

I want to add letters A,B,C,… in front of every line of input while printing them out using PERL. eg A file is parsed as a cmd line arg and its context will be displayed as A line1... B line 2.. I tried this..but I want better and perfect solution! !perl -p my $counter; BEGIN { $counter...

4. Shell Programming and Scripting

print running field average for a set of lines

Hi everyone, I have a program that generates logs that contains sections like this: IMAGE INPUT 81 0 0.995 2449470 0 1726 368 1 0.0635 0.3291 82 0 1.001 2448013 0 1666 365 1 0.0649 0.3235 83 0 1.009 2444822 0 1697 371 1 ...

5. Shell Programming and Scripting

Perl- Finding average "frequency" of occurrence of duplicate lines

Hello, I am working with a perl script that tries to find the average "frequency" in which lines are duplicated. So far I've only managed to find the way to count how many times the lines are repeated, the code is as follows: perl -ae' my $filename= $ENV{'i'}; open (FILE, "$filename") or...

6. Shell Programming and Scripting

How to add lines of a file and average them

I'm reading in numbers from a file and trying to add them together. Here is the code so far. I know the 1+2+3.... part is wrong. The file has five numbers in it with each number on its own line. The numbers are decimals if that matters. Thanks. while read EachLine do echo $EachLine done <...

7. Shell Programming and Scripting

Randomize letters

Hi, Is there a tool somewhat parallel to rev, but which randomizes instead of reverses? I've tried rl, but I can only get it to randomize words. I was hoping for something like this echo "hello" | ran leolh less simpler solutions are also welcome. Sorry if the question is...

8. Shell Programming and Scripting

Combine identical lines and average the one variable field

I have the following file 299899 chrX_299716_300082 196 78.2903 299991 chrX_299982_300000 18.2538 Tajd:0.745591 FayWu:-0.245701 T2:1.45 299899 chrX_299716_300082 196 78.2903 299991 chrX_299982_300000 18.2538 Tajd:0.745591 FayWu:-0.245701 T2:0.283 311027 chrX_310892_311162 300 91.6452...

9. UNIX for Beginners Questions & Answers

Random letters

Hi there, first of all this is not homework...this is a new type of exercise for practicing vocabulary with my students. I have a file consisting of two columns, separated by a tab, each line consisting of a word and its definition, separated by a line break. What i need is to replace a...

10. UNIX for Beginners Questions & Answers

awk to average matching lines in file

The awk below executes and is close (producing the first 4 columns in desired). However, when I add the sum of $7, I get nothing returned. Basically, I am trying to combine all the matching $4 in f1 and output them with the average of $7 in each match. Thank you :). f1 ...

LEARN ABOUT V7

pgmtexture

pgmtexture(1)						      General Commands Manual						     pgmtexture(1)

NAME

       pgmtexture - calculate textural features on a portable graymap

SYNOPSIS

       pgmtexture [-d d] [pgmfile]

DESCRIPTION

       Reads  a  portable graymap as input.  Calculates textural features based on spatial dependence matrices at 0, 45, 90, and 135 degrees for a
       distance d (default = 1).  Textural features include:

	      (1) Angular Second Moment,
	      (2) Contrast,
	      (3) Correlation,
	      (4) Variance,
	      (5) Inverse Difference Moment,
	      (6) Sum Average,
	      (7) Sum Variance,
	      (8) Sum Entropy,
	      (9) Entropy,
	      (10) Difference Variance,
	      (11) Difference Entropy,
	      (12, 13) Information Measures of Correlation, and
	      (14) Maximal Correlation Coefficient.

       Algorithm taken from:
       Haralick, R.M., K. Shanmugam, and I. Dinstein. 1973. Textural features for image classification.  IEEE Transactions on  Systems,  Man,  and
       Cybertinetics, SMC-3(6):610-621.

BUGS

       The  program  can  run incredibly slow for large images (larger than 64 x 64) and command line options are limited.  The method for finding
       (14) the maximal correlation coefficient, which requires finding the second largest eigenvalue of a matrix Q, does not always converge.

REFERENCES

       IEEE Transactions on Systems, Man, and Cybertinetics, SMC-3(6):610-621.

SEE ALSO

       pgm(5), pnmcut(1)

AUTHOR

       Copyright (C) 1991 by Texas Agricultural Experiment Station, employer for hire of James Darrell McCauley.

								    22 Aug 1991 						     pgmtexture(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

transposing letters

Discussion started by: myscsa2004

2. Shell Programming and Scripting

need to delete lines that start with letters

Discussion started by: sfisk

3. UNIX for Advanced & Expert Users

Add letters

Discussion started by: aadi_uni

4. Shell Programming and Scripting

print running field average for a set of lines

Discussion started by: euval