Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Min/max/total for selected columns based on first column as ID Post 303045489 by jiam912 on Friday 27th of March 2020 02:23:58 PM
Old 03-27-2020
Min/max/total for selected columns based on first column as ID

For every ID in column one, I want to get the min/max/total for each ID.


The values in different columns are not sorted, the actual attempt, works only if the columns are sorted.


input file
Code:
2010  1  44413               41105.0 21.75 146  
2010  1  44415               41105.0 21.75 146  
2010  1  44417               41105.0 21.75 100  
2010  1  44419               41105.0 28.00 146 
2010  1  50000               41105.0 21.75 200  
2010  1  44423               41105.0 21.75 146  
2011  1  44425               41105.0 21.75 146  
2011  1  44427               41105.0 20.00 146  
2011  1  70000               41105.0 21.75 146  
2011  1  44433               41105.0 29.00 700  
2011  1  44435               41105.0 21.00 146  
2012  1  44437               41105.0 21.75 146  
2012  1  20000               41105.0 21.75 150  
2012  1  44441               41105.0 21.75 146  
2012  1  90000               41105.0 21.75 146  
2012  1  44445               41105.0 21.75 600  
2012  1  44447               41105.0 21.75 146  
2012  1  44447               41105.0 21.75 146

attempt

Code:
 awk '{ currKey = $1 }
    currKey != prevKey { prt(); min=$3;min1=$5;min2=$6;cnt=0}
    { prevRec=$0; prevKey=currKey; max=$3;max1=$10;max2=$6; cnt++ }
      { prevKey=currKey; TOTAL+=$6}    
    END { prt() }
    function prt(   f) {
        if ( cnt ) {
        split(prevRec,f)
        print f[1],min,max,min1,max1,min2,max2,TOTAL, cnt
        }
    }' file | column -t

output from attempt
Code:
2010  44413  44423  21.75  21.75  146  146  884   6
2011  44425  44435  21.75  21.00  146  146  2668  5
2012  44437  44447  21.75  21.75  146  146  4002  7

output desired
Code:
2010  44413  50000  21.75  28.00  100  200  884   6
2011  44425  70000  20.00  29.00  146  700  1284  5
2012  20000  90000  21.75  21.75  146  600  1280  7

Appreciate your support

Last edited by jiam912; 03-27-2020 at 07:14 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sorting csv file based on column selected

Hi all, in my csv file it'll look like this, and of course it may have more columns US to UK;abc-hq-jcl;multimedia UK to CN;def-ny-jkl;standard DE to DM;abc-ab-klm;critical FD to YM;la-yr-tym;standard HY to MC;la-yr-ytm;multimedia GT to KJ;def-ny-jrt;critical I would like to group... (4 Replies)
Discussion started by: tententen
4 Replies

2. Shell Programming and Scripting

Find min.max value if matching columns found using AWK

Input_ File : 2 3 4 5 1 1 0 1 2 1 -1 1 2 1 3 1 3 1 4 1 6 5 6 6 6 6 6 7 6 7 6 8 5 8 6 7 Desired output : 2 3 4 5 -1 1 4 1 6 5 6 8 5 8 6 7 (3 Replies)
Discussion started by: vasanth.vadalur
3 Replies

3. Shell Programming and Scripting

AWK script - extracting min and max values from selected lines

Hi guys! I'm new to scripting and I need to write a script in awk. Here is example of file on which I'm working ATOM 4688 HG1 PRO A 322 18.080 59.680 137.020 1.00 0.00 ATOM 4689 HG2 PRO A 322 18.850 61.220 137.010 1.00 0.00 ATOM 4690 CD ... (18 Replies)
Discussion started by: grincz
18 Replies

4. Shell Programming and Scripting

How to find the average,min,max ,total count?

Hi , Below is my sample data,I have this 8 column(A,B,C,D,E,F,G,H) in csv file. A , B ,C ,D ,E ,F,G ,H 4141,127337,24,15,20,69,72.0,-3 4141,128864,24,15,20,65,66.0,-1 4141,910053,24,15,4,4,5.0,-1 4141,910383,24,15,22,3,4.0,-1 4141,496969,24,15,14,6,-24.0,-18... (7 Replies)
Discussion started by: vinothsekark
7 Replies

5. Shell Programming and Scripting

to find min and max value for each column!

Hello Experts, I have got a txt files which has multiple columns, I want to get the max, min and diff (max-min) for each column in the same txt file. Example: cat file.txt a 1 4 b 2 5 c 3 6 I want ouput like: cat file.txt a 1 4 b 2 5 c 3 6 Max 3 6 Min 1 4 Diff 2 2 awk 'min=="" ||... (4 Replies)
Discussion started by: dixits
4 Replies

6. UNIX for Dummies Questions & Answers

[Solved] Print a line using a max and a min values of different columns

Hi guys, I already search on the forum but i can't solve this on my own. I have a lot of files like this: And i need to print the line with the maximum value in last column but if the value is the same (2 in this exemple for the 3 last lines) i need get the line with the minimum value in... (4 Replies)
Discussion started by: MetaBolic0
4 Replies

7. Shell Programming and Scripting

Print min and max value from two column

Dear All, I have data like this, input: 1254 10125 1254 10126 1254 10127 1254 10128 1254 10129 1255 10130 1255 10131 1255 10132 1255 10133 1256 10134 1256 10135 1256 10137... (3 Replies)
Discussion started by: aksin
3 Replies

8. Shell Programming and Scripting

Please Help!!!! Awk for summing columns based on selected column value

a,b,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y,z,aa,bb,cc,dd,ee,ff,gg,hh,ii a thru ii are digits and strings.... The awk needed....if coloumn 9 == i (coloumn 9 is string ), output the sum of x's(coloumn 22 ) in all records and sum of y's (coloumn 23 ) in all records in a file (records.txt).... (6 Replies)
Discussion started by: BrownBob
6 Replies

9. Shell Programming and Scripting

Get min and max value in column

Gents, I have a big file file like this. 5100010002 5100010004 5100010006 5100010008 5100010010 5100010012 5102010002 5102010004 5102010006 5102010008 5102010010 5102010012 The file is sorted and I would like to find the min and max value, taking in the consideration key1... (3 Replies)
Discussion started by: jiam912
3 Replies

10. UNIX for Beginners Questions & Answers

Is it possible to ascend a numbers based on selected columns?

I have to ascend the number of two selected columns by horizontal manner. For example, I have a data like this in csv file (tab delimited format) 08 1 19185 18010 16 4 7960 9339 01 6 516769 517428 09 9 51384 49270 I need to ascend the two columns numbers (horizontal manner) like as... (5 Replies)
Discussion started by: dineshkumarsrk
5 Replies
OUTPUT(5)							File Formats Manual							 OUTPUT(5)

NAME
output - output data file formats DESCRIPTION
This manual page describes the output formats of the files created by the Yagi-Uda project's output program. The files are ASCII file, so can be analysed with any graph plotting program. Example of a .dat File Below is a typical .dat file, for a 4ele 144-146MHz beam, optimised for a huge (and useless) FB. # Driven=1 parasitic=3 total-elements=4 design=145.000MHz # Checked from 144.000MHz to 146.000MHz. f(MHz) E(deg) H(deg) R jX VSWR Gain(dBi) FB(dB) SideLobes(dB) 144.000 54.7 71.5 44.47 -2.35 1.136 9.386 21.944 16.650 144.500 54.0 70.1 41.34 -0.75 1.210 9.553 27.244 17.153 145.000 53.2 68.4 37.55 1.61 1.335 9.742 103.055 17.777 145.500 52.3 66.6 33.26 5.00 1.530 9.947 25.734 18.547 146.000 51.3 64.6 28.77 9.63 1.832 10.149 18.919 18.919 What is what in the .dat file The f(MHz) column is the frequency (MHz) at which the data is evaluated at. The E(deg) column is the approximate 3dB E-plane bandwidth calculated to the nearest 0.1 degree. The H(deg) column is the approximate 3dB H-plane bandwidth calculated to the nearest 0.1 degree. The (R) column is the input resistance in Ohms. The (jX) column is the input reactance in Ohms. The (VSWR) column is the input VSWR, usually refered to a 50 Ohm input, but this may be changed. The Gain (dBi) column is the gain at theta=90 degrees, which is the forward direction of the beam. It is possible that a higher gain occurs at other than 90 degrees, but this is not taken into account. The antenna is seriously at fault if this occurs. The FB(dB) column is the front to back ratio in dB. The Sidelobes(dB) column is the minimum level in dB down from the peak gain of any sidelobe. This is not calculated unless the '-c' option is used, and then only on some optimisation techniques. Example of a .gai File The following is a small section of the .gai file. f(MHz) theta gain-E(dBi) G(E)-peak phi gain-H(dBi) G(H)-peak 144.0000 -90.0000 -12.5584 -21.9444 -180.0000 -12.5584 -21.9444 144.0000 -45.0000 -7.3507 -16.7367 -135.0000 -3.5971 -12.9830 144.0000 0.0000 -999.0000 -1008.3860 -90.0000 -0.9010 -10.2870 144.0000 45.0000 0.1848 -9.2012 -45.0000 4.0261 -5.3599 144.0000 90.0000 9.3860 0.0000 0.0000 9.3860 0.0000 144.0000 135.0000 0.1848 -9.2012 45.0000 4.0261 -5.3599 144.0000 180.0000 -999.0000 -1008.3860 90.0000 -0.9010 -10.2870 144.0000 225.0000 -7.3507 -16.7367 135.0000 -3.5971 -12.9830 144.0000 270.0000 -12.5584 -21.9444 180.0000 -12.5584 -21.9444 What is what in the .gai file The f(MHz) column is the frequency in MHz. The theta column is the angle theta, for which the next two columns refer. The gain-E(dBi) is the gain at theta, relative to an isotropic radiator. This is the E-plane gain. Hence at the peak (theta), this gives the peak forward gain. The G(E)-peak is the gain at theta, relative to the peak gain. Hence at the peak (theta=90 degrees), this is zero. The phi column has nothing to do with the previous 3 columns. It is the angle for which the next two columns refer. The gain-H(dBi) is the gain at phi, relative to an isotropic radiator. This is the H-plane gain. Hence at the peak (phi=0), this gives the peak forward gain. The G(H)-peak is the gain at phi, relative to the peak gain. Hence at the peak (phi=0 degrees), this is zero. Example of a .up File The .up file list the improvements made by optimise to an antenna design. Starting from the original design, the file is appended each time a new better design is found. Here is an example, where the final line is the performance of the 4ele beam with the .dat file shown ear- lier. 1 7.57dBi, 16.93dB F/B, Z=(31.77-56.34j) Ohms, VSWR=3.95, SL=16.95 dB 84 7.58dBi, 16.93dB F/B, Z=(31.78-56.32j) Ohms, VSWR=3.95, SL=16.95 dB 623 7.58dBi, 16.93dB F/B, Z=(31.78-56.28j) Ohms, VSWR=3.95, SL=16.95 dB 89345 9.74dBi, 103.06dB F/B, Z=(37.55 +1.61j) Ohms, VSWR=1.33, SL=17.78 dB What is what in the .up file The first column is an integer specifying the iteration. The other columns, going from left to right are gain(dBi), FB, input impedance, VSWR and level of the most significant sidelobe, in dB down on the peak gain. SEE ALS0 yagi(1), output(1), input(1), optimise(1), first(1) and yagi(5). AUTHORS
Dr. David Kirkby G8WRB (david.kirkby@onetel.net), with help with converting to DOS from Dr. Joe Mack NA3T (mack@fcrfv2.ncifcrf.gov). Version 1.16 24th October 2000 OUTPUT(5)
All times are GMT -4. The time now is 10:45 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy