awk to print percent based on vales in file


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers awk to print percent based on vales in file
# 1  
Old 02-28-2020
awk to print percent based on vales in file

Trying to use awk to calulate a percent based on the count of each matching $5 in file divided by the count of each $7 that is greater than or = to 20. The portion of code before the first | gets the count of the matching $5, then the next portion before the second | gets the count of each $7 that is greater than or = to 20. The last part gets the overall %. The awk does execute, but no output results and there probably is a bette way and hope my logic makes sense . Thank you Smilie.

file
Code:
chr1	1787320	1787324	chr1:1787320-1787324	GNB1_1	1	394
chr1	1787320	1787324	chr1:1787320-1787324	GNB1_1	2	398
chr1	1787320	1787324	chr1:1787320-1787324	GNB1_1	3	17
chr1	1787320	1787324	chr1:1787320-1787324	GNB1_1	4	19
chr7	99203095	99203098	chr7:99203095-99203098	KPNA7_9	66	12
chr7	99203095	99203098	chr7:99203095-99203098	KPNA7_9	67	2
chr7	99203095	99203098	chr7:99203095-99203098	KPNA7_9	68	0
chrX	154370862	154370864	chrX:154370862-154370864	FLNA_26	375	0
chrX	154370862	154370864	chrX:154370862-154370864	FLNA_26	376	0

desired
Code:
GNB1_1	4 2 50.0%
KPNA7_9 3 2 33.3%
FLNA_26 2 0 0.0%

awk
Code:
awk -F '\t' '{c[$5]++}
END{
for (i in c) printf("%s\t%s\n",i,c[i])
}' file | awk 'count[$5]==""{ count[$5]=0 } 
            $7 <= 20{ count[$5]++} 
END{
              for(k in count) 
                 printf "%s %d\n",  k, count[k]
}' | awk '{A[$1]=$2;next} ($1 in A){X=(A[$1]/$3)*100;printf("%s %.1f\n",$1,  100-X)}' > output

# 2  
Old 02-28-2020
Your desired output cannot be calculated from your input sample, as none of the "KPNA7_9" lines has a $7 greater than or equal 20.
Your first awk script prints two fields per line, so a $5 or $7 as referenced in the second will be nil.The only element printed is count[""] which is 3 .
In your third awk script, ALL lines on stdin will be operated upon by the first action, and then next will ignore the rest of the script. Nothing will ever be printed.

A decent, consistent structuring like indenting and block building, etc. - your choice, but stick to it - of the program(s) will help you (later) and others reading and understanding your logics.

Try instead



Code:
awk -F '\t' '
        {CNT5[$5]++
         CNT7[$5] += ($7 >= 20)
        }
END     {for (c in CNT5) printf("%s\t%d\t%d\t%7.2f%%\n", c, CNT5[c], CNT7[c], CNT7[c]/CNT5[c]*100)
        }
' file
FLNA_26    2    0    0.00%
GNB1_1     4    2   50.00%
KPNA7_9    3    0    0.00%

This User Gave Thanks to RudiC For This Post:
# 3  
Old 03-02-2020
Thank you very much Smilie.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Using awk to print output based on first field.

Hi Folks, I have one requirement, There is one file, which contains two fields. Based on first field, I need to print an output. Example will be more suitable. Input file like this. abc 5 abc 10 xyz 6 xyz 9 xyz 10 mnp 10 mnp 12 mnp 6 (2 Replies)
Discussion started by: Raza Ali
2 Replies

2. Shell Programming and Scripting

awk to print line based on two keywords

I am starting to write a multi-line awk and using the file below which is tab-delimited, print only the line with oncomineGeneClass and oncomineVariantClass and PASS. The script execute but seems to be printing the entire file, not the desired line. Thank you :). file ... (8 Replies)
Discussion started by: cmccabe
8 Replies

3. Shell Programming and Scripting

awk to calculate total and percent off field in file

Trying to use awk to print the lines in file that have either REF or SNV in $3, add a header line, sort by $4 in numerical order. The below code does that already, but where I am stuck is on the last part where the total lines are counted and printed under Total_Targets, under Targets_less_than is... (4 Replies)
Discussion started by: cmccabe
4 Replies

4. Shell Programming and Scripting

awk to print specific line in file based on criteria

In the file below I am trying to extract a specific instance of path, if the adjacent plugin": "/rundb/api/v1/plugin/49/. Thank you :). file "path": "/results/analysis/output/Home/Auto_user_S5-00580-4-Medexome_65_028/plugin_out/FileExporter_out.52", "plugin": "/rundb/api/v1/plugin/49/",... (8 Replies)
Discussion started by: cmccabe
8 Replies

5. Shell Programming and Scripting

print the whole row in awk based on matched pattern

Hi, I need some help on how to print the whole data for unmatched pattern. i have 2 different files that need to be checked and print out the unmatched patterns into a new file. My sample data as follows:- File1.txt Id Num Activity Class Type 309 1.1 ... (5 Replies)
Discussion started by: redse171
5 Replies

6. Shell Programming and Scripting

awk based script to print the "mode(statistics term)" for each column in a data file

Hi All, Thanks all for the continued support so far. Today, I need to find the most occurring string/number(also called mode in statistics terminology) for each column in a data file (.csv type). For one column of data(1.txt) like below Sample 1 2 2 3 4 1 1 1 2 I can find the mode... (6 Replies)
Discussion started by: ks_reddy
6 Replies

7. Shell Programming and Scripting

awk print non matching lines based on column

My item was not answered on previous thread as code given did not work I wanted to print records from file2 where comparing column 1 and 16 for both files find rows where column 16 in file 1 does not match column 16 in file 2 Here was CODE give to issue ~/unix.com$ cat f1... (0 Replies)
Discussion started by: sigh2010
0 Replies

8. Shell Programming and Scripting

awk if percent % checking

hi everyone, # cat a a 10% b 25.5% c 91% d 50% # cat a | awk '$2 >= 90%; END {print $_}' awk: $2 > 90%; END {print $_} awk: ^ syntax error awk: each rule must have a pattern or an action part how to do only print when 2nd coln >= 90%. Thanks (6 Replies)
Discussion started by: jimmy_y
6 Replies

9. Shell Programming and Scripting

awk help - input vales from on efile to annother

Please see attached test file for better explanation and formatting of files....thanks foo1 H2600 LINE: H2600 H2600 H2600 MYSystems Ltd. (Feb 18 2009) V1760R1130 1 2213133522.79N 81 027.09E 500814.01502345.9 145 9 837 E1760R1130 1 2 2213133522.44N 81 027.33E... (4 Replies)
Discussion started by: garethsays
4 Replies

10. Shell Programming and Scripting

Find percent between sum of 2 columns awk help

Hi I'm new to this forum and I'm a beginner when it comes to shell and awk programming. But I have the following problem: I have 5 csv files (data1.csv, data2.csv, etc.) and need to calculate the average between the total sum of the 1st and 7 column. csv example:... (3 Replies)
Discussion started by: sapo51
3 Replies
Login or Register to Ask a Question