Count and print the most repeating string in each line Post: 302938502

Sponsored Content

Top Forums Shell Programming and Scripting Count and print the most repeating string in each line Post 302938502 by Don Cragun on Tuesday 17th of March 2015 06:35:27 AM

03-17-2015

Registered User

Quote:

Originally Posted by MadeInGermany

A simple one:

Code:

sort Input.txt | uniq -c | awk '($2!=p2 || $1==p1) {print $2,$3,$1} {p1=$1; p2=$2}'

Code:

Gene1 BP1 3
Gene2 BP3 4
Gene3 BP7 2
Gene3 BP8 2

This works with the sample input given in post #1 in this thread, but with a slightly modified Input.txt:

Code:

Gene1   BP1
Gene1   BP2
Gene1   BP2
Gene1   BP2
Gene1   BP2
Gene2   BP3
Gene2   BP3
Gene2   BP3
Gene2   BP3
Gene3   BP7
Gene3   BP8
Gene3   BP7
Gene3   BP8

(changing some Gene1 BP1 lines to Gene1 BP2, it produces the incorrect output:

Code:

2}'
Gene1 BP1 1
Gene2 BP3 4
Gene3 BP7 2
Gene3 BP8 2

instead of the correct output:

Code:

Gene1 BP2 4
Gene2 BP3 4
Gene3 BP7 2
Gene3 BP8 2

or the requested:

Code:

Gene1   BP2   4
Gene2   BP3   4
Gene3   BP7   2   BP8   2

The second sort in the pipeline I suggested can't be skipped unless the awk code is made considerably more complex.

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep a string and print a string from the line below it

I know how to grep, copy and paste a string from a line. Now, what i want to do is to find a string and print a string from the line below it. To demonstrate: Name 1: ABC Age: 3 Sex: Male Name 2: DEF Age: 4 Sex: Male Output: 3 Male I know how to get "3". My biggest problem is to...

2. Shell Programming and Scripting

awk: sort lines by count of a character or string in a line

I want to sort lines by how many times a string occurs in each line (the most times first). I know how to do this in two passes (add a count field in the first pass then sort on it in the second pass). However, can it be done more optimally with a single AWK command? My AWK has improved...

3. Shell Programming and Scripting

Count and print all repeating words in a line

Gurus, I have a file containing lines like this : Now, number of words in each line varies. My need is, if a word repeats in a line get it printed. Also total number of repeats. So, the output would be : Any help would be highly appreciated. Thanks & Regards

4. Shell Programming and Scripting

Extract string from multiple file based on line count number

Hi, I search all forum, but I can not find solutions of my problem :( I have multiple files (5000 files), inside there is this data : FILE 1: 1195.921 -898.995 0.750312E-02-0.497526E-02 0.195382E-05 0.609417E-05 -2021.287 1305.479-0.819754E-02 0.107572E-01 0.313018E-05 0.885066E-05 ...

5. Shell Programming and Scripting

Compare last 90 logs and print repeating lines with >20

*log files are in date order sample logs... ciscoresets_20120314 ciscoresets_20120313 ciscoresets_20120312 ciscoresets_20120311 ciscoresets_20120310 cat ciscoresets_20120314 SYDGRE04,10,9 SYDGRE04,10,10 SYDGRE04,10,11 SYDGRE04,10,12 SYDGRE04,10,13 SYDGRE04,10,14 SYDGRE04,10,15...

6. Shell Programming and Scripting

Print String Every Specific Line

Dear All, I have input file like this, 001 059 079 996 758 079 069 059 079 ... ... Desired output: AA 001 BB 059

7. UNIX for Dummies Questions & Answers

How to count a string in a line and report it?

Hi, I have a text file full of such line (this is only 1 line, tab delimited): 1 108 . C T 553.90 . ...

8. Shell Programming and Scripting

String search and print next all lines in one line until blank line

Dear all I want to search special string in file and then print next all line in one line until blank lines come. Help me plz for same. My input file and desire op file is as under. i/p file: A1/EXT "BSCABD1_21233G1" 757 130823 1157 RADIO X-CEIVER ADMINISTRATION BTS EXTERNAL FAULT ...

9. Shell Programming and Scripting

How to print line starting with certain string together with its following line?

Dear all, How can I print line starting with certain string together with its following line. Example is as follows: Input file: @M01596:22:000000000-A7YH7:1:1101:16615:1070 2:N:0:1...

10. UNIX for Beginners Questions & Answers

Count occurences of the word without it repeating

Hi, I would like to count the number of ALA occurences without having them to be repeated. In the script I have written now it has 40 repetitions of ALA but it has to be 8. ALA is chosen as one of the 20 values it can have when the script asks for the input of AAA, which for this example is chosen...

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep a string and print a string from the line below it

Discussion started by: kingpeejay

2. Shell Programming and Scripting

awk: sort lines by count of a character or string in a line

Discussion started by: Michael Stora

3. Shell Programming and Scripting

Count and print all repeating words in a line

Discussion started by: AshwaniSharma09

4. Shell Programming and Scripting

Extract string from multiple file based on line count number

Discussion started by: guns

5. Shell Programming and Scripting

Compare last 90 logs and print repeating lines with >20

Discussion started by: slashbash

6. Shell Programming and Scripting

Print String Every Specific Line

Discussion started by: attila

7. UNIX for Dummies Questions & Answers

How to count a string in a line and report it?

Discussion started by: a_bahreini

8. Shell Programming and Scripting

String search and print next all lines in one line until blank line

Discussion started by: jaydeep_sadaria

9. Shell Programming and Scripting

How to print line starting with certain string together with its following line?

Discussion started by: huiyee1

10. UNIX for Beginners Questions & Answers

Count occurences of the word without it repeating

Discussion started by: Aurimas