Print unique records in 2 columns using awk Post: 302726309

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

AWK ??-print for fields within records in a file

Hello all, Would appreciate if someone can help me out on the following requirement. INPUT FILE: -------------------------- TPS REPORT abc def ghi jkl mon pqr stu vrs lll END OF TPS REPORT TPS REPORT field1 field2 field3 field4 field5 field6

2. Shell Programming and Scripting

awk : extracting unique lines based on columns

Hi, snp.txt CHR_A SNP_A BP_A_st BP_A_End CHR_B BP_B SNP_B R2 p-SNP_A p-SNP_B 5 rs1988728 74904317 74904318 5 74960646 rs1427924 0.377333 0.000740085 0.013930081 5 ...

3. Shell Programming and Scripting

awk print only select records from file2

Print only records from file 2 that do not match file 1 based on criteria of comparing column 1 and column 6 Was trying to play around with following code I found on other threads but not too successful Code: awk 'NR==FNR{p=$1;$1=x;A=$0;next}{$2=$2(A?A:",,,")}1' FS=~ OFS=~ file1 FS="*"...

4. Shell Programming and Scripting

count the unique records based on certain columns

Hi everyone, I have a file result.txt with records as following and another file mirna.txt with a list of miRNAs e.g. miR22, miR123, miR13 etc. Gene Transcript miRNA Gar Nm_111233 miR22 Gar Nm_123440 miR22 Gar Nm_129939 miR22 Hel Nm_233900 miR13 Hel ...

5. Shell Programming and Scripting

Print unique names in each row of a specific column using awk

Is it possible to remove redundant names in the 4th column? input cqWE 100 200 singapore;singapore AZO 300 400 brazil;america;germany;ireland;germany .... .... output cqWE 100 200 singapore AZO 300 400 brazil;america;germany;ireland

6. Shell Programming and Scripting

Print unique names in a specific column using awk

Is it possible to modify file like this. 1. Remove all the duplicate names in a define column i.e 4th col 2. Count the no.of unique names separated by ";" and print as a 5th col thanx in advance!! Q input c1 30 3 Eh2 c10 96 3 Frp c41 396 3 Ua5;Lop;Kol;Kol c62 2 30 Fmp;Fmp;Fmp ...

7. Shell Programming and Scripting

Compare columns of multiple files and print those unique string from File1 in an output file.

Hi, I have multiple files that each contain one column of strings: File1: 123abc 456def 789ghi File2: 123abc 456def 891jkl File3: 234mno 123abc 456def In total I have 25 of these type of file.

8. Shell Programming and Scripting

awk to print unique text in field

I am trying to use awk to print the unique entries in $2 So in the example below there are 3 lines but 2 of the lines match in $2 so only one is used in the output. File.txt chr17:29667512-29667673 NF1:exon.1;NF1:exon.2;NF1:exon.38;NF1:exon.4;NF1:exon.46;NF1:exon.47 703.807...

9. Shell Programming and Scripting

awk to print unique text in field before hyphen

Trying to print the unique values in $2 before the -, currently the count is displayed. Hopefully, the below is close. Thank you :). file chr2:46603668-46603902 EPAS1-902|gc=54.3 253.1 chr2:211471445-211471675 CPS1-1205|gc=48.3 264.7 chr19:15291762-15291983 NOTCH3-1003|gc=68.8 195.8...

10. Shell Programming and Scripting

Issue using awk to print min values for unique ids

I am using the following script to search for and print minimum values for each individual Fields (3-14) for each unique id (Field 1). But when the field contains a "-99.99" ( I am ignoring "-99.99") and when the minimum value is the first line of a new id (Field 1), the output does not print Field...

LEARN ABOUT DEBIAN

numsum

NUMSUM(1)						User Contributed Perl Documentation						 NUMSUM(1)

NAME

       numsum - numsum program file

SYNOPSIS

       numsum [-iIcdhrsvxy] <FILE>

       | numsum [-iIcdhrsvxy]	(Input on STDIN from pipeline.)

       numsum [-iIcdhrsvxy]	(Input on STDIN.  Use Ctrl-D to stop.)

DESCRIPTION

       numsum will take all the numbers on stdin and return the sum of those numbers.  Currently it only processes the first number on each line.
       Besides positive numbers, it also handles negative numbers and numbers with decimals.

OPTIONS

	   -i  Only return the integer portion of the final sum.
	   -I  Only return the decimal portion of the final sum.

	   -c	   Print out the sum of each column.
	   -r	   Print out the sum of each row.

	   -x <n>  Specify a comma seperated list of columns to print.
	   -y <n>  Specify a comma seperated list of rows to print.

	   -s <string> Specify a string to use as a seperator for columns.
		       This defaults to be consecutive whitespace (s+).

	   -h  Help: You're looking at it.
	   -V  Increase verbosity.
	   -d  Debug mode.  For developers
	   -q  Quiet mode, don't print any warnings.

EXAMPLES

       Simply add up the numbers in a file.
	   $ numsum numbers.txt
	   4315

       Enter your own numbers on STDIN. The last number is the answer.
	   $ numsum
	   4
	   21
	   98
	   100
	   223

       Use it in a command pipeline.
	   $ ls -1s | grep .mp3 | numsum -c -x 5
	   72288

       Add up the total byte count in a http log file.
	   $ cat access_log | awk {'print $10'} numsum

	   or

	   numsum -c -x 10 access_log

       Add up the columns of numbers of a file.

	   $ cat columns
	   1 6 11 16 21
	   2 7 12 17 22
	   3 8 13 18 23
	   4 9 14 19 24
	   5 10 15 20 25
	   $ numsum -c columns
	   15 40 65 90 115

       Add up the 1st, 2nd and 5th columns only.

	   $ numsum -c -x 1,2,5 columns
	   15 40 115

       Add up the rows of numbers of a file.

	    $ numsum -r columns
	    55
	    60
	    65
	    70
	    75

       Add up the 2nd and 4th rows.

	    $ numsum -r -y 2,4 columns
	    60
	    70

SEE ALSO

       numaverage(1), numbound(1), numinterval(1), numnormalize(1), numgrep(1), numprocess(1), numrandom(1), numrange(1), numround(1)

COPYRIGHT

       numsum is part of the num-utils package, which is copyrighted by Suso Banderas and released under the GPL license.  Please read the COPYING
       and LICENSE files that came with the num-utils package

	 Developers can read the GOALS file and contact me about providing
       submitions or help for the project.

MORE INFO

       More info on numsum can be found at:

       http://suso.suso.org/programs/num-utils/

perl v5.10.1							    2009-10-31								 NUMSUM(1)