Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Print lines based upon unique values in Nth field
Top Forums UNIX for Beginners Questions & Answers Print lines based upon unique values in Nth field Post 303010214 by Scott on Thursday 28th of December 2017 12:31:07 PM
Old 12-28-2017
With a little more work, you can do this in awk, without the sort, but:
Code:
$ awk '{A[$1]++; L[$1]=$0} END { for( a in A ) if( A[a] == 1 ) print L[a] }' file | sort
PS004,001 L-(H-1M]]NYX[/ B-NGJN(H/WT MZMWR/ L-DWD// *
PS005,001 L-(H-1M]]NYX[/ >L H-NXJLWT/(W(T MZMWR/ L-DWD// *
PS006,001 L-(H-1M]]NYX[/ B-NGJN(H/WT <L H-CMJNJ/T MZMWR/ L-DWD// *
PS008,001 L-(H-1M]]NYX[/ <L H-GTJT/ MZMWR/ L-DWD// *
PS009,001 L-(H-1M]]NYX[/ <LMWT/ L-(H-BN/ MZMWR/ L-DWD// *

(noting that PS004,001, not just PS004 counts as $1, as , is not a field separator)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find top N values for field X based on field Y's value

I want to find the top N entries for a certain field based on the values of another field. For example if N=3, we want the 3 best values for each entry: Entry1 ||| 100 Entry1 ||| 95 Entry1 ||| 30 Entry1 ||| 80 Entry1 ||| 50 Entry2 ||| 40 Entry2 ||| 20 Entry2 ||| 10 Entry2 ||| 50... (1 Reply)
Discussion started by: FrancoisCN
1 Replies

2. Shell Programming and Scripting

Compare Tab Separated Field with AWK to all and print lines of unique fields.

Hi. I have a tab separated file that has a couple nearly identical lines. When doing: sort file | uniq > file.new It passes through the nearly identical lines because, well, they still are unique. a) I want to look only at field x for uniqueness and if the content in field x is the... (1 Reply)
Discussion started by: rocket_dog
1 Replies

3. Shell Programming and Scripting

How to Print from nth field to mth fields using awk

Hi, Is there any short method to print from a particular field till another filed using awk? Example File: File1 ==== 1|2|acv|vbc|......|100|342 2|3|afg|nhj|.......|100|346 Expected output: File2 ==== acv|vbc|.....|100 afg|nhj|.....|100 (8 Replies)
Discussion started by: machomaddy
8 Replies

4. UNIX for Dummies Questions & Answers

Print Nth to last field

Hey, I'm sure this is answered somewhere but my Googling has turned up nothing. I have a file with data in the following format: <desription of event> at <time and date>The desription of the event is variable length and hence when the list is displayed it is hard to easily see the date (and... (8 Replies)
Discussion started by: RECrerar
8 Replies

5. Shell Programming and Scripting

awk - printing nth field based on parameter

I have a need to print nth field based on the parameter passed. Suppose I have 3 fields in a file, passing 1 to the function should print 1st field and so on. I have attempted below function but this throws an error due to incorrect awk syntax. function calcmaxlen { FIELDMAXLEN=0 ... (5 Replies)
Discussion started by: krishmaths
5 Replies

6. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

7. Shell Programming and Scripting

awk to print unique text in field

I am trying to use awk to print the unique entries in $2 So in the example below there are 3 lines but 2 of the lines match in $2 so only one is used in the output. File.txt chr17:29667512-29667673 NF1:exon.1;NF1:exon.2;NF1:exon.38;NF1:exon.4;NF1:exon.46;NF1:exon.47 703.807... (5 Replies)
Discussion started by: cmccabe
5 Replies

8. Shell Programming and Scripting

awk to print unique text in field before hyphen

Trying to print the unique values in $2 before the -, currently the count is displayed. Hopefully, the below is close. Thank you :). file chr2:46603668-46603902 EPAS1-902|gc=54.3 253.1 chr2:211471445-211471675 CPS1-1205|gc=48.3 264.7 chr19:15291762-15291983 NOTCH3-1003|gc=68.8 195.8... (3 Replies)
Discussion started by: cmccabe
3 Replies

9. Shell Programming and Scripting

Print count of unique values

Hello experts, I am converting a number into its binary output as : read n echo "obase=2;$n" | bc I wish to count the maximum continuous occurrences of the digit 1. Example : 1. The binary equivalent of 5 = 101. Hence the output must be 1. 2. The binary... (3 Replies)
Discussion started by: H squared
3 Replies

10. Shell Programming and Scripting

awk to print lines based on text in field and value in two additional fields

In the awk below I am trying to print the entire line, along with the header row, if $2 is SNV or MNV or INDEL. If that condition is met or is true, and $3 is less than or equal to 0.05, then in $7 the sub pattern :GMAF= is found and the value after the = sign is checked. If that value is less than... (0 Replies)
Discussion started by: cmccabe
0 Replies

LEARN ABOUT DEBIAN

dahdi_hardware

DAHDI_HARDWARE(8)					User Contributed Perl Documentation					 DAHDI_HARDWARE(8)

NAME

       dahdi_hardware - Shows Dahdi hardware devices.

SYNOPSIS

       dahdi_hardware [-v][-x]

OPTIONS

       -v  Verbose ouput - show spans used by each device etc. Currently only implemented for the Xorcom Astribank.

       -x  Show disconnected Astribank unit, if any.

DESCRIPTION

       Show all dahdi hardware devices. Devices are recognized according to lists of PCI and USB IDs in Dahdi::Hardware::PCI.pm and
       Dahdi::Hardware::USB.pm . For PCI it is possible to detect by sub-vendor and sub-product ID as well.

       The first output column is the connector: a bus specific field that shows where this device is.

       The second field shows which driver should handle the device. a "-" sign marks that the device is not yet handled by this driver. A "+"
       sign means that the device is handled by the driver.

       For the Xorcom Astribank (and in the future: for other Dahdi devices) some further information is provided from the driver. Those extra
       lines always begin with spaces.

       Example output:

       Without drivers loaded:

	 usb:001/002	    xpp_usb-	 e4e4:1152 Astribank-multi FPGA-firmware
	 usb:001/003	    xpp_usb-	 e4e4:1152 Astribank-multi FPGA-firmware
	 pci:0000:01:0b.0   wctdm-	 e159:0001 Wildcard TDM400P REV H

       With drivers loaded, without -v:
	 usb:001/002	    xpp_usb+	 e4e4:1152 Astribank-multi FPGA-firmware
	 usb:001/003	    xpp_usb+	 e4e4:1152 Astribank-multi FPGA-firmware
	 pci:0000:01:0b.0   wctdm+	 e159:0001  Wildcard TDM400P REV E/F

       With drivers loaded, with -v:
	 usb:001/002	    xpp_usb+	 e4e4:1152 Astribank-multi FPGA-firmware
	  LABEL=[usb:123] CONNECTOR=usb-0000:00:1d.7-1
		 XBUS-00/XPD-00: FXS	  Span 2
		 XBUS-00/XPD-10: FXS	  Span 3
		 XBUS-00/XPD-20: FXS	  Span 4
		 XBUS-00/XPD-30: FXS	  Span 5
	 usb:001/003	    xpp_usb+	 e4e4:1152 Astribank-multi FPGA-firmware
	  LABEL=[usb:4567] CONNECTOR=usb-0000:00:1d.7-4
		 XBUS-01/XPD-00: FXS	  Span 6 XPP-SYNC
		 XBUS-01/XPD-10: FXO	  Span 7
		 XBUS-01/XPD-20: FXO	  Span 8
		 XBUS-01/XPD-30: FXO	  Span 9
	 pci:0000:01:0b.0   wctdm+	 e159:0001  Wildcard TDM400P REV E/F

perl v5.14.2							    2009-04-20							 DAHDI_HARDWARE(8)
All times are GMT -4. The time now is 07:21 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy