Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Print lines based upon unique values in Nth field Post 303010214 by Scott on Thursday 28th of December 2017 12:31:07 PM
Old 12-28-2017
With a little more work, you can do this in awk, without the sort, but:
Code:
$ awk '{A[$1]++; L[$1]=$0} END { for( a in A ) if( A[a] == 1 ) print L[a] }' file | sort
PS004,001 L-(H-1M]]NYX[/ B-NGJN(H/WT MZMWR/ L-DWD// *
PS005,001 L-(H-1M]]NYX[/ >L H-NXJLWT/(W(T MZMWR/ L-DWD// *
PS006,001 L-(H-1M]]NYX[/ B-NGJN(H/WT <L H-CMJNJ/T MZMWR/ L-DWD// *
PS008,001 L-(H-1M]]NYX[/ <L H-GTJT/ MZMWR/ L-DWD// *
PS009,001 L-(H-1M]]NYX[/ <LMWT/ L-(H-BN/ MZMWR/ L-DWD// *

(noting that PS004,001, not just PS004 counts as $1, as , is not a field separator)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find top N values for field X based on field Y's value

I want to find the top N entries for a certain field based on the values of another field. For example if N=3, we want the 3 best values for each entry: Entry1 ||| 100 Entry1 ||| 95 Entry1 ||| 30 Entry1 ||| 80 Entry1 ||| 50 Entry2 ||| 40 Entry2 ||| 20 Entry2 ||| 10 Entry2 ||| 50... (1 Reply)
Discussion started by: FrancoisCN
1 Replies

2. Shell Programming and Scripting

Compare Tab Separated Field with AWK to all and print lines of unique fields.

Hi. I have a tab separated file that has a couple nearly identical lines. When doing: sort file | uniq > file.new It passes through the nearly identical lines because, well, they still are unique. a) I want to look only at field x for uniqueness and if the content in field x is the... (1 Reply)
Discussion started by: rocket_dog
1 Replies

3. Shell Programming and Scripting

How to Print from nth field to mth fields using awk

Hi, Is there any short method to print from a particular field till another filed using awk? Example File: File1 ==== 1|2|acv|vbc|......|100|342 2|3|afg|nhj|.......|100|346 Expected output: File2 ==== acv|vbc|.....|100 afg|nhj|.....|100 (8 Replies)
Discussion started by: machomaddy
8 Replies

4. UNIX for Dummies Questions & Answers

Print Nth to last field

Hey, I'm sure this is answered somewhere but my Googling has turned up nothing. I have a file with data in the following format: <desription of event> at <time and date>The desription of the event is variable length and hence when the list is displayed it is hard to easily see the date (and... (8 Replies)
Discussion started by: RECrerar
8 Replies

5. Shell Programming and Scripting

awk - printing nth field based on parameter

I have a need to print nth field based on the parameter passed. Suppose I have 3 fields in a file, passing 1 to the function should print 1st field and so on. I have attempted below function but this throws an error due to incorrect awk syntax. function calcmaxlen { FIELDMAXLEN=0 ... (5 Replies)
Discussion started by: krishmaths
5 Replies

6. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

7. Shell Programming and Scripting

awk to print unique text in field

I am trying to use awk to print the unique entries in $2 So in the example below there are 3 lines but 2 of the lines match in $2 so only one is used in the output. File.txt chr17:29667512-29667673 NF1:exon.1;NF1:exon.2;NF1:exon.38;NF1:exon.4;NF1:exon.46;NF1:exon.47 703.807... (5 Replies)
Discussion started by: cmccabe
5 Replies

8. Shell Programming and Scripting

awk to print unique text in field before hyphen

Trying to print the unique values in $2 before the -, currently the count is displayed. Hopefully, the below is close. Thank you :). file chr2:46603668-46603902 EPAS1-902|gc=54.3 253.1 chr2:211471445-211471675 CPS1-1205|gc=48.3 264.7 chr19:15291762-15291983 NOTCH3-1003|gc=68.8 195.8... (3 Replies)
Discussion started by: cmccabe
3 Replies

9. Shell Programming and Scripting

Print count of unique values

Hello experts, I am converting a number into its binary output as : read n echo "obase=2;$n" | bc I wish to count the maximum continuous occurrences of the digit 1. Example : 1. The binary equivalent of 5 = 101. Hence the output must be 1. 2. The binary... (3 Replies)
Discussion started by: H squared
3 Replies

10. Shell Programming and Scripting

awk to print lines based on text in field and value in two additional fields

In the awk below I am trying to print the entire line, along with the header row, if $2 is SNV or MNV or INDEL. If that condition is met or is true, and $3 is less than or equal to 0.05, then in $7 the sub pattern :GMAF= is found and the value after the = sign is checked. If that value is less than... (0 Replies)
Discussion started by: cmccabe
0 Replies
Date::Manip::ConfigFile(3pm)				User Contributed Perl Documentation			      Date::Manip::ConfigFile(3pm)

NAME
Date::Manip::ConfigFile - sample config file DESCRIPTION
Date::Manip is a highly configurable module. Many of the options can be set in a config file. This document includes a sample config file. The config file consists of three sections. The first section is config variables. This is described more fully in the Date::Manip::Config document. The second section is the holiday definition section. The third section is the event definition section. These are both described more fully in the Date::Manip::Holidays document. SAMPLE CONFIG FILE
The sample config file below works for newer versions of Date::Manip. Some of the config variables may change, or be deprecated, and some may not work with earlier versions of Date::Manip, so it is strongly suggested that you check out the documentation for the version of Date::Manip you are using to confirm any of the config variables you want to include. ################################ # CONFIG VARIABLES ################################ # See Date::Manip::Config man page for a description of all # config variables. # To include configuration information from additional # config files: ConfigFile = /path/to/another/config/file ConfigFile = /path/to/another/config/file2 # For handling other languages Language = English DateFormat = US Encoding = # Set the current timezone: SetDate = now,America/New_York # Set the work work WorkWeekBeg = 1 WorkWeekEnd = 5 WorkDay24Hr = 0 WorkDayBeg = 08:00 WorkDayEnd = 17:00 TomorrowFirst = 1 # Misc. variables YYtoYYYY = 89 FirstDay = 1 Jan1Week1 = 0 Printable = 0 DefaultTime = midnight RecurRange = none ################################ # HOLIDAYS ################################ # See the Date::Manip::Holidays man page for a description of # this section. *HOLIDAYS # FEDERAL HOLIDAYS ################## # You can express New Year's Day as the actual day (Jan 1) # or the observed day (Jan 1 or the nearest week day). # You can't include BOTH because once a day is marked as # a holiday, a second definition will treat it the same # as a weekend and choose another day to assign the holiday # to (so there would be two days designated as New Years). # Jan 1 = New Year's Day 1*1:0:1:0:0:0*DWD = New Year's Day (observed) # Two different ways to defined MLK day third Monday in Jan = Martin Luther King Jr.'s Birthday # 1*1:3:1:0:0:0 = Martin Luther King Jr.'s Birthday # Observed by federal employees in Washington D.C. # Jan 20 = Inauguration day third Monday in Feb = Washington's Birthday last Monday in May = Memorial Day 1st Monday in Sep = Labor Day second Monday in Oct = Columbus Day # Jul 4 = Independence Day 1*7:0:4:0:0:0*DWD = Independence Day # 11/11 = Veterans Day 1*11:0:11:0:0:0*DWD = Veteran's Day # To define both Thanksgiving and the day after, use the # following two lines: fourth Thu in Nov = Thanksgiving 1*11:4:4:0:0:0*FD1 = Day after Thanksgiving # Dec 25 = Christmas 1*12:0:25:0:0:0*DWD = Christmas # SAMPLE HOLIDAYS ################## # You can define a one-time-only holiday by specifying # the day and year. 6/2/1999 = A special test holiday for 1999 ################################ # EVENTS ################################ # See the Date::Manip::Holidays man page for a description of # this section. *EVENTS 2000-02-01 = Event01 2000-02-01-12:00:00 = Event02 02-01 = Event03 02-01 12:00:00 = Event04 1*2:0:3:13:00:00 = Event05 2000-02-05 10:00:00 ; 2000-02-05 10:59:59 = Event06 2000-02-05 ; 2000-02-06 = Event07 02-05 ; 02-06 = Event08 2000-02-07 10:00:00 ; 0:0:0:0:3:0:0 = Event09 02-07 10:00:00 ; 0:0:0:0:4:0:0 = Event10 1*2:0:7:10:00:00 ; 0:0:0:0:5:0:0 = Event11 SEE ALSO
Date::Manip - main module documentation LICENSE
This script is free software; you can redistribute it and/or modify it under the same terms as Perl itself. AUTHOR
Sullivan Beck (sbeck@cpan.org) perl v5.14.2 2012-06-02 Date::Manip::ConfigFile(3pm)
All times are GMT -4. The time now is 01:30 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy