Deleting only 2nd and third duplicates in field 2 Post: 302880103

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing duplicates in a sorted file by field.

I have data like this: It's sorted by the 2nd field (TID). envoy,90000000000000634600010001,04/11/2008,23:19:27,RB00266,0015,DETAIL,ERROR, envoy,90000000000000634600010001,04/12/2008,04:23:45,RB00266,0015,DETAIL,ERROR,...

2. Shell Programming and Scripting

Awk to find duplicates in 2nd field

I want to find duplicates in file on 2nd field i wrote this code: nawk '{a++} END{for i in a {if (a>1) print}}' temp Could not find whats wrong with this. Appreciate help

3. Shell Programming and Scripting

Sort alpha on 1st field, numerical on 2nd field (sci notation)

I want to sort alphabetically on the first field and sort in descending numerical order on the 2nd field. With a normal "sort -r -n" it does this: abc ||| 5e-05 ||| bla abc ||| 3 ||| ble def ||| 1 ||| abc def ||| 0.2 ||| def As you can see it ignores the fact that 5e-05 is actually 0.00005...

4. Shell Programming and Scripting

Extracting duplicates from a desired field

Hello, I have a file of group names and GID's (/etc/group) and I want to find the duplicate group names and put them in a file. So there are 2 fields, i.e.: audit 10 avahi 70 avahi-autoipd 103 bellrpi 605 bin 1 bin 2 bord 512 busobj 161 bwadm 230 cali81 202 card 323 cardiff 901 cbm...

5. Shell Programming and Scripting

Deleting Duplicates leaving the first entry

Hi, I need to delete duplicate records in a file that is around 30MB. Below is what I need. Below are the entries of input file and the output file that I need. Each section of input file is separated by an empty line. Some of these sections have duplicate uid values. I want to retain only one...

6. Shell Programming and Scripting

Remove the partial duplicates by checking the length of a field

Hi Folks - I'm quite new to awk and didn't come across such issues before. The problem statement is that, I've a file with duplicate records in 3rd and 4th fields. The sample is as below: aaaaaa|a12|45|56 abbbbaaa|a12|45|56 bbaabb|b1|51|45 bbbbbabbb|b2|51|45 aaabbbaaaa|a11|45|56 ...

7. UNIX for Dummies Questions & Answers

remove duplicates based on a field and criteria

Hi, I have a file with fields like below: A;XYZ;102345;222 B;XYZ;123243;333 C;ABC;234234;444 D;MNO;103345;222 E;DEF;124243;333 desired output: C;ABC;234234;444 D;MNO;103345;222 E;DEF;124243;333 ie, if the 4rth field is a duplicate.. i need only those records where...

8. Shell Programming and Scripting

Remove duplicates based on a field's value

Hi All, I have a text file with three columns. I would like a simple script that removes lines in which column 1 has duplicate entries, but use the largest value in column 3 to decide which one to keep. For example: Input file: 12345a rerere.rerere len=23 11111c fsdfdf.dfsdfdsf len=33 ...

9. Shell Programming and Scripting

Trying to remove duplicates based on field and row

I am trying to see if I can use awk to remove duplicates from a file. This is the file: -==> Listvol <== deleting /vol/eng_rmd_0941 deleting /vol/eng_rmd_0943 deleting /vol/eng_rmd_0943 deleting /vol/eng_rmd_1006 deleting /vol/eng_rmd_1012 rearrange /vol/eng_rmd_0943 ...

10. UNIX for Dummies Questions & Answers

Combine Similar Output from the 2nd field w.r.t 1st Field

Hi, For example: I have: HostA,XYZ HostB,XYZ HostC,ABC I would like the output to be: HostA,HostB: XYZ HostC:ABC How can I achieve this? So far what I though of is:

LEARN ABOUT DEBIAN

html2po

html2po(1)						      Translate Toolkit 1.9.0							html2po(1)

NAME

       html2po - convert HTML files to Gettext PO localization files

SYNOPSIS

       html2po	[--version]  [-h|--help]  [--manpage]  [--progress  PROGRESS]  [--errorlevel ERRORLEVEL] [-i|--input] INPUT [-x|--exclude EXCLUDE]
       [-o|--output] OUTPUT [-P|--pot] [-u|--untagged] [--keepcomments] [--duplicates DUPLICATESTYLE]

DESCRIPTION

       See: http://translate.sourceforge.net/wiki/toolkit/html2po for examples and usage instructions

OPTIONS

       --version
	      show program's version number and exit

       -h/--help
	      show this help message and exit

       --manpage
	      output a manpage based on the help

       --progress
	      show progress as: dots, none, bar, names, verbose

       --errorlevel
	      show errorlevel as: none, message, exception, traceback

       -i/--input
	      read from INPUT in htm, html, xhtml formats

       -x/--exclude
	      exclude names matching EXCLUDE from input paths

       -o/--output
	      write to OUTPUT in po, pot formats

       -P/--pot
	      output PO Templates (.pot) rather than PO files (.po)

       -u/--untagged
	      include untagged sections

       --keepcomments
	      preserve html comments as translation notes in the output

       --duplicates
	      what to do with duplicate strings (identical source text): merge, msgctxt (default: 'msgctxt')

							      Translate Toolkit 1.9.0							html2po(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing duplicates in a sorted file by field.

Discussion started by: kinksville

2. Shell Programming and Scripting

Awk to find duplicates in 2nd field

Discussion started by: pinnacle

3. Shell Programming and Scripting

Sort alpha on 1st field, numerical on 2nd field (sci notation)

Discussion started by: FrancoisCN

4. Shell Programming and Scripting

Extracting duplicates from a desired field

Discussion started by: mgb