Find duplicates in 2 & 3rd column and their ID Post: 303000207

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find duplicates in the first column of text file

Hello, My text file has input of the form abc dft45.xml ert rt653.xml abc ert57.xml I need to write a perl script/shell script to find duplicates in the first column and write it into a text file of the form... abc dft45.xml abc ert57.xml Can some one help me plz?

2. Shell Programming and Scripting

need to remove duplicates based on key in first column and pattern in last column

Given a file such as this I need to remove the duplicates. 00060011 PAUL BOWSTEIN ad_waq3_921_20100826_010517.txt 00060011 PAUL BOWSTEIN ad_waq3_921_20100827_010528.txt 0624-01 RUT CORPORATION ad_sade3_10_20100827_010528.txt 0624-01 RUT CORPORATION ...

3. Shell Programming and Scripting

AWK script to create max value of 3rd column, grouping by first column

Hi, I need an awk script (or whatever shell-construct) that would take data like below and get the max value of 3 column, when grouping by the 1st column. clientname,day-of-month,max-users ----------------------------------- client1,20120610,5 client2,20120610,2 client3,20120610,7...

4. Shell Programming and Scripting

Find duplicates in column 1 and merge their lines (awk?)

Hi, I have a file (sorted by sort) with 8 tab delimited columns. The first column contains duplicated fields and I need to merge all these identical lines. My input file: comp100002 aaa bbb ccc ddd eee fff ggg comp100003 aba aba aba aba aba aba aba comp100003 fff fff fff fff fff fff fff...

5. UNIX for Dummies Questions & Answers

Search word in 3rd column and move it to next column (4th)

Hi, I have a file with +/- 13000 lines and 4 column. I need to search the 3rd column for a word that begins with "SAP-" and move/skip it to the next column (4th). Because the 3rd column need to stay empty. Thanks in advance.:) 89653 36891 OTR-60 SAP-2 89653 36892 OTR-10 SAP-2...

6. Shell Programming and Scripting

Find smallest & largest in every column

Dear All, I have input like this, J_15TEST_ASH05_33A22.13885.txt: $$ 1 MAKE SP1501 1 1 4 6101 7392 2 2442 2685 18 3201 4008 20 120 4158 J_15TEST_ASH05_33A22.13885.txt: $$ 1 MAKE SP1502 1 1 4 5125 6416 2 ...

7. Shell Programming and Scripting

Changing values only in 3rd column and 4th column

#cat file testing test! nipw asdkjasjdk ok! what !ok host server1 check_ssh_disk!102.56.1.101!30!50!/ other host server 2 des check_ssh_disk!192.6.1.10!40!30!/ #grep check file| awk -F! '{print $3,$4}'|awk '{gsub($1,"",$1)}1' 50 30 # Output:

8. Shell Programming and Scripting

Solution for replacement of 4th column with 3rd column in a file using awk/sed preserving delimters

input "A","B","C,D","E","F" "S","T","U,V","W","X" "AA","BB","CC,DD","EEEE","FFF" required output: "A","B","C,D","C,D","F" "S", T","U,V","U,V","X" "AA","BB","CC,DD","CC,DD","FFF" tried using awk but double quotes not preserving for every field. any help to solve this is much...

9. Shell Programming and Scripting

awk to Sum columns when other column has duplicates and append one column value to another with Care

Hi Experts, Please bear with me, i need help I am learning AWk and stuck up in one issue. First point : I want to sum up column value for column 7, 9, 11,13 and column15 if rows in column 5 are duplicates.No action to be taken for rows where value in column 5 is unique. Second point : For...

10. UNIX for Beginners Questions & Answers

UNIX script to compare 3rd column value with first column and display

Hello Team, My source data (INput) is like below EPIC1 router EPIC2 Targetdefinition Exp1 Expres rtr1 Router SQL SrcQual Exp1 Expres rtr1 Router EPIC1 Targetdefinition My output like SQL SrcQual Exp1 Expres Exp1 Expres rtr1 Router rtr1 Router EPIC1 Targetdefinition...

LEARN ABOUT DEBIAN

lsh-upgrade-key

LSH-UPGRADE-KEY(1)						    Lsh Manuals 						LSH-UPGRADE-KEY(1)

NAME

       lsh-upgrade-key - script for key conversion to lsh 2.0 format

SYNOPSIS

       lsh-upgrade-key KEY-FILE

DESCRIPTION

       CAUTION!  The  information  in  this manpage may be invalid or outdated. For authorative information on lsh, please see it's Texinfo manual
       (see the SEE ALSO section).

       The key in KEY-FILE is converted to the new format and stored in KEY-FILE.new (i.e. the suffix .new is added to the KEY-FILE name).

REPORTING BUGS

       Report bugs to <bug-lsh@gnu.org>.

COPYING

       The lsh suite of programs is distributed under the GNU General Public License; see the COPYING and AUTHORS files in the source distribution
       for details.

AUTHOR

       The lsh program suite is written mainly by Niels Moller <nisse@lysator.liu.se>.

       This  man-page  was  written  for  lsh 2.0 by Pontus Freyhult <pont_lsh@soua.net>, it is based on a template written by J.H.M. Dassen (Ray)
       <jdassen@wi.LeidenUniv.nl>.

SEE ALSO

       lsftp(1), lshg(1), lsh-authorize(1), lsh-decode-key(1), lsh-decrypt-key(1), lsh-keygen(1), lsh-make-seed(1),  lsh-upgrade(1),  lsh-upgrade-
       key(1), lsh-writekey(1), lshd(8), ssh-conv(1)

       The  full  documentation  for lsh is maintained as a Texinfo manual.  If the info and lsh programs are properly installed at your site, the
       command

	      info lsh

       should give you access to the complete manual.

LSH-UPGRADE-KEY 						   NOVEMBER 2004						LSH-UPGRADE-KEY(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find duplicates in the first column of text file

Discussion started by: gameboy87

2. Shell Programming and Scripting

need to remove duplicates based on key in first column and pattern in last column

Discussion started by: script_op2a

3. Shell Programming and Scripting

AWK script to create max value of 3rd column, grouping by first column

Discussion started by: ckmehta

4. Shell Programming and Scripting

Find duplicates in column 1 and merge their lines (awk?)

Discussion started by: falcox