|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Sort and Remove Duplicate on file
Post 302521920 by mabarif16 on Thursday 12th of May 2011 06:20:36 PM
05-12-2011
|
|
9 More Discussions You Might Find Interesting
1. Solaris
Can any one give me command How to delete duplicate records with out sort.
Suppose if the records like below:
345,bcd,789
123,abc,456
234,abc,456
712,bcd,789
out tput should be
345,bcd,789
123,abc,456
Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (2 Replies)
Discussion started by: svenkatareddy
2 Replies
2. Shell Programming and Scripting
Can any one give me command How to delete duplicate records with out sort.
Suppose if the records like below:
345,bcd,789
123,abc,456
234,abc,456
712,bcd,789
out tput should be
345,bcd,789
123,abc,456
Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (19 Replies)
Discussion started by: svenkatareddy
19 Replies
3. Shell Programming and Scripting
I have many pdf's scattered across 4 machines. There is 1 location where I have other Pdf's maintained. But the issues it the 4 machines may have duplicate pdf's among themselves, but I want just 1 copy of each so that they can be transfered to that 1 location.
What I have thought is:
1) I have... (11 Replies)
Discussion started by: deaddevil
11 Replies
4. Shell Programming and Scripting
I have a file a.txt having content like
deepak
ram
sham
deepram
sita
kumar
I Want to delete the first line containing "deep" ...
I tried using...
grep -i 'deep' a.txt
It gives me 2 rows...I want to delete the first one..
+ need to know the command to delete the line from... (5 Replies)
Discussion started by: saluja.deepak
5 Replies
5. Shell Programming and Scripting
I have a csv file that I would like to remove duplicate lines based on field 1 and sort. I don't care about any of the other fields but I still wanna keep there data intact. I was thinking I could do something like this but I have no idea how to print the full line with this. Please show any method... (8 Replies)
Discussion started by: cokedude
8 Replies
6. Shell Programming and Scripting
Hi,
INPUT:
DCBADD
OUTPUT:
ABCD
The SED script should alphabetically sort the chars in the string and remove the duplicate chars. (5 Replies)
Discussion started by: jds93
5 Replies
7. Shell Programming and Scripting
if different branch code is available for same BIC code and one of the branch code is XXX.only one row will be stored and with branch code as XXX .rest of the rows for the BIC code will not be stored.
for example if $7 is BIC code and $8 is branch code
INPUT file are following... (9 Replies)
Discussion started by: mohan sharma
9 Replies
8. UNIX for Dummies Questions & Answers
I want to delete partical duplicate file
>gma-miR156d Gm01,PACID=26323927 150.00 -18.28 2 18 17 35 16 75.00% 81.25%
>>gma-miR156d Gm01,PACID=26323927 150.00 -18.28 150.00 -18.28 1 21 119 17
I want to order by the second column and delete the... (1 Reply)
Discussion started by: grace_shen
1 Replies
9. Shell Programming and Scripting
Hi, all
I have a csv file that I would like to remove duplicate lines based on 1st field and sort them by the 1st field. If there are more than 1 line which is same on the 1st field, I want to keep the first line of them and remove the rest. I think I have to use uniq or something, but I still... (8 Replies)
Discussion started by: refrain
8 Replies
LEARN ABOUT DEBIAN
unidup
UNIDUP(1) General Commands Manual UNIDUP(1) NAME
unidup - Scan through a sorted .hex file and report duplicate code points. SYNOPSIS
unidup < input_font.hex DESCRIPTION
unidup reads a sorted GNU Unifont .hex file (sorted with the Unix sort utility) from stdin and prints notification of any duplicate code points on stdout. FILES
*.hex GNU Unifont font files SEE ALSO
bdfimplode(1), hex2bdf(1), hex2bdf-split(1), hex2sfd(1), hexbraille(1), hexdraw(1), hexmerge(1), johab2ucs2(1), unibmp2hex(1), unicover- age(1), unihex2bmp(1), unipagecount(1), uniunmask(1) AUTHOR
unidup was written by Paul Hardy. LICENSE
unidup is Copyright (C) 2007 Paul Hardy, and is released under version 2 of the GNU General Public License, or (at your option) a later version. BUGS
No known bugs exist. 2007 Dec 31 UNIDUP(1)