|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Removing duplicates except the last occurrence
Post 302923993 by Scrutinizer on Wednesday 5th of November 2014 03:09:32 PM
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi, I've been trying to removed duplicates lines with similar columns in a fixed width file and it's not working.
I've search the forum but nothing comes close.
I have a sample file:
27147140631203RA CCD *
27147140631203RA PPN *
37147140631207RD AAA
47147140631203RD JNA... (12 Replies)
Discussion started by: giannicello
12 Replies
2. UNIX for Dummies Questions & Answers
Hello experts,
I am trying to remove all lines in a csv file where the 2nd columns is a duplicate. I am try to use sort with the key parameter
sort -u -k 2,2 File.csv > Output.csv
File.csv
File Name|Document Name|Document Title|Organization
Word Doc 1.doc|Word Document|Sample... (3 Replies)
Discussion started by: orahi001
3 Replies
3. Shell Programming and Scripting
Hi I have a file that are a list of people & their credentials i recieve frequently The issue is that whne I catnet this list that duplicat entries exists & are NOT CONSECUTIVE (i.e. uniq -1 may not weork here )
I'm trying to write a scrip that will remove duplicate entries
the script can... (5 Replies)
Discussion started by: stevie_velvet
5 Replies
4. Shell Programming and Scripting
Hi,
I have a file in the below format.,
test test (10)
to to (25)
see see (45)
and i need the output in the format of
test 10
to 25
see 45
Some one help me? (6 Replies)
Discussion started by: imdadulla
6 Replies
5. UNIX for Advanced & Expert Users
Hi All
In unix ,we have a file ,there we have to remove the duplicates by using one specific column.
Can any body tell me the command.
ex:
file1
id,name
1,ww
2,qwq
2,asas
3,asa
4,asas
4,asas
o/p:
1,ww
2,qwq
3,asa (7 Replies)
Discussion started by: raju4u
7 Replies
6. Shell Programming and Scripting
I have a test file with the following 2 columns:
Col 1 | Col 2
T1 | 1 <= remove
T5 | 1
T4 | 2
T1 | 3
T3 | 3
T4 | 1 <= remove
T1 | 2 <= remove
T3 ... (7 Replies)
Discussion started by: gctex
7 Replies
7. Emergency UNIX and Linux Support
i want to remove all the duplictaes in a file.I dont want even a single entry.
For the input data:
12345|12|34
12345|13|23
3456|12|90
15670|12|13
12345|10|14
3456|12|13
i need the below data in one file
15670|12|13
and the below data in another file (9 Replies)
Discussion started by: pandeesh
9 Replies
8. Shell Programming and Scripting
I have an input file abc.txt with info like:
abcd
rateuse
inklite
robet
rateuse
abcd
I need to remove duplicates from the file (eg: abcd,rateuse) from the file and need to place the contents in same file abc.txt if needed can be placed in another file.
can anyone help me in this :( (4 Replies)
Discussion started by: rkrish
4 Replies
9. Shell Programming and Scripting
i hav two files like
i want to remove/delete all the duplicate lines in file2 which are viz unix,unix2,unix3 (2 Replies)
Discussion started by: sagar_1986
2 Replies
10. Shell Programming and Scripting
i hav two files like
i want to remove/delete all the duplicate lines in file2 which are viz unix,unix2,unix3.I have tried previous post also,but in that complete line must be similar.In this case i have to verify first column only regardless what is the content in succeeding columns. (3 Replies)
Discussion started by: sagar_1986
3 Replies
LEARN ABOUT DEBIAN
gifti_test
GIFTI_TEST(1) User Commands GIFTI_TEST(1) NAME
gifti_test - test reading/writing a GIFTI dataset SYNOPSIS
gifti_test [...] OPTIONS
-help Show usage help. -gifti_hist Show giftilib history. -gifti_ver Show giftilib version. -encoding TYPE Set the data encoding for any output file. TYPE = ASCII : ASCII encoding TYPE = BASE64 : base64 binary TYPE = BASE64GZIP : base64 compressed binary -gfile OUTPUT Write out dataset as gifti image. -infile INPUT Specify INPUT as the GIFTI dataset to read. -no_data Do not write out data. -show Show final gifti image. -slist LEN s0... Restrict output to list of length LEN. -verb VERB Set verbose level. EXAMPLES
1. read in a GIFTI dataset (verbose, show output?) gifti_test -infile dset.gii gifti_test -infile dset.gii -verb 3 gifti_test -infile dset.gii -show 2. copy a GIFTI dataset (check differences?) gifti_test -infile dset.gii -gfile copy.gii diff dset.gii copy.gii 3. copy a GIFTI data, but write out only 3 surf indices: 0,4,5 gifti_test -infile time_series.gii -gfile ts3.gii -slist 3 0 4 5 SEE ALSO
Website: http://www.nitrc.org/projects/gifti AUTHOR
Richard Reynolds - SSCC, DIRP, NIMH, National Institutes of Health This manual page was written by Michael Hanke <michael.hanke@gmail.com>, for the Debian project (but may be used by others). gifti_test June 2010 GIFTI_TEST(1)