10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a file with the following format:
fields seperated by "|"
title1|something class|long...content1|keys
title2|somhing class|log...content1|kes
title1|sothing class|lon...content1|kes
title3|shing cls|log...content1|ks
I want to remove all duplicates with the same "title field"(the... (3 Replies)
Discussion started by: dtdt
3 Replies
2. UNIX for Dummies Questions & Answers
Hello,
I want to filter all the duplicates of a record to one place. Sample input and output will give you better idea.
I am new to unix. Can some one help me on this?
Input:
7488 7389 chr1.fa chr1.fa
3546 9887 chr5.fa chr9.fa
7387 7898 chrX.fa chr3.fa
7488 7389 chr1.fa chr1.fa... (2 Replies)
Discussion started by: koneru_18
2 Replies
3. Shell Programming and Scripting
Hi guys,
I am trying to identify the number of duplicate entries in a string inputed by the user. Here is a command I use:
$ user_input="M T T"
$echo "${user_input}" | awk '{for(i=0;i<=NF;i++) print $i }'| sort | uniq -d
The above works fine for string with multiple letters. The problem is... (2 Replies)
Discussion started by: aoussenko
2 Replies
4. UNIX for Dummies Questions & Answers
Hi
my inFile has 3 fields with duplicates in field1.
I would like to print the average field2 and field3 for the duplicated field1.
$cat inFile
f1 f2 f3
A 7 2
B 4 2
B 2 3
C 6 5
D 15 2
D 5 3
D 10 4$cat outFile
f1 f2 f3
A 7 2... (8 Replies)
Discussion started by: jdhahbi
8 Replies
5. Shell Programming and Scripting
Hi,
I have a file in the below format.,
test test (10)
to to (25)
see see (45)
and i need the output in the format of
test 10
to 25
see 45
Some one help me? (6 Replies)
Discussion started by: imdadulla
6 Replies
6. UNIX for Dummies Questions & Answers
Hi,
How to eliminate the duplicate values in unix? I have a excel file which contains duplicate values.
Need to use this in a script.
Thanks in advance. (3 Replies)
Discussion started by: venkatesht
3 Replies
7. Shell Programming and Scripting
Can some one provide me a shell script.
I have file with many columns and many rows. need to sort the first column and then remove the duplicates records if exists.. finally print the full data with first coulm as unique.
Sort BASED ON FIRST FIELD and remove the duplicates if exists... (2 Replies)
Discussion started by: tuffEnuff
2 Replies
8. Shell Programming and Scripting
Masters,
I have a text file in the following format.
vrsonlviee RVEBAALSKE
lyolzteglx UUOSIWMDLR
pcybtapfee DKGFJBHBJO
ozhrucfeau YQXATYMGJD
cjwvjolrcv YDHALRYQTG
mdukphspbc CQZRIOWEUB
nbiqomzsgw DYSUBQSSPZ
xovgvkneav HJFQQYBLAF
boyyzdmzka BVTVUDHSCR
vrsonlviee TGTKUCUYMA... (2 Replies)
Discussion started by: genehunter
2 Replies
9. Shell Programming and Scripting
I have input file like below.
I00789524 0213 5212
D00789524 0213 5212
I00778787 2154 5412
The first two records are same(Duplicates) except I & D in the first character. I want non duplicates(ie. 3rd line) to be output. How can we get this . Can you help. Is there any single AWK or SED... (3 Replies)
Discussion started by: awk_beginner
3 Replies
10. HP-UX
how to get duplicates in a file containing data in columns using command or scripting? (4 Replies)
Discussion started by: megh
4 Replies