05-03-2005
select distinct row from a file
Hi, buddies out there.
I have a text file ( only one column ) which I created using vi editor. The file contains duplicate rows and I would like to select distinct rows, how to go on it using unix command:
file content =
apple
apple
orange
watermelon
apple
orange
Can it be done without using SQL? maybe something like "grep command" can help?
Thanks
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
How do I create a script that provides a count of distinct values of a particular field in a file utilizing commonly available UNIX commands (sh or awk)?
Field1|Field2|Field3|Field4
AAA|BBB|CCC|DDD
111|222|333|777
AAA|EEE|ZZZ|EEE
111|555|333|444
AAA|EEE|CCC|DDD
111|222|555|444
For... (2 Replies)
Discussion started by: Refresher
2 Replies
2. Shell Programming and Scripting
Hi ,
I have a similar problem.
Please can anyone help me with a shell script or a perl.
I have a flat file like this
fruit country
apple germany
apple india
banana pakistan
banana saudi
mango india
I want to get a output like
fruit country
apple ... (7 Replies)
Discussion started by: smalya
7 Replies
3. Programming
Hello there.
I've got the query like that
SELECT count(tour_id) AS cnt
FROM orders
JOIN tours
ON orders.tour_id=tours.id
GROUP BY tour_id
The result Is
cnt
1
4
2
1
1
Now i have to select all records with minimum values in field "cnt"
MySQL function min() returns only one.... (2 Replies)
Discussion started by: Trump
2 Replies
4. Shell Programming and Scripting
I have . dat file which contains data in a specific format:
0 3 892 921 342
1 3 921 342 543
2 4 817 562 718 765
3 3 819 562 717 761
i need to compare each field in a row with another field of the same column but different row and cont the... (8 Replies)
Discussion started by: Abhik
8 Replies
5. Shell Programming and Scripting
Hi, I have an output like this:
#CMD
Output:
user1
user2
user3
user4
How can I select ONLY the first row?
Thanks (4 Replies)
Discussion started by: iga3725
4 Replies
6. UNIX for Dummies Questions & Answers
Hi,
I have a tab-delimited file as follows:
1 1 2 2 3 3 4 4
a a b b c c d d
5 5 6 6 7 7 8 8
e e f f g g h h
9 9 10 10 11 11 12 12
i i j j k k l l
13 13 14 14 15 15 16 16
m m n n o o p p
The output I need is:
1 1 a a 5 5 e e 9 9 i i 13... (5 Replies)
Discussion started by: mvaishnav
5 Replies
7. Shell Programming and Scripting
Hi, I have the following file:
LOG:015608::ERR:2310:map_spsrec:Invalid parameter
LOG:015608::ERR:2471:map_dgdrec:Invalid parameter
LOG:015608::ERR:2487:map_nnmrec:Invalid number
LOG:015608::ERR:2310:map_nmrec:Invalid number
LOG:015608::ERR:2438:map_nmrec:Invalid number
As a delimiter I... (2 Replies)
Discussion started by: apenkov
2 Replies
8. Shell Programming and Scripting
Hi ,
i need to display only one of duplicated values and merged them in one record only when tag started with 3100.2.128.8
3100.2.97.1=192.168.0.12
3100.2.128.8=418/66/03e9/0044801
3100.2.128.8=418/66/03ea/0044601
3100.2.128.8=418/66/03e9/0044801
3100.2.128.8=418/66/03ea/0044601... (5 Replies)
Discussion started by: OTNA
5 Replies
9. Shell Programming and Scripting
Hi all!
I would like to solve a problem but I have no clue of how do it!I will be grateful if someone could help me!
Briefly I have a big file like this:
>ENSMUSG00000000204 | ENSMUST00000159637
GGCGAGGCTTACGCCATTTTACCTCAGCGAGCATTCATAAAGCTGCGAGCATTCATACAG
>ENSMUSG00000000204 |... (3 Replies)
Discussion started by: giuliangiuseppe
3 Replies
10. UNIX for Dummies Questions & Answers
Hi
How can I extract sequences from a fasta file with respect a certain criteria? The beginning of my file (containing in total more than 1000 sequences) looks like this:
>H8V34IS02I59VP
SDACNDLTIALLQIAREVRVCNPTFSFRWHPQVKDEVMRECFDCIRQGLG
YPSMRNDPILIANCMNWHGHPLEEARQWVHQACMSPCPSTKHGFQPFRMA... (6 Replies)
Discussion started by: Marion MPI
6 Replies
ARSORT(3) 1 ARSORT(3)
arsort - Sort an array in reverse order and maintain index association
SYNOPSIS
bool arsort (array &$array, [int $sort_flags = SORT_REGULAR])
DESCRIPTION
This function sorts an array such that array indices maintain their correlation with the array elements they are associated with.
This is used mainly when sorting associative arrays where the actual element order is significant.
PARAMETERS
o $array
- The input array.
o $sort_flags
- You may modify the behavior of the sort using the optional parameter $sort_flags, for details see sort(3).
RETURN VALUES
Returns TRUE on success or FALSE on failure.
EXAMPLES
Example #1
arsort(3) example
<?php
$fruits = array("d" => "lemon", "a" => "orange", "b" => "banana", "c" => "apple");
arsort($fruits);
foreach ($fruits as $key => $val) {
echo "$key = $val
";
}
?>
The above example will output:
a = orange
d = lemon
b = banana
c = apple
The fruits have been sorted in reverse alphabetical order, and the index associated with each element has been maintained.
SEE ALSO
asort(3), The comparison of array sorting functions.
PHP Documentation Group ARSORT(3)