Sponsored Content
Full Discussion: Sort and Unique in Perl
Top Forums Shell Programming and Scripting Sort and Unique in Perl Post 302165725 by MobileUser on Friday 8th of February 2008 03:10:24 PM
Old 02-08-2008
Sort and Unique in Perl

Almost same as MatrixMadhan's. Row count was not included, so the following code is just for completeness:

Code:
#!/usr/bin/perl -w
use strict;

# Program to get unique values for 3rd column and print them

open(FILE, "b.txt");

my %list = ();

while(<FILE>){
   chomp;
   my @array = split(/\|/);
   $list{$array[2]}++;
}

close(FILE);

# Print out the results

foreach my $value (sort keys %list) {
   print "The unique values are $value\n";
}

print "Number of rows are ".keys(%list);

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

unique sort contents of a variable

Hi , I have #echo $var1 #hdisk2 hdisk3 hdisk0 hdisk2 Now I need to remove duplicate entries from this . ie. after sorting it should only have hdisk2 hdisk3 hdisk0 . I can have these values in a array as well . I understand we can use sort -u to remove the duplicates in a... (2 Replies)
Discussion started by: praveenbvarrier
2 Replies

2. Shell Programming and Scripting

Perl sort unique by one field only

Hi all, I've searched the forum and I can find some code to sort uniquely in perl but not by a single field. I have a file with data such as the following: 1,test,34 1,test2,65 2,test,35, 1,test3,34 2,test,34 What i want to do is sort it uniqely by the first field only so I'd end... (2 Replies)
Discussion started by: Donkey25
2 Replies

3. Shell Programming and Scripting

What some ideas with sort and get unique data

Hi all, I am writing a script where i can parse through the directory and get common string in two directories i get. The command below SUN_PLATFORM=`$FIND $STREAM_PATH . -depth -name ShareableEntities | $AWK -F"/" '{if($10 ~ /sun5/) print $0}'` gives the following output:- ... (1 Reply)
Discussion started by: asirohi
1 Replies

4. Shell Programming and Scripting

Awk sort and unique

Input file --------- 12:name1:|host1|host1|host2|host1 13:name2:|host1|host1|host2|host3 14:name3: ...... Required output --------------- 12:name1:host1(2)|host1(1) 13:name2:host1(2)|host2(1)|host3(1) 14:name3: where (x) - Count how many times field appears in last column ... (3 Replies)
Discussion started by: greycells
3 Replies

5. Shell Programming and Scripting

Unique sort with two fields

I have a file with contents below 123,502 123,506 123,702 234,101 235,104 456,104 456,100 i want to sort such that i get a unique value in column A, and for those with multiple value in A, i want the lowest value in B. output should be 123,502 234,101 235,104 456,100 (3 Replies)
Discussion started by: dealerso
3 Replies

6. Shell Programming and Scripting

Unique sort with three fields

I have another file with three columns A,B,C as below 123,1,502 123,2,506 123,3,702 234,4,101 235,5,104 456,6,104 456,7,100 i want to sort such that i get a unique value in column A, and for those with multiple value in A, i want the lowest value in C. output should be Code:... (3 Replies)
Discussion started by: dealerso
3 Replies

7. Shell Programming and Scripting

sort split merge -u unique

Hi, this is about sorting a very large file (like 10 gb) to keep lines with unique entries across SOME of the columns. The line originally looked like this: sort -u -k2,2 -k3,3n -k4,4n -k5,5n -k6,6n file_unsorted > file_sorted please note the -u flag. The problem is that this single... (4 Replies)
Discussion started by: jbr950
4 Replies

8. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

9. Shell Programming and Scripting

Sort unique by multiple fields

i need to sort to get all the unique records based on the 1st and 2nd column, and keep the record with the highest value on 5th column if there are duplicates, every column with varies length a^2^x^y^z bxc^2xx2^aa^bvxxxx^cdd a^3^1^2^3 a^2^x^1^c I want a result which will only keep the 1st... (2 Replies)
Discussion started by: dtdt
2 Replies

10. Shell Programming and Scripting

Sort unique

Hi, I have an input file that I have sorted in a previous stage by $1 and $4. I now need something that will take the first record from each group of data based on the key being $1 Input file 1000AAA|"ZZZ"|"Date"|"1"|"Y"|"ABC"|""|AA 1000AAA|"ZZZ"|"Date"|"2"|"Y"|"ABC"|""|AA... (2 Replies)
Discussion started by: Ads89
2 Replies
Async::MergePoint(3pm)					User Contributed Perl Documentation				    Async::MergePoint(3pm)

NAME
"Async::MergePoint" - resynchronise diverged control flow SYNOPSIS
use Async::MergePoint; my $merge = Async::MergePoint->new( needs => [ "leaves", "water" ], ); my $water; Kettle->boil( on_boiled => sub { $water = shift; $merge->done( "water" ); } ); my $tea_leaves; Cupboard->get_tea_leaves( on_fetched => sub { $tea_leaves = shift; $merge->done( "leaves" ); } ); $merge->close( on_finished => sub { # Make tea using $water and $tea_leaves } ); DESCRIPTION
Often in program logic, multiple different steps need to be taken that are independent of each other, but their total result is needed before the next step can be taken. In synchonous code, the usual approach is to do them sequentially. An asynchronous or event-based program could do this, but if each step involves some IO idle time, better overall performance can often be gained by running the steps in parallel. A "Async::MergePoint" object can then be used to wait for all of the steps to complete, before passing the combined result of each step on to the next stage. A merge point maintains a set of outstanding operations it is waiting on; these are arbitrary string values provided at the object's construction. Each time the "done()" method is called, the named item is marked as being complete. When all of the required items are so marked, the "on_finished" continuation is invoked. For use cases where code may be split across several different lexical scopes, it may not be convenient or possible to share a lexical variable, to pass on the result of some asynchronous operation. In these cases, when an item is marked as complete a value can also be provided which contains the results of that step. The "on_finished" callback is passed a hash (in list form, rather than by reference) of the collected item values. This module was originally part of the IO::Async distribution, but was removed under the inspiration of Pedro Melo's Async::Hooks distribution, because it doesn't itself contain anything IO-specific. CONSTRUCTOR
$merge = Async::MergePoint->new( %params ) This function returns a new instance of a "Async::MergePoint" object. The %params hash takes the following keys: needs => ARRAY Optional. An array containing unique item names to wait on. The order of this array is not significant. on_finished => CODE Optional. CODE reference to the continuation for when the merge point becomes ready. If provided, will be passed to the "close" method. METHODS
$merge->close( %params ) Allows an "on_finished" continuation to be set if one was not provided to the constructor. on_finished => CODE CODE reference to the continuation for when the merge point becomes ready. The "on_finished" continuation will be called when every key in the "needs" list has been notified by the "done()" method. It will be called as $on_finished->( %items ) where the %items hash will contain the item names that were waited on, and the values passed to the "done()" method for each one. Note that this is passed as a list, not as a HASH reference. While this feature can be used to pass data from the component parts back up into the continuation, it may be more direct to use normal lexical variables instead. This method allows the continuation to be placed after the blocks of code that execute the component parts, so it reads downwards, and may make it more readable. $merge->needs( @keys ) When called on an open MergePoint (i.e. one that does not yet have an "on_finished" continuation), this method adds extra key names to the set of outstanding names. The order of this list is not significant. This method throws an exception if the MergePoint is already closed. $merge->done( $item, $value ) This method informs the merge point that the $item is now ready, and passes it a value to store, to be passed into the "on_finished" continuation. If this call gives the final remaining item being waited for, the "on_finished" continuation is called within it, and the method will not return until it has completed. EXAMPLES
Asynchronous Plugins Consider a program using "Module::Pluggable" to provide a plugin architecture to respond to events, where sometimes the response to an event may require asynchronous work. A "MergePoint" object can be used to coordinate the responses from the plugins to this event. my $merge = Async::MergePoint->new(); foreach my $plugin ( $self->plugins ) { $plugin->handle_event( "event", $merge, @args ); } $merge->close( on_finished => sub { my %results = @_; print "All plugins have recognised $event "; } ); Each plugin that wishes to handle the event can use its own package name, for example, as its unique key name for the MergePoint. A plugin handling the event synchonously could perform something such as: sub handle_event { my ( $event, $merge, @args ) = @_; .... $merge->needs( __PACKAGE__ ); $merge->done( __PACKAGE__ => $result ); } Whereas, to handle the event asynchronously the plugin can instead perform: sub handle_event { my ( $event, $merge, @args ) = @_; .... $merge->needs( __PACKAGE__ ); sometime_later( sub { $merge->done( __PACKAGE__ => $result ); } ); } AUTHOR
Paul Evans <leonerd@leonerd.org.uk> perl v5.12.3 2011-06-10 Async::MergePoint(3pm)
All times are GMT -4. The time now is 11:01 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy