Shell Programming and Scripting

Hi Everyone,

I have a txt file with 40k lines.
111 1.1.1.1
111 1.1.1.1
111 2.2.2.2
111 1.1.1.1
111 1.1.1.1

How would use perl to easy have IP list, the final result will be:
1.1.1.1,2.2.2.2,

I can only think using if to determine one by one through all 40k, this is working, but thought not efficient. Please advice.

Thanks

Code:

perl -lane'
  push @f, $F[1] unless $x{$F[1]}++;
  print join ",", @f if eof
  ' infile

Or if you really want the final ,:

Code:

perl -ane'
  print $F[1], "," unless $x{$F[1]}++;
  print $/ if eof
  ' infile

Thanks radoulov, it works .

I have another file:
312009 1 0620233743 0620233748 20090620235854 20.7.22.14 aaa
312009 2 0620233743 0620233748 20090620235854 20.7.22.14 aaa
312009 3 0620233743 0620233748 20090620235854 20.7.22.14 aaa
312009 5 0620233743 0620233748 20090620235854 21.7.22.14 aaa
312009 2 0620233743 0620233748 20090620235854 20.7.22.14 aaa

I would like to hav a result of:
20.7.22.1 8
21.7.22.1 5

i did:
perl -F' ' -lane '$h{$F[5]} += $F[1]; END{print "$_: $h{$_}" for sort keys %h}' a.txt

But failed, please advice Thanks




Instead of
[root@localhost ~]# perl -ane'
print $F[1], "," unless $x{$F[1]}++;
print $/ if eof
' a.txt

if i have a file a.pl, how can i put this command into that file?

Thanks

You mean 20.7.22.14, not 20.7.22.1, rigth?

Code:

perl -ane'
  $x{$F[5]} += $F[1];
  print map "$_ $x{$_}\n", sort { $x{$b} <=> $x{$a} } keys %x
    if eof
  ' infile

Sorry sorry, yes it is 20.7.22.14

Use this code as a the Perl script:

Code:

#!/usr/bin/env perl

use warnings;
use strict;

my %x;

while (<>) {
  my @F = split;
  $x{$F[5]} += $F[1];
}

print map "$_ $x{$_}\n", 
  sort { $x{$b} <=> $x{$a} } keys %x;

Thanks radoulov it works so perfect just few seconds to process my file, inside has 30k lines.

If i have a.pl, how would I transfer this code into that perl file? Thanks