Shell Programming and Scripting

Aigles,
As I said:

Dear Guru
Thanks lot for your efforts and love to see the result and surely have devoted good time for my question.Hats of to you for your in deapth
reply which will not only increase my knowledge but my respect for
you and this Forum .

inputfile:

1 aaa 1/01/1975 delhi
2 bbb 2/03/1977 mumbai
3 ccc 2/03/1977 mumbai
4 ddd 1/01/1975 chennai
5 aaa 1/01/1975 kolkatta
6 bbb 2/03/1977 bangalore


program1:

sort -k2,3 inputfile | \
awk '
BEGIN { first_duplicate = 1 }
{
name = $2;
dob = $3;
if (name == prv_name && dob == prv_dob) {
if (first_duplicate)
print "\n" prv_rec;
print $0;
first_duplicate = 0;
} else {
prv_name = name;
prv_dob = dob;
prv_rec = $0;
first_duplicate = 1;
}
}
'

Result:
>

1 aaa 1/01/1975 delhi
5 aaa 1/01/1975 kolkatta

2 bbb 2/03/1977 mumbai
6 bbb 2/03/1977 bangalore
>

Questions:

How do I direct the result to a output.file given the code in program1?

------------------------------------------------------------------------

Program 2:

#Sort is now ( sort -k3,3 inputfile)

sort -k2,3 inputfile | \
awk '
BEGIN { first_duplicate = 1 }
{
name = $2;
dob = $3;
# And if (name == prv_name && dob == prv_dob) become if (name != prv_name && dob == prv_dob)#
if (name != prv_name && dob == prv_dob) {
if (first_duplicate)
print "\n" prv_rec;
print $0;
first_duplicate = 0;
} else {
prv_name = name;
prv_dob = dob;
prv_rec = $0;
first_duplicate = 1;
}
}
'

Result:

>

1 aaa 1/01/1975 delhi
4 ddd 1/01/1975 chennai

2 bbb 2/03/1977 mumbai
3 ccc 2/03/1977 mumbai
>

Questions:

What codes change are needed to have program 3 to give similar results of that program 1 and program 2?

Expert please help!



Program 3 codes:


nawk '{
idx= $2 SUBSEP $3
arr[idx] = (idx in arr) ? arr[idx] ORS $0 : $0
arrCnt[idx]++
}
END {
for (i in arr)
if (arrCnt[i] > 1) print arr[i]
}' myInputfile

Program 1: after the last ' add:

Code:

 > newfile

I suppose your requirements is this:
input(a):

Code:

1 aaa 1/01/1975 delhi
2 bbb 2/03/1977 mumbai
3 aaa 1/01/1976 mumbai
4 bbb 2/03/1975 chennai
5 aaa 1/01/1975 kolkatta
6 bbb 2/03/1977 bangalore

output:

Code:

2 bbb 2/03/1977 mumbai
6 bbb 2/03/1977 bangalore

1 aaa 1/01/1975 delhi
5 aaa 1/01/1975 kolkatta

code:

Code:

awk '{
num[$2$3]=num[$2$3]+1
str[$2$3]=str[$2$3]"\n"$0
}
tr[$2$3]=str[$2$3]"\n"$0
}
END{
for (i in num)
if (num[i]>=2)
print str[i]
}' a

Code:

#! /opt/third-party/bin/perl

open(FILE, "<", "input");

while(<FILE>) {
  chomp;
  my @arr = split(/ /);
  if( defined($fileHash{$arr[1].$arr[2]}) ) {
    $fileHash{$arr[1].$arr[2]} .= ("##" . $_);
  }
  else {
    $fileHash{$arr[1].$arr[2]} = $_;
  }
}

close(FILE);

foreach my $k ( keys %fileHash ) {
  $v = $fileHash{$k};
  if( $v =~ /##/ ) {
    my @arr = split(/##/, $v);
    foreach my $a ( @arr ) {
      print "$a\n";
    }
  }
}

exit 0

This should be even faster

Thank you all for your reply!!!

I am interested in how to make this works. Please read carefully!

inputfile:

1 aaa 1/01/1975 delhi
2 bbb 2/03/1977 mumbai
3 ccc 2/03/1977 mumbai
4 ddd 1/01/1975 chennai
5 aaa 1/01/1975 kolkatta
6 bbb 2/03/1977 bangalore

program2 code:

sort -k2,3 inputfile | \
awk '
BEGIN { first_duplicate = 1 }
{
name = $2;
dob = $3;
if (name == prv_name && dob == prv_dob) {
if (first_duplicate)
print "\n" prv_rec;
print $0;
first_duplicate = 0;
} else {
prv_name = name;
prv_dob = dob;
prv_rec = $0;
first_duplicate = 1;
}
}
'

What changes are needed to to program 2 to give me the following result:

>

1 aaa 1/01/1975 delhi
4 ddd 1/01/1975 chennai

2 bbb 2/03/1977 mumbai
3 ccc 2/03/1977 mumbai
>

Many thanks!