Shell Programming and Scripting

i have a input file which does not have a delimiter
All i Need to do is to identify a line and extract the data from it and run the loop again and need to ensure that it was not extracted earlier


Input file
------------
abcd 12345 egfhijk ip 192.168.0.1 CNN.com
abcd 12345 egfhijk ip 192.168.0.1 hotmail.com
abcd 12345 egfhijk STARTTLS=server ip 192.168.0.1 hotmail.com
asjdh khasdhsdf kshdfjksdhfk STARTTLS=server ip 192.168.2.43 abc.yahoo.com
sdfhh jkadfhh jasdfhjkasdhf STARTTLS=server ip 62.43.65.45 abc.cool.com
abcd 12345 egfhijk STARTTLS=server ip 192.168.0.1 hotmail.com
asjdh khasdhsdf kshdfjksdhfk STARTTLS=server ip 192.168.2.43 abc.yahoo.com
sdfhh jkadfhh jasdfhjkasdhf STARTTLS=server ip 62.43.65.45 abc.cool.com

---------

Output File
-----------
hotmail.com
yahoo.com
cool.com


you can see that the data would be repeated in the input file still i need to ensure that data is not repeated in the output file and only those lines are checked where we have STARTTLS=server

Note the input file is approx 35 MB

What have you tried?

hope its not a home work

Code:

awk '/STARTTLS/{print $NF}' filename|sort -u

perl:

Code:

open $fh,"<","a.txt";
while(<$fh>){
	if (/STARTTLS=server/){
		my @arr=split(" ",$_) ;
		my @brr=split("[.]",$arr[$#arr]);
		my $temp=sprintf("%s.%s",$brr[$#brr-1],$brr[$#brr]);
		$hash{$temp}=1;
	}
}
print join "\n", sort keys %hash;

You're a jerk.

relax.

Code:

while (<>){
 if ( /STARTTLS/ ){
   @list=split /\s/,$_;
   $hash{$list[-1]}++;
 }
}
foreach my $k ( sort( keys(%hash) ) ){print $k."\n";}

Summer cherry is a jerk, and I am perfectly relaxed.