Shell Programming and Scripting

hi,

I have 2 large lists:

LIST A: containes 6 fields of many entries (VARIABLE number), like:

2011-07-10 | 18:19:47 | 38037300 | 9647808003122 | 2 | success

LIST B: containes 3 fields & 183 entries (FIXED number), like:

9647805651885 9647805651885 SCP_10

What I want is a CODE for:

comparison for each number (say: X) in 7th field of "LIST A", over the complete range of entries in "LIST B", through
for-do-done loop inside another one, such that:

(a) If this X fulfil the inequality: NUM1< X < NUM2 ==> then lock on this entry & take the correspondent VAL (in LIST B), and
append it in the 7th field of LIST A (in front of the "X", within the same line)... AND break out the loop, to take another value
in LIST A (say: Y) to do the same comparison over the whole range of LIST B... and so on till completing all values of LIST A.

(b) Otherwise (if X does not lie between NUM1 & NUM2) ==> then render for another run of loop to check with the next entry, and
so on... till finding it... and BREAK out of loop... & return to LIST A to take another value.

(c) If not found over the whole range of LIST B ==> then append "NotFound"
in the 7th field of LIST A (in front of the "X", within the same line).

To end up with FINAL LIST A of 7 fields (the required VALues in the 7th field).

EX for SUCCESSFUL found VALues:

2011-07-10 | 18:19:47 | 38037300 | 9647808003122 | 2 | success | SCP_5

EX for NOT FOUND VALues:

2011-07-10 | 16:32:47 | 38045300 | 9647818553444 | 5 | success | NotFound



Thanks in advance.

BR,
Ahmed

Any input guys?

Actually I'm surveying forums, & I think this can be done by NAWK.
I'm trying to figure it out, but your help is highly needed & appreciated.

BR,
Ahmed

Not able to understand requirement as it is not clear. Please post sample input file and desire o/p file.

Is there anything you have tried yourself so far? Also refrain bumping up your posts if you don't get an answer immediately - this is no Script-Drive-In. You don't have to pay so you don't have to demand.
Also please start using code tags when posting code, data or logs etc. to enhance readability and keep formatting etc.

As far as I my understanding of your requirement

I assume LISTA and LISTB you mentioned are files.

Code:

while read line
 do
 c=0
 num=`echo $line| cut -d"|" -f4`
 while read line1
 do
 num1=`echo $line1 | cut -d" " -f1`
 num2=`echo $line1 | cut -d" " -f2`
 fie=`echo $line1 | cut -d" " -f3`
 if [ $num -ge $num1 -a $num -le $num2 -a $c -ne 1 ] ;
 then
 echo "$line | $fie"
 c=1
 fi
 done < LISTB
 if [ $c -eq 0 ];
 then
 echo "$line | not found"
 fi
 done < LISTA

Respectively:

_Not exactly. I've seen similar case on forums, but I'm not sure.
However, I'm trying to tailor it to my case... & see.
_Noted.
_No Coment.
_Noted.

Tnx

---------- Post updated at 04:05 PM ---------- Previous update was at 01:57 PM ----------

Many Thanks panyam, it worked... & u r right in ur assumption (2 files).
But unfortunately, it is SLOW (given that I'm using a test LISTA - much less in size than the actual one).

However, I've seen the following case similar to mine in forums. But, unfortunately didn't work for my case (after making some modifications). I think this solution is nice to do.

Code:

 
$ cat file1
41.138.128.0    41.138.159.255  location1
41.138.160.0    41.138.191.255  location2
41.138.192.0    41.138.207.255  location3
41.138.208.0    41.138.223.255  location4
41.138.224.0    41.138.239.255  location5
41.138.240.0    41.138.255.255  location6
41.138.32.0     41.138.63.255   location7
41.138.64.0     41.138.71.255   location8
41.138.72.0     41.138.79.255   location9
41.138.80.0     41.138.87.255   location10
$ cat file2
41.138.208.3    information
41.138.80.23    information
41.138.11.23    information
11.138.11.23    information

awk '
NR==FNR {split($1,s,".");        #file1
         split($2,e,".");
         a[NR]=$3;               #loc. 
         b[NR]=s[1] FS s[2];     #1st 2 digits of IP min
         c[NR]=s[3];             #3rd digit of IP min
         d[NR]=e[3];             #3rd digit of IP max
         i=NR;
         next
        }
{  split($1,ip,".")              #IP of file2
   for (j=1;j<=i;j++) 
      if (ip[1] FS ip[2]==b[j] && ip[3]>=c[j] && ip[3]<=d[j]) { print $0 FS a[j];break}
}' file1 file2

O/P:
41.138.208.3    information location4
41.138.80.23    information location10

Any ideas to make this work on my case, with the following simplification (samples below):

Code:

 
My LISTA:
 
2011-07-10  18:19:47  38037300   9647808003122   2   success
2011-07-10  18:19:47  38037307   9647800147864   2   success 
 
My LIST B:
 
9647805651885 9647805651885 SCP_10
9647812649216 9647812649216 SCP_12

Thanks in advance.
Ahmed

---------- Post updated at 04:08 PM ---------- Previous update was at 04:05 PM ----------

Many Thanks panyam, it worked... & u r right in ur assumption (2 files).
But unfortunately, it is SLOW (given that I'm using a test LISTA - much less in size than the actual one).

However, I've seen the following case similar to mine in forums. But, unfortunately didn't work for my case (after making some modifications). I think this solution is nice to do.


Quote:
Sorry, I didn't elaborate on my problem. field1 and field2 from file1 are Legal IP addresses forming a section(e.g. from 111.111.111.0 to 111.111.111.255).
I want to get the 'location' filed from file1 given an IP address(the first field from file2) falling within the section.
The IP sections in file1 are sorted.


Code:
$ cat file141.138.128.0 41.138.159.255 location141.138.160.0 41.138.191.255 location241.138.192.0 41.138.207.255 location341.138.208.0 41.138.223.255 location441.138.224.0 41.138.239.255 location541.138.240.0 41.138.255.255 location641.138.32.0 41.138.63.255 location741.138.64.0 41.138.71.255 location841.138.72.0 41.138.79.255 location941.138.80.0 41.138.87.255 location10$ cat file241.138.208.3 information41.138.80.23 information41.138.11.23 information11.138.11.23 informationawk 'NR==FNR {split($1,s,"."); #file1 split($2,e,"."); a[NR]=$3; #loc. b[NR]=s[1] FS s[2]; #1st 2 digits of IP min c[NR]=s[3]; #3rd digit of IP min d[NR]=e[3]; #3rd digit of IP max i=NR; next }{ split($1,ip,".") #IP of file2 for (j=1;j<=i;j++) if (ip[1] FS ip[2]==b[j] && ip[3]>=c[j] && ip[3]<=d[j]) { print $0 FS a[j];break}}' file1 file2O/P:41.138.208.3 information location441.138.80.23 information location10
Any ideas to make this work on my case, with the following simplification (samples below):



Code:
My LISTA: 2011-07-10 18:19:47 38037300 9647808003122 2 success2011-07-10 18:19:47 38037307 9647800147864 2 success My LIST B: 9647805651885 9647805651885 SCP_109647812649216 9647812649216 SCP_12


Thanks in advance.
Ahmed


---------- Post updated at 04:11 PM ---------- Previous update was at 04:08 PM ----------

Many Thanks panyam, it worked... & u r right in ur assumption (2 files).
But unfortunately, it is SLOW (given that I'm using a test LISTA - much less in size than the actual one).

However, I've seen the following case similar to mine in forums. But, unfortunately didn't work for my case (after making some modifications). I think this solution is nice to do.


Quote:
Sorry, I didn't elaborate on my problem. field1 and field2 from file1 are Legal IP addresses forming a section(e.g. from 111.111.111.0 to 111.111.111.255).
I want to get the 'location' filed from file1 given an IP address(the first field from file2) falling within the section.
The IP sections in file1 are sorted.


Code:
$ cat file141.138.128.0 41.138.159.255 location141.138.160.0 41.138.191.255 location241.138.192.0 41.138.207.255 location341.138.208.0 41.138.223.255 location441.138.224.0 41.138.239.255 location541.138.240.0 41.138.255.255 location641.138.32.0 41.138.63.255 location741.138.64.0 41.138.71.255 location841.138.72.0 41.138.79.255 location941.138.80.0 41.138.87.255 location10$ cat file241.138.208.3 information41.138.80.23 information41.138.11.23 information11.138.11.23 informationawk 'NR==FNR {split($1,s,"."); #file1 split($2,e,"."); a[NR]=$3; #loc. b[NR]=s[1] FS s[2]; #1st 2 digits of IP min c[NR]=s[3]; #3rd digit of IP min d[NR]=e[3]; #3rd digit of IP max i=NR; next }{ split($1,ip,".") #IP of file2 for (j=1;j<=i;j++) if (ip[1] FS ip[2]==b[j] && ip[3]>=c[j] && ip[3]<=d[j]) { print $0 FS a[j];break}}' file1 file2O/P:41.138.208.3 information location441.138.80.23 information location10
Any ideas to make this work on my case, with the following simplification (samples below):



Code:
My LISTA: 2011-07-10 18:19:47 38037300 9647808003122 2 success2011-07-10 18:19:47 38037307 9647800147864 2 success My LIST B: 9647805651885 9647805651885 SCP_109647812649216 9647812649216 SCP_12


Thanks in advance.
Ahmed

How about perl

Code:

#!/usr/bin/perl
open(LA,"<","listA") or die "canot open file listA\n";
open(LB,"<","listB") or die "canot open file listB\n";

while (<LA>) {
$flg=0;
chomp;
$line=$_;
$val=(split(/\|/))[3];
while (<LB>) {
        chomp;
        @flds=split;
        if ($val >= $flds[0] and $val <= $flds[1] ) {
                print $line,"|", $flds[2],"\n";
                $flg=1;
                last;
        }
}
if ($flg == 0) { print $line,"|Not Found\n"; }
}
close(LA);
close(LB);