Shell Programming and Scripting

Hi gurus,

I have done my best to be as precisely as possible with this.
Besides giving the format of file a and file b and the result file
I have also given the algorithm as I have figured out.
I will try to do this and I hope that some of you could help
me to solve this or better yet present me with a solution.
This could really help my learning experience!.

Thank you

Please read below for a carefull explanation of the whole task

>>>>>>>>>>>>>>
File A

Type;Owner;Prefix;AddressType;hostType;Bitmask;BlockType;isSubnet
Block;Company;172.16.0.0;IPv4;;16;normal;ordinary;;;;;
Block;Company;172.16.0.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.0.0;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.0.128;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.1.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.1.0;IPv4;;25;normal;ordinary;;;;;;;"operations";"noc"
Block;Company;172.16.1.128;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.2.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.2.0;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.2.0;IPv4;;27;"address_set";ordinary;;;;;;;

>>>>>>>>>>>>>>>>>>>>>>
File B

Host;Company;172.16.1.1;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.4;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.5;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.19;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.20;IPv4;user;;;;;;;;;;;;;;;om-zl-hs4a077-cs01.network.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.31;IPv4;user;;;;;;;;;;;;;;;sx11.operations.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.88;IPv4;user;;;;;;;;;;;;;;;cdsrv03.operations.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.127;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.129;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.1;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.4;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.5;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.7;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.8;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.9;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.10;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;

>>>>>>>>>>>>>>>>>>>>>>>>>
Result File

Type;Owner;Prefix;AddressType;hostType;Bitmask;BlockType;isSubnet
Block;Company;172.16.0.0;IPv4;;16;normal;ordinary;;;;;
Block;Company;172.16.0.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.0.0;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.0.128;IPv4;;25;normal;ordinary;;;;;;;
Block;Company;172.16.1.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.1.0;IPv4;;25;"address_set";ordinary;;;;;;;"operations";"noc"
Host;Company;172.16.1.1;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.4;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.5;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.19;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.1.20;IPv4;user;;;;;;;;;;;;;;;om-zl-hs4a077-cs01.network.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.31;IPv4;user;;;;;;;;;;;;;;;sx11.operations.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.88;IPv4;user;;;;;;;;;;;;;;;cdsrv03.operations.company;;;;;;;;;;;;;;;;
Host;Company;172.16.1.127;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Block;Company;172.16.1.128;IPv4;;25;"address_set";ordinary;;;;;;;
Host;Company;172.16.1.129;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Block;Company;172.16.2.0;IPv4;;24;normal;ordinary;;;;;;;
Block;Company;172.16.2.0;IPv4;;25;"address_set";ordinary;;;;;;;
Host;Company;172.16.2.1;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.4;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.5;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.7;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.8;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.9;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Host;Company;172.16.2.10;IPv4;user;;;;;;;;;;;;;;;N/A;;;;;;;;;;;;;;;;
Block;Company;172.16.2.0;IPv4;;27;"address_set";ordinary;;;;;;;

>>>>>>>>>>>>>
The way I think it could be solved


I want to solve this by reading file A line by line.
If column 1 of a line is equal to Block, then read column 3 (prefix) and save the result temporarily.
Next read column 3 (prefix) of the next line and compare it with the previous line, if the value is
equal to the previous line we proceed with the next line. We will not go to the next line if we find
a value of column 3 on the next line which is greater than the value of column 3 on the current line.
Now that we are on a line where the value of column 3 of the next line is not equal to the value of
column 3 of the previous line we will do the work. First we change column 7 to be equal to "address_set".
Next we read column 6 (which is by now the most specific bitmask) of the current line.
With column 3 and 6 from the current line we calculate all possible addresses including the network and
broadcast address (e.g if column 3 is 10.10.10.0 and column 6 25, we have addresses 10.10.10.0
to 10.10.10.127). With this set of calculated IP addresses we will compare against column 3 of each line
of File B. If there is a match the whole line of File B where the match has been found is copied below
the line in File A where we are currently, and next we move to this new added line.
The line we have copied from file B is deleted from File B and copied to a separate file called processed.
When we have processed all calculated IP addresses we will look for the next line with a value of Block
in column 1. From there on we will repeat the whole process again. We keep doing this till there are no
more lines in File A to process.

LJ

So use your algorithm and awk like this:

Code:

awk -F\; 'FILENAME=="fileA" { processA; } FILENAME=="fileB" { processB; } '\
'{ # do something here for both files after processing in processA and processB }'