Shell Programming and Scripting

Hi All,

I tried to solve this but the result gives me all zeros for one file. I failed to do for all 500 files.

I have some 500 files with the extension .dat I have another set of files; 500 in number with extension .dic I created these .dic files by using

Code:

sort -u

from the actual .dat files.

This is what I mean:
For example, my 1.dat looks like this:

Code:

apple
orange
tomato
computer
tomato
computer
apple

After I use

Code:

sort -u 1.dat

I get 1.dic like this:

Code:

apple
computer
orange
tomato

I did the same for all 500 files. That is create .dic from .dat

I have another set of files with extension .fil These files contain numbers for the words in stored in .dic Hence, for 1.dic my 1.fil looks like this:

Code:

2.33
0.55
1.43
0.0009983

Now in all, this is the scenario:
I) 1.dat the main file with the complete set of words.
II) 1.dic the file created by

Code:

sort -u

on 1.dat
III) 1.fil the file containing numbers and these numbers correspond to some values of the words stored in 1.dic, this means for every word in 1.dic, there is some value stored in 1.fil

The task which I am trying to accomplish:
I want to look in each .dic file, then get the words line by line one at a time, then get the value corresponding to that word from .fil file and then search the .dat file for the position of that word in the .dat file and store that number against the position in some separate file, lets name it 1.num.

Taking above case here's the output for 1.num:

Code:

2.33
1.43
0.0009983
0.55
0.0009983
0.55
2.33

One can notice that I just looked at the 1.dic got the word, got the corresponding value from 1.fil, then searched the 1.dat and placed that number against the position of that word in 1.num. I have to do this for some 500 files of the same types that is .dic, .dat and .fil and create 500 .num files

This is what I have done so far:

Code:

awk 'NR==FNR{
       A[$1]=NR
       next
     }
     !n{n=NR}
     FNR==1{
       ++m
       close(f)
       f=FILENAME
       sub(/\.dic/,x,f)
       k=f
       f=f".dat"
     }
     {
       getline v<f
       B[A[$1],k]=v
     }
     END{
       for(i=1;i<=n;i++){
         for(j=1;j<=m;j++)printf "%s ",B[i,j]?B[i,j]:0
         print x
       }
     }' *.dat *.dic

I am using Linux with BASH. Any help appreciated.

Using your source files

Code:

perl -e ' 
open my $keys, "<", "1.dic"; 
open my $values, "<", "1.fil";
my %hash;
while(<$keys>){
   my $value=readline($values);
   $hash{$_}=$value;
}
close($keys);
close($values);
open my $data, "<", "1.dat"; 
while (<$data>){
print $hash{$_};
}'
2.33
1.43
0.0009983
0.55
0.0009983
0.55
2.33

Or less formally

Code:

perl -e 'open K,"1.dic"; open V,"1.fil";while(<K>){$v=readline(V);$h{$_}=$v;}open D,"1.dat"; while (<D>){print $h{$_};}'

If I'm not missing something, this should work:

Code:

awk 'END { process( f ) }
FNR == 1 {      
  if ( f ) process( f )
  f = FILENAME
  sub( /\.dic$/, x, f )
  }
getline num < (f ".fil") { map[$0] = num }
func process( f ) {
  while (( getline dat < ( f ".dat" )) > 0 ) {
    print map[dat] > ( f ".num" )
    }
  close( f ".dat" ); close( f ".fil" )
  close( f ".num" ); split( x, map )      
  }' *dic