Shell Programming and Scripting

Hi All,

I have two sets of files with names .dat and .txt. The number of files is really large more than 90000. The files have names like 1.dat, 2.dat,3.dat and so on where as txt files have names like 1.txt, 2.txt, 3.txt and so on

The DAT and TXT files are equal in number. About 90000 each

1.dat files look like this:

Code:

234422 1 .00222
323232 1 3232
32323 1 0.00222
1234 1 1211
2332 1 0.9
233 1 0.883
123 1 45

and its corresponding 1.txt file looks like this:

Code:

123
233
2332
1234
32323
323232
234422

Numbers in the first column of 1.dat are also there in 1.txt in some other order. But the numbers present in 1 column in 1.dat are guaranteed to be found in 1.txt also. This goes with 2.dat, 2.txt and 3.dat, 3.txt and so on.

My requirement is to sort the columns in the 1.dat file so that the numbers in first column align with those in the 1.txt. This is what I mean (suppose my output file is 1.aligned):

Code:

123 1 45
233 1 0.883
2332 1 0.9
1234 1 1211
32323 1 0.00222
323232 1 3232
234422 1 .00222

As you can see, the order of numbers in the first column in 1.align is same as that in 1.txt. Nothing has changed only I have sorted the numbers based on 1.txt and first column of 1.dat and aligned them together in 1.align and I have to do this for all 90000 files.

I am using Linux with BASH.

Code:

awk 'NR==FNR{a[$1]=$0;next} {print a[$1]}' 1.dat 1.txt

--ahamed

Code:

awk '
NR == FNR { a[$1] = $0  }
NR != FNR { print a[$0] }' 1.dat 1.txt

Check and then wrap it in a loop like this:

Code:

for i in $(seq 1 90000); do                                                            
  echo "$i.dat $i.txt"
done

Thanks.

I was trying to modify the above code and came up with this haven't check it:

Code:

find . -name '*.dat'| xargs  awk 'NR==FNR{a[$1]=$0;next}{print a[$1]}' *.txt

I wish I was an owner of a company

---------- Post updated at 12:48 PM ---------- Previous update was at 12:45 PM ----------

Oh yes, mine wont work. I disregarded the sequence loop completely.

Code:

#!/bin/ksh
for txt in *.txt
do
  num=`echo $txt | cut -f1 -d"."`
  awk 'NR==FNR{a[$1]=$0;next}{print a[$1]}' $num.dat $num.txt >> $num.sorted
done

--ahamed