Shell Programming and Scripting

Hi Friends,

I have a file1 with 3400 records that are tab separated and I have a file2 with 6220 records. I want to merge both these files. I tried using join file1 and file2 after sorting. But, the records should be (3400*6220 = 21148000). Instead, I get only around 11133567. Is there anything that I am doing wrong. Also, is there a way to join each record in file1 to each record in file2 using awk?

File1
a b c d
e f g h

File2
1 2 3 4
5 6 7 8

Output
a b c d 1 2 3 4
a b c d 5 6 7 8
e f g h 1 2 3 4
e f g h 5 6 7 8






Also, can some tell me how to find the max of column in awk. I tried the following one...

awk 'max=="" || $2 > max {max=$2} END{ print max}' FS=" " input.txt

But, that gives only for numerical values. And, I have a mix of numbers and characters in column6. Ex: xyz_123 to xyz_4453. But, the max on $6 is showing to be xyz_999.

Thanks in advance.

All helps appreciated.

Can you please paste the join command you are using for this?

An awk solution...

Code:

awk 'NR==FNR{a[$0];next} { for(i in a){print i, $0} }' file1 file2 | sort

To count the max column

Code:

awk '{max=NF>max?NF:max}END{print max}' infile

--ahamed

Try this for join command:

Code:

while read LINE
do
sed -e "s/^/${LINE}/g" File2
done < File1

Code:

awk 'NR==FNR{a[FNR]=$0;max2=FNR;next} {for (i=1;i<=max2;i++) print $0,a[i]}' file2 file1

Join file1 file2 > file3

Really? I don't think that will work. At least it is not working for me, not with the data samples provided unless you have tried it with actual data where there is some common factor.

man join
BTW, does the awk solution works for you?

--ahamed

oops...I am sorry. Thanks for reminding me.

my files are this way.

File1
x y z
x d e
a b c
a g h

File2
x 1 2 3 4
a 5 6 7 8
y 3 4 5 6

Output
x y z 1 2 3 4
x d e 1 2 3 4
a b c 5 6 7 8.
a g h 5 6 7 8


I apologize for my insanity.

All the codes work for each record by reach record.

But, is there a way to match it to the first column of file1 to the first column of file 2 and then only print the output?

Thanks in advance.