Multiple file merge by column


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Multiple file merge by column
# 8  
Old 02-14-2013
Sorry for late reply..

But your previous sample and actual input file has lot discrepancies.

Try with this(not tested)

Code:
awk 'FNR==1{Y=Y?Y FS $0"-"FILENAME:$0"-"FILENAME;}
FNR>1{X[$1,$2]=X[$1,$2]?X[$1,$2] FS $3:$0;}
END{print Y;for(i in X){print X[i]}}' *.dat

This User Gave Thanks to pamu For This Post:
# 9  
Old 02-14-2013
HOORAY! we' re getting closer Smilie
This code seems to get a bit closer...
Look, I really appreciate your efforts on my problem! To make it easier, for me it would be just fine if I had an output like this:
Code:
 
00.00.dat 00.10.dat 00.20.dat 00.30.dat
292.9999 292.3690 292.0391 291.8038
292.9949 292.2965 291.9523 291.7151

This is the column i need one by the other under the file name. This code can then easily be pasted in a libreoffice calc document with the given X and Y's and that way I will be able to print graphs. I will be completely fine with this.
Thanks again. Have a nice day!
# 10  
Old 02-14-2013
Try with this...

Code:
awk 'FNR==1{X[FNR]=X[FNR]?X[FNR] FS FILENAME:FILENAME;}
FNR>1{X[FNR]=X[FNR]?X[FNR] FS $3:$3;}
END{for(i=1;i<=FNR;i++){print X[i]}}' *.dat

Hope this is what you want.. Smilie

Regards,

pamu
# 11  
Old 02-14-2013
I had tried a code like this but it prints it like a new row with a whitespace charachter. Is it a separator problem?
Code:
00.00.dat 00.10.dat 00.20.dat 00.30.dat
292.9998
 292.3675
 292.0370
 291.8015
292.9998
 292.3661
 292.0351
 291.7992

---------- Post updated at 10:54 AM ---------- Previous update was at 10:39 AM ----------

This code does the trick, but only for $1 and $2... :-(

Code:
awk '{a[FNR]=a[FNR] FS $3;t=(FNR>T)?FNR:t}END {for (i=1;i<=t;i++) print a[i]}' *.dat

For $3 it prints all prices in a single column.
# 12  
Old 02-14-2013
I am confused..Smilie

because there is an weird behavior for the values of $3.

$3 has values like.. 292.9998 that's why it is failing.....

But i am not able to investigate why it is so Smilie

I m working on it hope i'll find some sure solution.. Smilie

Regards,

pamu
# 13  
Old 02-14-2013
Thanks once again!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Cut specific column from 2 file and merge

Hi ALL, I have two file. I need to combine these two file based on a layout. I used the below code and able to extract the record. But now able to insert that to a 3'rd file in between the extract FILE 1 CAID NUMBER 1-20 TID NUMBER 21-22 LABEL CHAR 23-44 BASE 45-60... (5 Replies)
Discussion started by: arunkumar_mca
5 Replies

2. Shell Programming and Scripting

Merge column file

Hi All, I have on file1 and file2 some, $cat file1 aaa bbb ccc ddd eee fff ggg hhh iii jjj with line blank, and (12 Replies)
Discussion started by: aav1307
12 Replies

3. Shell Programming and Scripting

Seperated by columns, merge in a file, sort them on common column

Hi All, I have 4 files in below format. I took them as an example. File 1: Cut from position 1-4 then 6-7 then 8-14 then rest left and make them as columns in one new file. Inserting character H to the initial of all line like HCTOT. CTOT 456787897 Low fever CTOR 556712345 High fever... (2 Replies)
Discussion started by: Mannu2525
2 Replies

4. Shell Programming and Scripting

Merge the multiple text files into one file

Hi All, I am trying to merge all the text files into one file using below snippet cat /home/Temp/Test/Log/*.txt >> all.txt But it seems it is not working. I have multiple files like Output_ServerName1.txt, Output_ServreName2.txt I want to merge each file into one single file and... (6 Replies)
Discussion started by: sharsour
6 Replies

5. UNIX for Dummies Questions & Answers

How do I merge multiple columns into one column?

Hi all, I'm looking for a way to merge multiple columns (from one file) into a single column in an output file. The file I have looks somewhat like this: @HWI-ST212 1:N:0 AGTCCTACCGGGAGT + @@@DDDDDHHHHHII @HWI-ST212 1:N:0 CGTTTAAAAATTTCT + @;@B;DDDDH?:F;F... (4 Replies)
Discussion started by: Vnguyen
4 Replies

6. Shell Programming and Scripting

How to merge multiple rows into single row if first column matches ?

Hi, Can anyone suggest quick way to get desired output? Sample input file content: A 12 9 A -0.3 2.3 B 1.0 -4 C 34 1000 C -111 900 C 99 0.09 Output required: A 12 9 -0.3 2.3 B 1.0 -4 C 34 1000 -111 900 99 0.09 Thanks (3 Replies)
Discussion started by: cbm_000
3 Replies

7. UNIX for Advanced & Expert Users

merge two column multiple files into one

Hi I have multiple files each with two columns and I need to combine all those file into a tab delimited file. (multiple entry with same name separated by a comma) The content of the files are as follows: --- file1.txt: name var1 aaa xx aaa gg bbb yy ddd zz --- file2.txt ... (8 Replies)
Discussion started by: mary271
8 Replies

8. UNIX for Dummies Questions & Answers

Writing a loop to merge multiple files by common column

I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns. I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Discussion started by: evelibertine
1 Replies

9. Shell Programming and Scripting

Help with merge two file based on similar column content

Input file 1: A1BG A1BG A1BG A1CF A1CF BCAS BCAS A2LD1 A2M A2M HAT . . Input file 2: A1BG All A1CF TEMP (5 Replies)
Discussion started by: perl_beginner
5 Replies

10. Shell Programming and Scripting

merge two two txt files into one file based on one column

Hi, I have file1.txt and file2.txt and would like to create file3.txt based on one column in UNIX Eg: file1.txt 17328756,0000786623.pdf,0000786623 20115537,0000793892.pdf,0000793892 file2.txt 12521_74_4.zip,0000786623.pdf 12521_15_5.zip,0000793892.pdf Desired Output ... (5 Replies)
Discussion started by: techmoris
5 Replies
Login or Register to Ask a Question