Visit Our UNIX and Linux User Community


Combining columns from different files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Combining columns from different files
# 1  
Old 09-10-2009
Combining columns from different files

I have two files I need to combine. The problem I'm having is I need to only combine data from the second file in the empty spaces of the first. For example:

file1
Data Field

Data Field
Data Field

Data Field

file2
a - Insert Data
b - Insert Data
c - Insert Data
d - Insert Data
e - Insert Data
f - Insert Data

Output file
file3
Data Field
b - Insert Data
Data Field
Data Field
e - Insert Data
Data Field

I'm thinking of awk but I'm not sure on where to start. I would appreciate if someone could direct me on where I can learn more on how to do this.
# 2  
Old 09-10-2009
This might work...



Code:
 
awk 'NF=0{print NR}' file1 >> blank_line_numbers
for i in `cat blank_line_numbers`
do
insert_line=`head -$i file2 | tail -1`
sed 's/^$/$insert_line/$i' file1 >> temp
mv temp file1
done

# 3  
Old 09-11-2009
MySQL

You can try the following bash script.

Code:
#!/bin/bash
PATH=/usr/bin:/bin
export PATH

exec 3<file1
exec 4<file2

while read a 0<&3; do
        read b 0<&4
        echo ${a:-$b}
done

# this line will output any remaining lines in file2
# if you don't need this, then you can take it out
cat <&4


Last edited by rwu; 09-11-2009 at 03:49 AM..
# 4  
Old 09-11-2009
I try to resolve this with command awk, but i have problems...
I try this...
Code:
awk 'NR==FNR{a[NR]=$0;next}{b[FNR]=$0}END { for(i=1;i<=FNR;i++) if (b[i]=" ") b[i]=a[i]}{print i,b[i]}' file1 file2

please advice.
# 5  
Old 09-11-2009
Code:
nawk 'FNR==NR {f1[FNR]=$0;next} {print NF?$0:f1[FNR]}' file2 file1

# 6  
Old 09-11-2009
great, magic...but i don't understand this part....

Code:
nawk 'FNR==NR {f1[FNR]=$0;next} {print NF?$0:f1[FNR]}'

Could you explain please .....

Thanx
# 7  
Old 09-11-2009
Quote:
Originally Posted by protocomm
great, magic...but i don't understand this part....

Code:
nawk 'FNR==NR {f1[FNR]=$0;next} {print NF?$0:f1[FNR]}'

Could you explain please .....

Thanx
you can rewrite this as:
Code:
nawk 'FNR==NR {f1[FNR]=$0;next} 
                        {
                           if (NF!=0) 
                              print $0
                           else
                              print f1[FNR]
                        }' file2 file1


Last edited by vgersh99; 09-11-2009 at 03:08 PM..

Previous Thread | Next Thread
Test Your Knowledge in Computers #850
Difficulty: Medium
Every Bluetooth device has a unique 48-bit address.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Combining certain columns of multiple files into one file

Hello Unix gurus, I have a large number of files (say X) each containing two columns of data and the same number of rows. I would like to combine these files to create a unique merged file containing X columns corresponding to the second column of each file (with a bonus of having the first... (3 Replies)
Discussion started by: ksennin
3 Replies

2. Shell Programming and Scripting

Join two files combining multiple columns and produce mix and match output

I would like to join two files when two columns in each file matches with each other and then produce an output when taking multiple columns. Like I have file A 1234,ABCD,23,JOHN,NJ,USA 2345,ABCD,24,SAM,NY,USA 5678,GHIJ,24,TOM,NY,USA 5678,WXYZ,27,MAT,NJ,USA and file B ... (2 Replies)
Discussion started by: mady135
2 Replies

3. Shell Programming and Scripting

Combining rows into columns

hi experts, I have a flat file with below contents Database1 Table1 column1 Database1 Table1 column2 Database1 Table1 column3 Database1 Table1 column4 Database1 Table2 Column1 Database1 Table2 Column2 Database2 Table1 Column1 Database2 Table1 Column2 Database2 Table1 Column3... (9 Replies)
Discussion started by: Selva_2507
9 Replies

4. Linux

[Solved] Combining columns from different files

Hey Guys & Gals, I am stuck with the following ; I have 2 text files, each containing 2 columns. My goal is to have a column from the 2nd file placed inbetween the columns in the first file. Basically the idea is, each address has a different name (but 1 name per address) but 1 address... (6 Replies)
Discussion started by: TAPE
6 Replies

5. Shell Programming and Scripting

Combining columns from multiple files into one single output file

Hi, I have 3 files with one column value as shown File: a.txt ------------ Data_a1 Data_a2 File2: b.txt ------------ Data_b1 Data_b2 Data_b3 Data_b4 File3: c.txt ------------ Data_c1 Data_c2 Data_c3 Data_c4 Data_c5 (6 Replies)
Discussion started by: vfrg
6 Replies

6. UNIX for Dummies Questions & Answers

Need Help in reading N days files from a Directory & combining the files

Hi All, Request your expertise in tackling one requirement in my project,(i dont have much expertise in Shell Scripting). The requirement is as below, 1) We store the last run date of a process in a file. When the batch run the next time, it should read this file, get the last run date from... (1 Reply)
Discussion started by: dsfreddie
1 Replies

7. Shell Programming and Scripting

Combining columns from multiple files to one file

I'm trying to combine colums from multiple file to a single file but having some issues, appreciate your help. The filenames are the same except for the extension, path1.m0 --------- a b c d e f g h i path1.m1 --------- m n o p q r s t u File names are path1.m The... (3 Replies)
Discussion started by: rkmca
3 Replies

8. UNIX for Dummies Questions & Answers

Combining two text files as columns?

I have one space delimited file with multiple columns and one tab delimited file with multiple columns (They have the same number of rows). I want to basically combine these two text files into a new text file by column. How would I go about doing that? (1 Reply)
Discussion started by: evelibertine
1 Replies

9. Shell Programming and Scripting

combining columns from different files

Hi all, I would be very grateful for some advice on the following. I have several text files. The files are experiment results with columns of data separated by white space. The files begin with several lines of header which are all preceeded by a comment character '#'. Each file has a... (10 Replies)
Discussion started by: iomaire
10 Replies

10. Shell Programming and Scripting

Combining Two fixed width columns to a variable length file

Hi, I have two files. File1: File1 contains two fixed width columns ID of 15 characters length and Name is of 100 characters length. ID Name 1-43<<11 spaces>>Swapna<<94 spaces>> 1-234<<10 spaces>>Mani<<96 spaces>> 1-3456<<9 spaces>>Kapil<<95 spaces>> File2: ... (4 Replies)
Discussion started by: manneni prakash
4 Replies

Featured Tech Videos