Joining two files


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Joining two files
# 8  
Old 08-29-2011
Quote:
Originally Posted by rangarasan
Hi,

just try this,

Code:
nawk 'BEGIN{FS=",";}{t=0;while(getline line<"File2"){split(line,a,",");if ( $2 == a[1] ){print $1,$2,a[2];t=t+a[2];if ( t == $3 ){break;}}}}' File1 >File3

Where File1 and File2 are your input files and File3 is your output file.


Cheers,
RangaSmilie
But for the below set of data, the above code doesn't produce correct results:


file1
-----------
11635 ,1974-07-17 00:00:00,20311905,250
11635B ,1974-08-07 00:00:00,20311905,100
11635A ,1974-07-22 00:00:00,20311905,250
11635C ,1974-09-24 00:00:00,20311905,500
file2
----------
20311905,88419,1,7,100
20311905,602135,3,7,100
20311905,610283,5,7,100
20311905,664254,7,56,150
20311905,85106,0,7,100
20311905,90733,2,7,100
20311905,604715,4,7,150
20311905,652707,6,15,150
20311905,665416,8,59,150

the code i have used is :
Code:
nawk 'BEGIN{FS=",";}{t=0;while(getline line<"file2"){split(line,a,",");if ( $3 == a[1] ){print $1,$2,$3,a[2],a[3],a[4],a[5];t=t+a[5];if ( t == $4 ){break;}}}}' file1 >file3

The 3rd field in file1 and 1st field in file2 are the keys

thanks
# 9  
Old 09-06-2011
How to make the script to work for the above data?

Thanks
# 10  
Old 09-06-2011
Post a sample of the input and the expected output...
# 11  
Old 09-06-2011
input:
-----
Code:
file1
-----------
11635 ,1974-07-17 00:00:00,20311905,250
11635B ,1974-08-07 00:00:00,20311905,100
11635A ,1974-07-22 00:00:00,20311905,250
11635C ,1974-09-24 00:00:00,20311905,500
file2
----------
20311905,88419,1,7,100
20311905,602135,3,7,100
20311905,610283,5,7,100
20311905,664254,7,56,150
20311905,85106,0,7,100
20311905,90733,2,7,100
20311905,604715,4,7,150
20311905,652707,6,15,150
20311905,665416,8,59,150

Code:
Required output:
11635B,20311905,88419,1,7,100
 11635,20311905,602135,3,7,100
 11635A,20311905,610283,5,7,100
 11635,20311905,664254,7,56,150
 11635C,20311905,85106,0,7,100
 11635C,20311905,90733,2,7,100
 11635A,20311905,604715,4,7,150
 11635C,20311905,652707,6,15,150
 11635C,20311905,665416,8,59,150

The 3rd field in file1 and 1st field in file2 are the keys..

in file1 the value corresponds to 11635 is 250.
In the result if you sum up all the values of 11635 is 100+150 =250.

Similarly all the values should be equal.

Please let me know if you need any more info.

Thanks
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Please help me in joining two files

I have two files with the below contents : sampleoutput3.txt 20150202;hostname1 20150223;hostname2 20150716;hostname3 sampleoutput1.txt hostname;packages_out_of_date;errata_out_of_date; hostname1;11;0; hostnamea;12;0; hostnameb;11;0; hostnamec;95;38; hostnamed;440;358;... (2 Replies)
Discussion started by: rahul2662
2 Replies

2. Shell Programming and Scripting

Joining 2 Files

File "A" (column names: Nickname Number GB) Nickname Number GB PROD_DB0034 100A 16 ASMIL1B_DATA_003 100B 16 PSPROD_0000 1014 36 PSPROD_0001 100D 223 ..... File "B" (column names: TYPE DEVICE NUMBER SIZE) TYPE DEVICE NUMBER SIZE 1750500 hdisk2 100A 16384 1750500 hdisk3 ... (4 Replies)
Discussion started by: Daniel Gate
4 Replies

3. Shell Programming and Scripting

Help with joining files and adding headers to files

Hi, I have about 20 tab delimited text files that have non sequential numbering such as: UCD2.summary.txt UCD45.summary.txt UCD56.summery.txt The first column of each file has the same number of lines and content. The next 2 column have data points: i.e UCD2.summary.txt: a 8.9 ... (8 Replies)
Discussion started by: rrdavis
8 Replies

4. Shell Programming and Scripting

Joining two files into one

Hi experts, I'm quite newbie here!! I have two seperate files. Contents of file like below File 1: 6213019212001 8063737 File:2 15703784 I want to join these two files into one where content will be File 3: 6213019212001 8063737 15703784 Regards, Ray Seilden (1 Reply)
Discussion started by: RayanS
1 Replies

5. Shell Programming and Scripting

Joining Three Files

Hi guys, I have three files which needs to be joined to a single file. File 1: Col a, Col b, Col c File 2: Col 1a, Col 1b File 3: Col 2a, Col 2b Output: Col 1a, Col 2a, Col a, Col b, Col c. All the files are comma delimited. I need to join Col b with Col 1b and need to... (17 Replies)
Discussion started by: mac4rfree
17 Replies

6. Shell Programming and Scripting

joining two or more files

i have three files file a has contents 123 234 238 file b has contents 189 567 567 and file c has contents qwe ert ery (1 Reply)
Discussion started by: tomjones
1 Replies

7. Shell Programming and Scripting

Joining files

Hi, Whats the unix function to join multiple files? is it cat? so I have multiple files in the same format and I want to join then by row eg. FILE1 1 3 1 3 1 3 1 3 FILE2 2 4 2 4 2 4 (1 Reply)
Discussion started by: kylle345
1 Replies

8. Shell Programming and Scripting

Help with joining two files

Greetings, all. I've got a project that requires I join two data files together, then do some processing and output. Everything must be done in a shell script, using standard unix tools. The files look like the following: File_1 Layout: Acct#,Subacct#,Descrip Sample: ... (3 Replies)
Discussion started by: rjlohman
3 Replies

9. UNIX for Dummies Questions & Answers

joining files

Hi, Could anyone help me ? I'm trying to join two files, but no common field are on them. So I think on generate \000\ sequence to add for each line on both files, so then will be able to join these files. Any idea? Thanks in advance, (2 Replies)
Discussion started by: Manu
2 Replies

10. UNIX for Dummies Questions & Answers

joining 2 files

Hi, I have two files that I need to find difference between. Do I use diff or join? If join, how do I use it? thanks, webtekie (1 Reply)
Discussion started by: webtekie
1 Replies
Login or Register to Ask a Question