Merging two files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Merging two files
# 1  
Old 02-28-2013
Merging two files

Hi All ,

I have a scenario where we need to combine two files .
Below are the sample files and expected output ,

File 1:
Code:
1|ab
1|ac
1|ae
2|ad
2|ac

File 2:
Code:
1|xy
1|fc
2|gh
2|ku

Output file :
Code:
1|ab|xy
1|ab|fc
1|ac|xy
1|ac|fc
1|ae|xy
1|ae|fc
2|ad|gh
2|ad|ku
2|ac|gh
2|ac|ku

Please help us how this can be done in unix .

Moderator's Comments:
Mod Comment Use code tags, see PM.

Last edited by saj; 02-28-2013 at 08:21 AM..
# 2  
Old 02-28-2013
this should help you

Code:
join -t"|" file1 file2

These 2 Users Gave Thanks to PikK45 For This Post:
# 3  
Old 02-28-2013
Code:
awk -F "|" 'NR==FNR{X[$1,++Y[$1]]=$2;next}
    {for(i=1;i<=Y[$1];i++){print $1,$2,X[$1,i]}}' OFS="|" file2 file1

This User Gave Thanks to pamu For This Post:
# 4  
Old 03-01-2013
awk, perl, python

awk
Code:
gawk -F"[|]" '{
if(NR==FNR){
  _[$1]=sprintf("%s,%s",_[$1],$2)
}
else{
  tmp=_[$1]
  n=split(tmp,arr,",")
  for(i=2;i<=n;i++){
    print $0"|"arr[i]
}
}
}
' b a

perl
Code:
open my $fh1,"<a.txt" or die "can not open a.txt";
open my $fh2,"<b.txt" or die "can not open b.txt";
my %hash;
while(<$fh2>){
	chomp;
	my @tmp = split("[|]",$_);
	push @{$hash{$tmp[0]}}, $tmp[1];
}
close $fh2;
while(<$fh1>){
	chomp;
	my @tmp = split("[|]", $_);
	my @tmp = @{$hash{$tmp[0]}};
	for(my $i=0;$i<=$#tmp;$i++){
		print $_,"|",$tmp[$i],"\n";
	}
}
close $fh1;

python
Code:
dict={}
with open("b.txt","r") as f1:
 for line in f1:
  s=line.replace("\n","")
  items=s.split("|")
  if items[0] in dict:
   dict[items[0]].append(items[1])
  else:
   dict[items[0]]=[items[1]]
with open("a.txt","r") as f2:
 for line in f2:
  s=line.replace("\n","")
  items=s.split("|")
  for i in dict[items[0]]:
   print(s,"|",i,sep="")

This User Gave Thanks to summer_cherry For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging two files

Guys, I am having little problem with getting a daily report! The daily process that I do is as follows 1. Unload Header for the report from the systables to one unl file, say Header.unl 2. Unload the data from the required table/tables to another unl file, say Data.unl 3. Send a... (2 Replies)
Discussion started by: PikK45
2 Replies

2. Shell Programming and Scripting

Help with merging 2 files into 1

::::::::: ::FileA:: ::::::::: A1-------A2--------A3---A4---A5-- ================================= AC5VXVLT-XX---------------------- B57E434--XXXX1-----MMMM-ZZZ--111- C325G20--XXXXX3----CCCC------3332 DC35S51--XXXXY1----DDDD------44X- DC35S52--XXXXY2----DDDD------44Y-... (5 Replies)
Discussion started by: lordsmiter
5 Replies

3. Shell Programming and Scripting

Merging two files with same name

Hello all, I have limited experience in shell scripting. Here goes my question: I have two directories that have same number of files with same file names i.e. consider 2 directories A and B. Both directories have files 1.txt, 2.txt...... I need to merge the file 1.txt of A with file 1.txt... (5 Replies)
Discussion started by: jaysean
5 Replies

4. Shell Programming and Scripting

Merging files

I have two files file 1 containing x rows and 1 column file 2 containing x rows and 1 column I want to merge both the files and add a comma between the two eg plz guide (1 Reply)
Discussion started by: test_user
1 Replies

5. UNIX for Dummies Questions & Answers

Merging two files

Hi, I have two files a.txt and b.txt. a.txt 1 2 3 4 b.txt a b c d e I want to generate a file c.txt by merging these two file and the resultant file would contain c.txt 1 (4 Replies)
Discussion started by: siba.s.nayak
4 Replies

6. Shell Programming and Scripting

merging of files.

Hi, I want to merge the two files on the basis of columns like... file 1 Data Key A 12 B 13 file2 Data Value A A1 A A2 B B1 B B2 (5 Replies)
Discussion started by: clx
5 Replies

7. Shell Programming and Scripting

merging two files

Hi everyone, I have two files which will be exactly same at first. After sometime there will be inserts in one file. My problem is how to reflect these changes in second file also. I found out that any compare and merge utility would do the job like, GNU " sdiff " command. But the... (14 Replies)
Discussion started by: rameshonline
14 Replies

8. Shell Programming and Scripting

Help with merging files

i would like to merge two files that have the same format but have different data. i would like to create one output file that contains information from both the original files.:rolleyes: (2 Replies)
Discussion started by: joe black
2 Replies

9. Shell Programming and Scripting

Merging 2 files

Hi, I have got two files 1.txt 1111|apple| 2222|orange| 2.txt 1111|1234|000000000004356| 1111|1234|000000001111| 1111|1234|002000011112| 2222|5678|000000002222| 2222|9102|000000002222| I need to merge these two so that my out put looks like below: Search code being used should be... (4 Replies)
Discussion started by: jisha
4 Replies

10. Shell Programming and Scripting

merging files

Thanks in advance I have 2 files having key field in each.I would like to join both on common key.I have used join but not sucessful. The files are attached here . what i Want in the output is on the key field SLS OFFR . I have used join commd but not successful. File one ======= SNO ... (6 Replies)
Discussion started by: vakharia Mahesh
6 Replies
Login or Register to Ask a Question