Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Merge 2 files with one reference columns

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Merge 2 files with one reference columns
# 8  
Old 10-23-2013
@ MadeInGermany. Thanks for the script. It seems working but very slow with large amount of data.

@ Akshay and rdrtx1. Both scripts are fast and producing identical output.

One question - how to ignore CASE of the servername field.

Thanks
# 9  
Old 10-23-2013
Quote:
Originally Posted by mv_mv
[..]
One question - how to ignore CASE of the servername field.
You could use the to tolower() function
Code:
awk '{sv=tolower($1)} NR==FNR{A[sv FS $2]=sv; next} {for (i in A) if(sv==A[i]) print i,$2}' FS=, OFS=, file2 file1

# 10  
Old 10-23-2013
@ MadeInGermany - Code works but as you rightly said, is slow with large amounts of data.

@ rdrtx1 - Thanks. Your code works and is fast as well.

@ Akshay @ rdrtx1 - Is there any option to ignore CASE of servername

Thanks
# 11  
Old 10-23-2013
Fast AND memory efficient is an array of linked lists.
While awk does not have linked list, the closest approach is a string where its components are accessed by the split function.
Code:
awk -F, '{sv=tolower($1)} NR==FNR {A[sv]=A[sv] FS $2; next} {n=split(A[sv],B); for (i=2;i<=n;i++) print sv,$2,B[i]}' OFS=, file2 file1

Even the original order is retained.
# 12  
Old 10-23-2013
Quote:
Originally Posted by mv_mv
@ MadeInGermany - Code works but as you rightly said, is slow with large amounts of data.

@ rdrtx1 - Thanks. Your code works and is fast as well.

@ Akshay @ rdrtx1 - Is there any option to ignore CASE of servername

Thanks
for server name ignore case, try adding to top of script:
Code:
typeset -l d1 d3

# 13  
Old 10-23-2013
Quote:
Originally Posted by rdrtx1
for server name ignore case, try adding to top of script:
Code:
typeset -l d1 d3

This works in ksh and bash-4, in the shell code outside awk.
Within awk the tolower() function is to be used.
# 14  
Old 10-24-2013
typeset is very elegant and works well.

Thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge columns from two files using awk

I have two csv files : say a.csv, b.csv a.csv looks like this : property1,property2,100 property3,property4,200 In a.csv, the combination of column1 and column2 will be unique b.csv looks like this property1,property2, 300, t1 property1,property2, 400,t2 property3, property4,800,t1... (2 Replies)
Discussion started by: Lakshmikumari
2 Replies

2. Shell Programming and Scripting

Merge files based on columns

011111123444 1234 1 20000 011111123444 1235 1 30000 011111123446 1234 3 40000 011111123447 1234 4 50000 011111123448 1234 3 50000 File2: 011111123444,Rsttponrfgtrgtrkrfrgtrgrer 011111123446,Rsttponrfgtrgtr 011111123447,Rsttponrfgtrguii 011111123448,Rsttponrfgtrgtjiiu I have 2 files... (4 Replies)
Discussion started by: vinus
4 Replies

3. Shell Programming and Scripting

Merge columns from multiple files

Hello and Good day I have a lot of files with same number of rows and columns.$2 and $3 are the same in all files . I need to merge $2,$3,$6 from first file and $6 from another files. File1: $1 $2 $3 $4 $5 $6... (8 Replies)
Discussion started by: ali.seifaddini
8 Replies

4. Shell Programming and Scripting

Merge columns on different files

Hello, I have two files that have this format: file 1 86.82 0.00 86.82 43.61 86.84 0.00 86.84 43.61 86.86 0.00 86.86 43.61 86.88 0.00 86.88 43.61 file 2 86.82 0.22 86.84 0.22 86.86 0.22 86.88 0.22 I would like to merge these two files such that the final file looks like... (5 Replies)
Discussion started by: kayak
5 Replies

5. UNIX for Dummies Questions & Answers

Merge columns from multiple files

Hi all, I've searched the web for a long time trying to figure out how to merge columns from multiple files. I know paste will append columns like so: paste file1 file2 file3 file4 file5 ... But this becomes inconvenient when you want to append a large number of files into a single file. ... (2 Replies)
Discussion started by: torchij
2 Replies

6. Shell Programming and Scripting

Merge columns of different files

Hi, I have tab limited file 1 and tab limited file 2 The output should contain common first column vales and corresponding 2nd column values; AND also unique first column value with corresponding 2nd column value of the file that contains it and 0 for the second file. the output should... (10 Replies)
Discussion started by: polsum
10 Replies

7. UNIX for Dummies Questions & Answers

Merge two files with two columns being similar

Hi everyone. How can I merge two files, where each file has 2 columns and the first columns in both files are similar? I want all in a file of 4 columns; join command removes the duplicate columns. 1 Dave 2 Mark 3 Paul 1 Apple 2 Orange 3 Grapes to get it like this in the 3rd file:... (9 Replies)
Discussion started by: Atrisa
9 Replies

8. Shell Programming and Scripting

merge the two files which has contain columns

Hi may i ask how to accomplish this task: I have 2 files which has multiple columns first file 1 a 2 b 3 c 4 d second file 14 a 9 .... 13 b 10.... 12 c 11... 11 d 12... I want to merge the second file to first file that will looks like this ... (2 Replies)
Discussion started by: jao_madn
2 Replies

9. UNIX for Dummies Questions & Answers

compare columns from 2 files and merge

Dear all, Being new to Unix i have a problem. I have 2 files: File 1: 118,1,0,2,3,0,5,0.3,0,0.3,0.6,1 118,2,1,2,2,0,5,0.4,0,0.4,0.4,1 118,4,2,0,3,0,5,0.7,0,0.3,0.6,1 118,6,4,1,0,0,5,0.8,0,0.2,0,1 File 2: 118,1,BFGL-NGS-109695,3610326,0,18,1,0.556,0.389,0.056,0.25,0.8183... (2 Replies)
Discussion started by: samwilkinson
2 Replies

10. Shell Programming and Scripting

Compare two files and merge columns in a third

Hi, I'm working with snmp, with a little script I'm able to obtain from a switch a list with a couple of values with this format Port Mac 1 00:0A:0B:0C:0D:0E .... (hundred of entries) Now with a simple arp on a router I am able to obtain another list 00:0A:0B:0C:0D:0E... (20 Replies)
Discussion started by: CM64
20 Replies
Login or Register to Ask a Question