Compairson and merging of files.


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Compairson and merging of files.
# 1  
Old 11-12-2008
Compairson and merging of files.

Sorry for the duplicate post as there seem to be hundreds of similar posts - I have searched - however due to my limited scripting knowledge I can not seem to modify any of the other answers to suit my needs.

I have two files:

ONE: Each value, h1, h2 etc... only appears once.

h1 0000 0000
h2 0000 0000
c 0000 0000
ca 0000 0000
c1 0000 0000

TWO: Values h1... can appear more than once or may not appear at all i.e. h2

h1 1 2 3 4
c 1 2 3 4
ca 1 2 3 4
h1 1 2 3 4
c1 1 2 3 4
h1 1 2 3 4

If the first columns match the values from the first file need to be appened to the second.

i.e.

h1 1 2 3 4 0000 0000
c 1 2 3 4 0000 0000
ca 1 2 3 4 0000 0000
h1 1 2 3 4 0000 0000
c1 1 2 3 4 0000 0000
h1 1 2 3 4 0000 0000

I have attempted this with python and awk.

Any help would be greatly appreciated!Smilie
# 2  
Old 11-12-2008
Code:
awk ' FILENAME=="file1" { tmp=sprintf("%s %s", $2, $3);  arr[$1]= tmp}
        FILENAME=="file2" { printf("%s %s\n", $0, arr[$1]) }
       '  file1 file2 > newfile

# 3  
Old 11-12-2008
Use nawk or /usr/xpg4/bin/awk on Solaris.

Code:
awk 'NR == FNR {
  _[$1] = $2 FS $3
  next
  }
$1 in _ { 
  $(NF+1) = _[$1] 
  } 
1' file1 file2

# 4  
Old 11-12-2008
Thanks for the v.quick reply.

Both worked on one system(Ubuntu) and errors galore on another(Red Hat)?

Can this be accomplished using python? This would be preferred as it is part of a larger python script.
# 5  
Old 11-12-2008
Quote:
Originally Posted by hfielder
Thanks for the v.quick reply.

Both worked on one system(Ubuntu) and errors galore on another(Red Hat)?
[...]
It should work if you have GNU awk (gawk) on RedHat.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging two files

Hi All , I have a scenario where we need to combine two files . Below are the sample files and expected output , File 1: 1|ab 1|ac 1|ae 2|ad 2|ac File 2: 1|xy 1|fc 2|gh 2|ku Output file : 1|ab|xy (3 Replies)
Discussion started by: saj
3 Replies

2. Shell Programming and Scripting

Merging two files

Guys, I am having little problem with getting a daily report! The daily process that I do is as follows 1. Unload Header for the report from the systables to one unl file, say Header.unl 2. Unload the data from the required table/tables to another unl file, say Data.unl 3. Send a... (2 Replies)
Discussion started by: PikK45
2 Replies

3. Shell Programming and Scripting

Help with merging 2 files into 1

::::::::: ::FileA:: ::::::::: A1-------A2--------A3---A4---A5-- ================================= AC5VXVLT-XX---------------------- B57E434--XXXX1-----MMMM-ZZZ--111- C325G20--XXXXX3----CCCC------3332 DC35S51--XXXXY1----DDDD------44X- DC35S52--XXXXY2----DDDD------44Y-... (5 Replies)
Discussion started by: lordsmiter
5 Replies

4. Shell Programming and Scripting

Merging files

I have two files file 1 containing x rows and 1 column file 2 containing x rows and 1 column I want to merge both the files and add a comma between the two eg plz guide (1 Reply)
Discussion started by: test_user
1 Replies

5. UNIX for Dummies Questions & Answers

Merging two files

Hi, I have two files a.txt and b.txt. a.txt 1 2 3 4 b.txt a b c d e I want to generate a file c.txt by merging these two file and the resultant file would contain c.txt 1 (4 Replies)
Discussion started by: siba.s.nayak
4 Replies

6. Shell Programming and Scripting

merging of files.

Hi, I want to merge the two files on the basis of columns like... file 1 Data Key A 12 B 13 file2 Data Value A A1 A A2 B B1 B B2 (5 Replies)
Discussion started by: clx
5 Replies

7. Shell Programming and Scripting

merging two files

Hi everyone, I have two files which will be exactly same at first. After sometime there will be inserts in one file. My problem is how to reflect these changes in second file also. I found out that any compare and merge utility would do the job like, GNU " sdiff " command. But the... (14 Replies)
Discussion started by: rameshonline
14 Replies

8. Shell Programming and Scripting

Help with merging files

i would like to merge two files that have the same format but have different data. i would like to create one output file that contains information from both the original files.:rolleyes: (2 Replies)
Discussion started by: joe black
2 Replies

9. Shell Programming and Scripting

merging two files

Friends, os: redhat enterprise linux/SCO UNIX5.0 I have two files and I would like to merge on given key value. Now I have tried with join commd but it does not supporte multiple delimiters. and if records length is not fixed. join -a1 5 -a2 1 -t -o file1 file2 > outname Can any... (7 Replies)
Discussion started by: vakharia Mahesh
7 Replies

10. Shell Programming and Scripting

merging files

Thanks in advance I have 2 files having key field in each.I would like to join both on common key.I have used join but not sucessful. The files are attached here . what i Want in the output is on the key field SLS OFFR . I have used join commd but not successful. File one ======= SNO ... (6 Replies)
Discussion started by: vakharia Mahesh
6 Replies
Login or Register to Ask a Question