merging two files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting merging two files
# 1  
Old 06-28-2004
merging two files

Hi everyone,

I have two files which will be exactly same at first. After sometime there will be inserts in one file. My problem is how to reflect these changes in second file also.

I found out that any compare and merge utility would do the job like, GNU " sdiff " command. But the problem with sdiff is, it is an interactive tool. we have to tell the command what to do each time it finds a difference in the files. (Either merge the change or discard it by specifying 'l' , 'r' ..options)

do any one of you know how to automate this process.... or any other utility is available for doing this?

(sort with -m option is not what i want ..because i dont want to lose the order in the files)

Thanks in advance
# 2  
Old 06-28-2004
cp firstfile secondfile
will ensure that any changes made to the first file are reflected in the second file.
# 3  
Old 06-28-2004
hi perdarabo,

i am sorry to miss out an important point above.. My second file also can have inserts at the end but not in the middle...so if we do cp we will loose second file changes.

(to put it differently, i am looking at two files which are same at first but after sometime both will change)
# 4  
Old 06-28-2004
Code:
cp firstfile secondfile

will "clobber" the 2nd file. (clobber = completely replace/overwrite everything in "secondfile").

If you want to append data from firstfile, try
Code:
firstfile >> secondfile

, which appends the contents of firstfile to secondfile. Make sure there are two ">>" b/c only one ">" does the same thing as the above cp command. This is explained in good shell programming books under "input/output redirection".
# 5  
Old 06-29-2004
Quote:
Code:
firstfile >> secondfile

Surely all that is going to do is attach the entire content of firstfile onto the end of second file rather than just what has been updated.

Doesn't he want to take two data files that start with the same content, update both files with different sets of data and merge those 2 files into 1 file that contains all the data without replicating anything ?? (If you follow what I mean..)

I'm not sure if there are any UNIX commands that could do it, but I would look at using Perl or similar...

Last edited by PaulC; 06-29-2004 at 04:23 AM..
# 6  
Old 06-29-2004
Quote:
Originally posted by PaulC
Surely all that is going to do is attach the entire content of firstfile onto the end of second file rather than just what has been updated.

Doesn't he want to take two data files that start with the same content, update both files with different sets of data and merge those 2 files into 1 file that contains all the data without replicating anything ?? (If you follow what I mean..)

I'm not sure if there are any UNIX commands that could do it, but I would look at using Perl or similar...
You're right. I didn't read his post clearly enough. The rsync utility can help: http://rsync.samba.org (is usually avail in most distros as well) It works locally as well as remotely and can use ssh for added security.
# 7  
Old 06-29-2004
Perhaps take a look at comm.

comm -23 prints only lines in the first file but not in the second
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging two files

Hi All , I have a scenario where we need to combine two files . Below are the sample files and expected output , File 1: 1|ab 1|ac 1|ae 2|ad 2|ac File 2: 1|xy 1|fc 2|gh 2|ku Output file : 1|ab|xy (3 Replies)
Discussion started by: saj
3 Replies

2. Shell Programming and Scripting

Merging two files

Guys, I am having little problem with getting a daily report! The daily process that I do is as follows 1. Unload Header for the report from the systables to one unl file, say Header.unl 2. Unload the data from the required table/tables to another unl file, say Data.unl 3. Send a... (2 Replies)
Discussion started by: PikK45
2 Replies

3. Shell Programming and Scripting

Help with merging 2 files into 1

::::::::: ::FileA:: ::::::::: A1-------A2--------A3---A4---A5-- ================================= AC5VXVLT-XX---------------------- B57E434--XXXX1-----MMMM-ZZZ--111- C325G20--XXXXX3----CCCC------3332 DC35S51--XXXXY1----DDDD------44X- DC35S52--XXXXY2----DDDD------44Y-... (5 Replies)
Discussion started by: lordsmiter
5 Replies

4. Shell Programming and Scripting

Merging two files with same name

Hello all, I have limited experience in shell scripting. Here goes my question: I have two directories that have same number of files with same file names i.e. consider 2 directories A and B. Both directories have files 1.txt, 2.txt...... I need to merge the file 1.txt of A with file 1.txt... (5 Replies)
Discussion started by: jaysean
5 Replies

5. Shell Programming and Scripting

Merging files

I have two files file 1 containing x rows and 1 column file 2 containing x rows and 1 column I want to merge both the files and add a comma between the two eg plz guide (1 Reply)
Discussion started by: test_user
1 Replies

6. UNIX for Dummies Questions & Answers

Merging two files

Hi, I have two files a.txt and b.txt. a.txt 1 2 3 4 b.txt a b c d e I want to generate a file c.txt by merging these two file and the resultant file would contain c.txt 1 (4 Replies)
Discussion started by: siba.s.nayak
4 Replies

7. Shell Programming and Scripting

merging of files.

Hi, I want to merge the two files on the basis of columns like... file 1 Data Key A 12 B 13 file2 Data Value A A1 A A2 B B1 B B2 (5 Replies)
Discussion started by: clx
5 Replies

8. Shell Programming and Scripting

Help with merging files

i would like to merge two files that have the same format but have different data. i would like to create one output file that contains information from both the original files.:rolleyes: (2 Replies)
Discussion started by: joe black
2 Replies

9. Shell Programming and Scripting

Merging 2 files

Hi, I have got two files 1.txt 1111|apple| 2222|orange| 2.txt 1111|1234|000000000004356| 1111|1234|000000001111| 1111|1234|002000011112| 2222|5678|000000002222| 2222|9102|000000002222| I need to merge these two so that my out put looks like below: Search code being used should be... (4 Replies)
Discussion started by: jisha
4 Replies

10. Shell Programming and Scripting

merging files

Thanks in advance I have 2 files having key field in each.I would like to join both on common key.I have used join but not sucessful. The files are attached here . what i Want in the output is on the key field SLS OFFR . I have used join commd but not successful. File one ======= SNO ... (6 Replies)
Discussion started by: vakharia Mahesh
6 Replies
Login or Register to Ask a Question