Shell Programming and Scripting

Hi Friends,

I have a requirement where i need to compare the 2 tables ( Let assume SOURCE table and TARGET Table )in teradata . before this requirement we used to do a MINUS query and did the work. But now we came to situation where we need to get the expected output as below :

Code:

No of Mismatches :
 
Mismatches Report :
 
KEYFILED(UNIQUE Filed) | SORCE FIELD(ORIGINAL VALUE)| TARGET FIELD(CHANGED VALUE)

I did the following to get the output in unix .

The output for the 1000 rows in both tables is taking 1 min, where i tried with 50,000 rows it is taking almost 1hr which is an performance issue.

Please let me know any of you have come across the same issue. if so, what you have done? did you use any tools for the comparision ? or any menthod to compare two tables?

Please give me some suggestions.

Thanks in advance.

More details please. I guess this should be doable in your DB with an (maybe complex?) SQL - statement.

Please post what Operating System and version your are running, what Database Engine and version this is, what Shell you use, and the contents of your script. Please also give us a feel for the power and scale of your computer.
You may find that inserting date commands in your script will show where the slow statements reside.

As @RudiC suggests, why not do the whole process in SQL? Is the sort key field not indexed in the database?

Do not post classroom or homework problems in the main forums. Homework and coursework questions can only be posted in this forum under special homework rules.

Please review the rules, which you agreed to when you registered, if you have not already done so.

More-than-likely, posting homework in the main forums has resulting in a forum infraction. If you did not post homework, please explain the company you work for and the nature of the problem you are working on.

If you did post homework in the main forums, please review the guidelines for posting homework and repost.

Thank You.

The UNIX and Linux Forums.