Shell script matching similar records | Unix Linux Forums | Shell Programming and Scripting

  Go Back    


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here.

Shell script matching similar records

Shell Programming and Scripting


Closed Thread    
 
Thread Tools Search this Thread Display Modes
    #1  
Old 10-16-2013
kashik786 kashik786 is offline
Registered User
 
Join Date: Sep 2009
Last Activity: 17 October 2013, 1:38 PM EDT
Posts: 6
Thanks: 0
Thanked 0 Times in 0 Posts
Shell script matching similar records

hello all,
I have requirement to identify similar records matching about 80% to 90%.I have to black list customers with multiple accounts.
The data is in the Oracle Database, but is there any way I can get the data into flat file and compare the strings and fetch similar matching records?
I have one table with

Code:
id 
Name
middle_name
address
city

I need to pull out name and address fields similar. And spaces or slight difference can be ignored. I have tried within database methods which is very slow. And I have only basic knowledge of shell scripting need help for a way to get compared result faster. I have very large data to compare..more than 10 millions..

Last edited by Scrutinizer; 10-17-2013 at 03:47 PM.. Reason: code tags
Sponsored Links
    #2  
Old 10-16-2013
CarloM CarloM is offline Forum Advisor  
Registered User
 
Join Date: Oct 2011
Last Activity: 22 August 2014, 7:35 AM EDT
Location: London, UK
Posts: 1,043
Thanks: 107
Thanked 241 Times in 226 Posts
Exporting 10 million records to a flat file and processing that is unlikely to be faster than just doing it in SQL, at least if the relevant columns are indexed. Have you checked your query with explain plan or similar to see if you can optimise it at all?
Sponsored Links
    #3  
Old 10-17-2013
kashik786 kashik786 is offline
Registered User
 
Join Date: Sep 2009
Last Activity: 17 October 2013, 1:38 PM EDT
Posts: 6
Thanks: 0
Thanked 0 Times in 0 Posts
ya I thought it will be a problem but any way I got some hint of using CONTAINS function oracle. Thank you
Sponsored Links
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Join all the lines matching similar pattern evrurs Shell Programming and Scripting 2 12-19-2012 07:33 AM
Matching and reporting near-similar lines in a file Fahmida UNIX for Dummies Questions & Answers 7 11-24-2011 05:21 AM
script to return records which are not matching rajivrsk Shell Programming and Scripting 8 10-24-2011 07:34 AM
Help with shell script in formatting the records. vinny81 Shell Programming and Scripting 2 02-24-2010 07:13 PM
shell script similar to the command HEAD BELLA86 Shell Programming and Scripting 3 11-27-2009 01:24 PM



All times are GMT -4. The time now is 03:15 PM.