Compare 200,000 of rows in two text files

ppat7046 · #1 (**permalink**) 04-03-2009

Friends,

I have two very large plain text files with pipe delimited as below.
Both files are not sorted.
Both files have 200,000 of rows.

FName|LName|Address|HPhNumber

Is perl or shell script feasible for this task?

Thanks,
Prashant

TonyFullerMalv · #2 (**permalink**) 04-03-2009

This shell script may do what you are after?

Code:

sort file1 > file1.sorted
sort file2 > file2.sorted
sdiff file1.sorted file2.sorted

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
How to compare two text files in column wise?	psiva_arul	UNIX for Advanced & Expert Users	3	03-19-2009 12:46 PM
compare two text files in a good format	pareshan	UNIX for Dummies Questions & Answers	2	03-18-2009 11:22 AM
How to compare contents of two CSV rows	axwack	Shell Programming and Scripting	1	10-23-2008 07:47 PM
sed or awk to convert text files with recurring headings to rows and colum	Bjoeboo	Shell Programming and Scripting	5	05-07-2008 11:47 AM
compare text files	jimmyflip	UNIX for Dummies Questions & Answers	14	05-28-2002 08:02 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by