How can i prepare a file by comparing two other files?

manmohanpv · #1 (**permalink**) 02-15-2008

File 1 data:

TestA
TestB
TestC

File 2 data:

TestA
TestD
TestE

My Output File (pick all from both and create a file without duplicate data)
----------------------------------------------------------------------

TestA
TestB
TestC
TestD
TestE

----------------------------------------------------------------
here, TestA comes in both files, i dont want to duplicate it (appear multiple times) in my output file. How can i do it?

Thanks in advance,

-mac

robotronic · #2 (**permalink**) 02-16-2008

Code:

awk '!x[$0]++' file1 file2

robotronic · #3 (**permalink**) 02-16-2008

I've misunderstood the request. The previous script removes duplicate entries but doesn't sort the data.

You can simply use:

Code:

sort -u file1 file2

summer_cherry · #4 (**permalink**) 02-18-2008

Hi,

Follow one should be ok for you.

Code:

sort file1 > t1
sort file2 > t2
comm t1 t2 | sed 's/	//g'
rm t1 t2

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Comparing two files	superstar003	Shell Programming and Scripting	2	05-08-2008 04:36 AM
comparing shadow files with real files	terrym	UNIX for Advanced & Expert Users	4	02-09-2007 02:38 AM
comparing two files using awk.	jerome Sukumar	Shell Programming and Scripting	4	11-22-2006 06:27 AM
comparing files to contents of a file	SummitElse	Shell Programming and Scripting	3	06-28-2006 12:36 PM
shell script comparing files in a file	raina_nalin	Shell Programming and Scripting	4	06-21-2005 06:00 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by