Duplicate lines in the file

guptan · #1 (**permalink**) 05-18-2006

Hi,

I have a file with duplicate lines in it. I want to keep only the duplicate lines and delete the non duplicates. Can some one please help me?

Regards
Narayana Gupta

ranj@chn · #2 (**permalink**) 05-18-2006

IF the file is already sorted, then

uniq -d filename

otherwise

sort filename | uniq -d

ranj@chn · #3 (**permalink**) 05-18-2006

awk '{a[$0]++;} END {for (i in a) {if (a[i] > 1) print i;} }' filename

guptan · #4 (**permalink**) 05-18-2006

Thanks Ranj, It worked.

Regards
Narayana Gupta

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Remove Duplicate lines from File	Nysif Steve	UNIX for Dummies Questions & Answers	18	09-09-2007 08:57 AM
How to redirect duplicate lines from a file????	zing_foru	UNIX for Dummies Questions & Answers	3	04-25-2007 07:03 AM
removing duplicate lines from a file	ocelot	UNIX for Dummies Questions & Answers	4	01-25-2007 11:02 AM
Remove Duplicate Lines in File	Teh Tiack Ein	Shell Programming and Scripting	5	01-12-2006 08:30 AM
Counting The Number Of Duplicate Lines In a File	crunchtime	UNIX for Dummies Questions & Answers	2	07-04-2003 01:24 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by