How to remove duplicates without sorting - UNIX for Dummies Questions & Answers - The UNIX and Linux Forums

The UNIX and Linux Forums

		The UNIX and Linux Forums > Top Forums > UNIX for Dummies Questions & Answers
How to remove duplicates without sorting

.

google unix.com

Mark Forums Read

Thread: How to remove duplicates without sorting

View Single Post in the UNIX and Linux Forums - Click on the Thread or Permalink to View Entire Thread -->

#4 (permalink)

Old

01-17-2008

matrixmadhan matrixmadhan is offline

matrixmadhan is offline

Forum Advisor

Technorati Master

Join Date: Mar 2005

Location: leaf node in B+ tree

Posts: 2,958

Quote:

sort File1 | uniq > File2

You don't need a sort and uniq for removing duplicates

same can be accomplished by "-u" option

Code:

sort -u filename > new.filename