Shell Programming and Scripting

Hi,

I have a very big (with around 1 million entries) txt file with IPv4 addresses in the standard format, i.e. a.b.c.d

The file looks like

10.1.1.1
10.1.1.1
10.1.1.1
10.1.2.4
10.1.2.4
12.1.5.6
.
.
.
.

and so on....

There are duplicate/multiple entries for some IP addresses. I want an awk/sed script (since the file is too big) to remove the copies of the IP addresses that are being repeated OR in other words I just want to keep distinct entries (IP addresses in this case) and write them in an output file. So the output file would look something like this:

10.1.1.1
10.1.2.4
12.1.5.6
.
.
.

and so on...

Any help would be highly appreciated.

Thanks !

This question has been asked numerous times. Search the site for print unique, and choose one of the many solutions.