The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > UNIX for Dummies Questions & Answers
Google UNIX.COM



View Single Post in UNIX Forums - Click on the Thread or Permalink to View Entire Thread -->
  #1 (permalink)  
Old 04-23-2007
zing_foru zing_foru is offline
Registered User
 

Join Date: Mar 2007
Posts: 33
How to redirect duplicate lines from a file????

Hi,

I am having a file which contains many duplicate lines. I wanted to redirect these duplicate lines into another file.

Suppose I have a file called file_dup.txt which contains some line as

file_dup.txt

A100-R1
ACCOUNTING-CONTROL
ACTONA-ACTASTOR
ADMIN-AUTH-STATS
ACTONA-ACTASTOR
ADMIN-AUTH-STATS

If you see the above file contents the 3 and 4 numbered lines are duplicated. I want to redirect the lines which are duplicated in to another file say file_nodup.txt. So the file_nodup.txt will contain the line as follows

file_nodup.txt

ACTONA-ACTASTOR
ADMIN-AUTH-STATS

Is there any command in UNIX which will give me the above work done?
Or any AWK way to solve it.

Thanks in advance…

Regards…
zing_foru
Reply With Quote
Forum Sponsor