The UNIX and Linux Forums  
Hello and Welcome from United States to the UNIX and Linux Forums! Thank You for Visiting and Joining Our Global Community.

Go Back   The UNIX and Linux Forums > Top Forums > UNIX for Dummies Questions & Answers
Reload this Page Remove duplicate rows of a file based on a value of a column
.
google unix.com

Forums Register Forum RulesLinksAlbums FAQ Members List Calendar Search Today's Posts Mark Forums Read



Thread: Remove duplicate rows of a file based on a value of a column
View Single Post in the UNIX and Linux Forums - Click on the Thread or Permalink to View Entire Thread -->
  #1 (permalink)  
Old 09-26-2008
risk_sly risk_sly is offline
Registered User
  
 

Join Date: Sep 2008
Posts: 17
Remove duplicate rows of a file based on a value of a column
Hi,

I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g.

COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT
A NEW XX22
B 3k32 2322


I want the file not to contain duplicate COL1. i.e. the file should only contain the ff:

COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT


The records with duplicate COL1 were deleted.

Anybody who has suggestions on how to do this?

Thank you.