The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > Shell Programming and Scripting
Google UNIX.COM
Home Forums Register Rules & FAQ Members List Arcade Search Today's Posts Mark Forums Read


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts here. Shell Script Page.


Other UNIX.COM Threads You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
finding duplicates in columns and removing lines totus Shell Programming and Scripting 14 05-16-2008 05:10 PM
using sed to get rid of duplicated columns... fedora Shell Programming and Scripting 4 04-10-2008 01:21 PM
remove duplicated columns kamel.seg Shell Programming and Scripting 6 02-21-2008 03:36 AM
Removing lines that are (same in content) based on columns adsforall UNIX for Dummies Questions & Answers 7 11-09-2007 08:13 AM
remove duplicated lines without sort lalelle Shell Programming and Scripting 6 08-21-2007 04:44 AM

Reply
 
Submit Tools LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 05-16-2008
yahyaaa's Avatar
Registered User
 

Join Date: May 2008
Location: Jordan
Posts: 23
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiReddit! Stumble this Post!Spurl this Post!
Help removing lines with duplicated columns

Hi Guys...

Please Could you help me with the following ?

aaaa bbbb cccc sdsd
aaaa bbbb cccc qwer

as you can see, the 2 lines are matched in three fields...
how can I delete this pupicate ? I mean to delete the second one if 3 fields were duplicated ?

Thanks
Reply With Quote
Forum Sponsor
  #2 (permalink)  
Old 05-16-2008
Registered User
 

Join Date: Apr 2008
Location: European Union/Germany
Posts: 173
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiReddit! Stumble this Post!Spurl this Post!
i) Use useful topics!
ii)
Code:
awk -F" " '! something[$3]++' inputfile
Reply With Quote
  #3 (permalink)  
Old 05-16-2008
yahyaaa's Avatar
Registered User
 

Join Date: May 2008
Location: Jordan
Posts: 23
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiReddit! Stumble this Post!Spurl this Post!
Hi again

Could you explain this command for me ....
Reply With Quote
  #4 (permalink)  
Old 05-16-2008
yahyaaa's Avatar
Registered User
 

Join Date: May 2008
Location: Jordan
Posts: 23
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiReddit! Stumble this Post!Spurl this Post!
Hi again

and what do u mean by " Use useful topics "...

Regards
Reply With Quote
  #5 (permalink)  
Old 05-16-2008
Registered User
 

Join Date: Apr 2008
Location: European Union/Germany
Posts: 173
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiReddit! Stumble this Post!Spurl this Post!
You've named this thread - your question - simply "help". It would be much better to use something like "removing duplicate lines".

And well, I see you've finally used the board search finding duplicates in columns and removing lines .

Let's put it together:
i) you've used a meaningless topic
ii) you've posted your problem three times
iii) you've already found a thread in which you problem is answered and explained

Do you really believe this will motivate me to explain this to you? I don't.
Reply With Quote
Google UNIX.COM
Reply



Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -7. The time now is 10:49 PM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
The UNIX and Linux Forums Content Copyright ©1993-2008 The CEP Blog All Rights Reserved -Ad Management by RedTyger

Search Engine Optimization by vBSEO 3.1.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102