|
|
|
google unix.com
|
|||||||
| Forums | Register | Forum Rules | Links | Albums | FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here. |
More UNIX and Linux Forum Topics You Might Find Helpful
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Count number of occurences of a word | shikhakaul | UNIX for Dummies Questions & Answers | 8 | 06-25-2009 12:10 PM |
| Counting number of occurences | kingofprussia | UNIX for Dummies Questions & Answers | 1 | 04-01-2008 08:11 PM |
| Need to replace all occurences of a search string using sed | mjs3221 | Shell Programming and Scripting | 2 | 12-07-2006 02:09 AM |
| number of occurences of a string | siddu_chittari | Shell Programming and Scripting | 12 | 12-05-2006 01:09 AM |
| Counting occurences of different strings in a file | Freerider | UNIX for Dummies Questions & Answers | 4 | 07-15-2005 11:27 AM |
Powered by 
|
|
|
LinkBack | Thread Tools | Search this Thread | Rate Thread | Display Modes |
07-10-2008
|
||||
|
||||
|
Deleting all occurences of a duplicate row
Hi,
I need to delete all occurences of the repeated lines from a file and retain only the lines that is not repeated elsewhere in the file. As seen below the first two lines are same except that for the string "From BaseLine" and "From SMS".I shouldn't consider the string "From SMS" and "From BaseLine" for checking the repeated lines. I want to retain only the third line. From BaseLine - 0T001 000 999999999 00101 20080411000000T1023.27 From SMS - 0T001 000 999999999 00101 20080411000000T1023.27 From BaseLine - 0T001 000 999999999 00101 20080411000000T109.019 My output should be the third line alone. These file size would range from 100 MB to 900MB. The performance factor should also be considered. Can you please help me out? Regards, Ragav. |
| Bookmarks |
| Tags |
| solaris |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
Threaded Mode
