The UNIX and Linux Forums  
Hello and Welcome from United States to the UNIX and Linux Forums! Thank You for Visiting and Joining Our Global Community.

Go Back   The UNIX and Linux Forums > Top Forums > Shell Programming and Scripting
Filtering multiple entries in a file Filtering multiple entries in a file
.
google unix.com

Forums Register Forum RulesLinksAlbums FAQ Members List Calendar Search Today's Posts Mark Forums Read


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Multiple crontab entries crashing server alexandicity Red Hat 2 05-12-2008 09:25 AM
Need Script to delete multiple entries from a file sidewayz Shell Programming and Scripting 1 02-14-2008 12:38 PM
problem in filtering the file adityam UNIX for Dummies Questions & Answers 0 11-22-2007 07:37 AM
Urgent: Filtering a File HItesh Shell Programming and Scripting 5 05-11-2006 04:16 AM
filtering by file size nir UNIX for Dummies Questions & Answers 2 01-17-2002 10:17 PM

Closed Thread
English Japanese Spanish French German Portuguese Italian Dutch Swedish Russian Norwegian Hungarian Hebrew Danish
 
LinkBack Thread Tools Search this Thread Rate Thread Display Modes
  #1 (permalink)  
Old 08-19-2006
suman_jakkula suman_jakkula is offline
Registered User
  
 

Join Date: Jan 2006
Posts: 35
Filtering multiple entries in a file
Hi,
I have a requirement to filter multiple entries in a text file.
Entries are a pair of 2 lines .Like

line1
line2
.......
........
Here line1, line2 consist of one pair. line1 and line2 contain different data.
There can be multiple entries for the same pair. And there can be 'n' such pairs having multiple entries.
Is there a method available in perl/shell scripting to filter the multiple entries.
Could any one guide me to achieve this? Any help is appreciated.

Thanks in advance.
--------------------
Suman
  #2 (permalink)  
Old 08-19-2006
jim mcnamara jim mcnamara is offline Forum Staff  
...@...
  
 

Join Date: Feb 2004
Location: NM
Posts: 5,643
You want to remove duplicate lines?
Code:
awk '!arr[$0]++' duplicatedfile > noduplicates_in_this_file
  #3 (permalink)  
Old 08-22-2006
suman_jakkula suman_jakkula is offline
Registered User
  
 

Join Date: Jan 2006
Posts: 35
Excellent!!!.


Could you explain me the logic in the command?

Thanks & Regards,
-------------------
Suman
Sponsored Links
Closed Thread

Bookmarks

« automatic header insertion | input redirection question »
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Linear Mode Linear Mode
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 04:54 PM.

The UNIX and Linux Forums - Learn UNIX and UNIX Commands RSS Feeds - Contact Us - The UNIX and Linux Forums - Learn UNIX and UNIX Commands - Archive - Top

Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited. Language translation by Google.
vBCredits v1.4 Copyright ©2007 - 2008, PixelFX Studios
The UNIX and Linux Forums Content Copyright ©1993-2009. All Rights Reserved.Ad Management by RedTyger

Content Relevant URLs by vBSEO 3.2.0