The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > Shell Programming and Scripting
removing duplicate blank lines removing duplicate blank lines
.
google unix.com

Forums Casino Register Forum RulesLinksAlbums FAQ Members List Search Today's Posts Mark Forums Read


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Removing Blank Lines dhanamurthy Shell Programming and Scripting 3 05-08-2008 01:52 AM
How to count lines - ignoring blank lines and commented lines kthatch UNIX for Dummies Questions & Answers 6 05-25-2007 01:21 AM
removing duplicate lines from a file ocelot UNIX for Dummies Questions & Answers 4 01-25-2007 10:02 AM
Removing duplicate lines ignore case hellsd UNIX for Dummies Questions & Answers 17 12-02-2004 09:47 AM
delete blank lines or lines with spaces only vascobrito UNIX for Dummies Questions & Answers 3 01-13-2004 06:36 AM

Reply
Page 1 of 2 1 2 >
 
Submit Tools LinkBack Thread Tools Search this Thread Rate Thread Display Modes
  #1 (permalink)  
Old 07-31-2008
Registered User
  

Join Date: Jul 2008
Posts: 4
removing duplicate blank lines
Hi,

how to remove the blank lines from the file only If we have more than one blank line.

thanks
rameez
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 07-31-2008
era era is offline Forum Advisor  
Herder of Useless Cats (On Sabbatical)
  

Join Date: Mar 2008
Location: /there/is/only/bin/sh
Posts: 3,652
Code:
awk '/^$/ { if (blank++) next; print }1' file
Reply With Quote
  #3 (permalink)  
Old 07-31-2008
Registered User
  

Join Date: Jul 2008
Posts: 4
It woks fine.

Can you please explain the following part in the command
'{ if (blank++) next; print }1'
Reply With Quote
  #4 (permalink)  
Old 07-31-2008
era era is offline Forum Advisor  
Herder of Useless Cats (On Sabbatical)
  

Join Date: Mar 2008
Location: /there/is/only/bin/sh
Posts: 3,652
The variable blank will be zero initially, but non-zero (i.e. true) on subsequent runs.

The 1 is an awk idiom which matches and prints lines not handled by previous conditions.

Actually you should change it to '{ blank=0; print }' in order for the script to work correctly on files where there are multiple sequences of adjacent empty lines. Sorry for missing that.
Reply With Quote
  #5 (permalink)  
Old 07-31-2008
Registered User
  

Join Date: Jul 2008
Posts: 4
Thanks...thats great!
Reply With Quote
  #6 (permalink)  
Old 07-31-2008
aigles's Avatar
aigles aigles is offline Forum Advisor  
Registered User
  

Join Date: Apr 2004
Location: Bordeaux, France
Posts: 1,226
Another way with awk yet :
Code:
awk 'NR==1 || NF || prvNF {print} {prvNF=NF}'
Jean-Pierre.
Reply With Quote
  #7 (permalink)  
Old 07-31-2008
era era is offline Forum Advisor  
Herder of Useless Cats (On Sabbatical)
  

Join Date: Mar 2008
Location: /there/is/only/bin/sh
Posts: 3,652
Sorry, it's still not right. Should test before I post. Apologies.

Code:
awk '/^$/{ if (! blank++) print; next } { blank=0; print }'file
(What a grand way to increase my post count ...)
Reply With Quote
Google The UNIX and Linux Forums
Reply
Page 1 of 2 1 2 >

Bookmarks

Edit Tags
Tags
duplicates, truncation

« retrieve lines from file which fall under the given date range | Grep not working - special characters?? »
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Linear Mode Linear Mode
Rate This Thread:




All times are GMT -4. The time now is 08:04 PM.

The UNIX and Linux Forums - Learn UNIX and UNIX Commands RSS Feeds - Contact Us - The UNIX and Linux Forums - Learn UNIX and UNIX Commands - Archive - Top

Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
vBCredits v1.4 Copyright ©2007 - 2008, PixelFX Studios
The UNIX and Linux Forums Content Copyright ©1993-2009. All Rights Reserved.Ad Management by RedTyger

Content Relevant URLs by vBSEO 3.2.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66