Removing Blank Lines


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing Blank Lines
# 1  
Old 05-07-2008
Removing Blank Lines

Hi
i have the below lines from a file

7538
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
7538
7538
7538
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036



PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036
PRGRP450800PERSONAL SOAP AND BATH ADDITIV 7036

I want to remove the BLANK lines from this file. I am reading a file of size atleast 1 GB.

So kindly let me know which would be the best way to quickly reduce the processing time when removing the blanks.

If you can give me an example that would also be fine.

Regards
Dhana
# 2  
Old 05-07-2008
You could run the following command:

sed '/^$/d' < file1 > file2

file2 is the one without blank lines.

some of the version of sed allows '-i' switch to do in place. It saves the output in the same file.
# 3  
Old 05-08-2008
Code:
sed 's/^$//g' filename>newfile

# 4  
Old 05-08-2008
or in grep...

Quote:
grep -v '^$' origfile > newfile
I just don't know the performance if tested against a very large file..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To check Blank Lines, Blank Records and Junk Characters in a File

Hi All Need Help I have a file with the below format (ABC.TXT) : ®¿¿ABCDHEJJSJJ|XCBJSKK01|M|7348974982790 HDFLJDKJSKJ|KJALKSD02|M|7378439274898 KJHSAJKHHJJ|LJDSAJKK03|F|9898982039999 (cont......) I need to write a script where it will check for : blank lines (between rows,before... (6 Replies)
Discussion started by: chatwithsaurav
6 Replies

2. UNIX for Advanced & Expert Users

Delete blank spaces and blank lines in a file

Hi Gurus, Somebody can say me how to delete blank spaces and blank lines in a file unix, please. Thank you for advanced. (10 Replies)
Discussion started by: systemoper
10 Replies

3. Shell Programming and Scripting

Removing blank lines

Hi, my input file is like this I want to remove the blank line. "/home/rit/sandbox/garuda/data/test/woman/T_RITK_F0008_ML_100080039.lab" r a N e l a k sh a m . "/home/rit/sandbox/garuda/data/test/woman/T_RITK_F0008_ML_100070453.lab" a v a s (4 Replies)
Discussion started by: sreejithalokkan
4 Replies

4. Shell Programming and Scripting

Removing blank lines from a file

Hi All, How do i remove continuos blank lines from a file. I have a file with data: abc; def; ghi; jkl; mno; pqr; In the above file, there are two blank lines. I want to remove, one out of them. My output should look like: (2 Replies)
Discussion started by: raosr020
2 Replies

5. UNIX for Dummies Questions & Answers

Removing blank lines not working

In my bash script I want to echo lines in a file and ensure no blank lines are echoed:for i in $(cat txt) do echo $i | sed 's/|/ /g;s/ SEARCHTERM$//g;s/ /\r\n/g;s/^$/d' done Keep in mind this is a fragment so ignore the fact that the for loop is not closed. When I add the "s/^$/d' per... (12 Replies)
Discussion started by: MaindotC
12 Replies

6. Shell Programming and Scripting

Delete blank lines, if blank lines are more than one using shell

Hi, Consider a file named "testfile" The contents of file are as below first line added for test second line added for test third line added for test fourth line added for test fifth line added for test (5 Replies)
Discussion started by: anil8103
5 Replies

7. UNIX for Dummies Questions & Answers

Removing blank lines in a file

Hi I have a text file that has blank lines at different places. How to remove all the blank lines in a file? Thanks Ashok (3 Replies)
Discussion started by: ashok.k
3 Replies

8. Shell Programming and Scripting

PERL: removing blank lines from multiple files

Hi Guru's , I have a whole bunch of files in /var/tmp that i need to strip any blank lines from, so ive written the following script to identify the lines (which works perfectly).. but i wanted to know, how can I actually strip the identified lines from the actual source files ?? my... (11 Replies)
Discussion started by: hcclnoodles
11 Replies

9. Shell Programming and Scripting

Removing blank lines from comma seperated and space seperated file.

Hi, I want to remove empty/blank lines from comma seperated and space seperated files Thanks all for help (11 Replies)
Discussion started by: pinnacle
11 Replies

10. Shell Programming and Scripting

removing duplicate blank lines

Hi, how to remove the blank lines from the file only If we have more than one blank line. thanks rameez (8 Replies)
Discussion started by: rameezrajas
8 Replies
Login or Register to Ask a Question