Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: any better way to remove line breaks
Top Forums Shell Programming and Scripting any better way to remove line breaks Post 302243594 by era on Monday 6th of October 2008 05:39:17 AM
Old 10-06-2008
Maybe replace all line breaks, then replace back if the next character is not a wedge.

Code:
gzip -dc log.gz | tr '\n' '§' | sed -e 's/§</</g' -e 's/§/\n/g'

The character § is unlikely to occur in the log file, but might be problematic if your locale doesn't handle it as a single byte. If your file doesn't contain any underscores, using an underscore instead is safer; or maybe you can come up with another character which doesn't occur in the file (literal vertical bar perhaps? exclamation mark?)

The notation \n might or might not be understood to mean newline by your tr and/or sed; read the manual page and/or experiment with other possible notations, including \012 (for tr) and literal newline:

Code:
gzip -dc log.gz | tr '
' '§' | sed -e 's/§</</g' -e 's/§/\
/g'

Yes, it looks weird, but it's valid string syntax in the shell. (Might want to try without the backslash before the newline in the sed script if it still doesn't work.)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove page breaks from a flat file???

Hi All, I get a flat file with its last field data splitting onto a new line.I got this program from Vgersh which when run would cancatenate the split data back to the end of the previous records.But this program fails when it encounters a page break between the split data and the previous... (5 Replies)
Discussion started by: kumarsaravana_s
5 Replies

2. Shell Programming and Scripting

Help with wc and line breaks

Hi everyone, I have gone through the forum trying to find an answer to this question but was unsuccessful. I am hoping that someone can help me with this please. I am trying to get my script to recognise line breaks from a file and to give me a result for wc of each line. So basically, if you... (7 Replies)
Discussion started by: stargazerr
7 Replies

3. Shell Programming and Scripting

Piped input to sed 's/\n/ /' doesn't remove the line breaks..

Using ls input as example.. ls | sed 's/\n/ /'outputs with line breaks, where I was expecting the \n to disappear. I've tried \r as well wondering if terminal output used different breaks. Is there a way to remove the line breaks without saving to file and then working from there? ----------... (2 Replies)
Discussion started by: davidpbrown
2 Replies

4. Shell Programming and Scripting

Remove line breaks after a match

I need to remove all line breaks in a document after a match, until there is a blank line. Example below, after the match "THE GREEN TABLE" remove line breaks until a blank line. Then, after the match "THE BLUE TABLE" do the same. Before: THE GREEN TABLE Lorem ipsum dolor sit amet,... (14 Replies)
Discussion started by: dockline
14 Replies

5. Shell Programming and Scripting

Remove line breaks in csv file using shell script

Hi All, I've a csv file in which the record is getting break into 1 line or more than one line. I want to combine those splits into one line and remove the unwanted character existing in the record i.e. double quote symbol ("). The line gets break only when the record contains double... (4 Replies)
Discussion started by: rajak.net
4 Replies

6. Programming

Clean and keep line breaks

Hello, I want to keep line spaces in comments but clean more then 2 after each. Example: $sentence="This is my first sentence This will be in a new row This will be too in a new row but not separated with 3line breaks just with one "; And i want to... (1 Reply)
Discussion started by: AimyThomas
1 Replies

7. UNIX for Dummies Questions & Answers

Page breaks and line breaks

Hi All, Need an urgent solution to an issue . We have created a ksh file or shell script which generates 1 DAT file. the DAT file contains extract of a select statement . Now the issue is , when we are executing the ksh file , the output is coimng with page breaks and line breaks . We have... (4 Replies)
Discussion started by: Ayaskant
4 Replies

8. Shell Programming and Scripting

[BASH] read 'line' issue with leading tabs and virtual line breaks

Heyas I'm trying to read/display a file its content and put borders around it (tui-cat / tui-cat -t(ypwriter). The typewriter-part is a 'bonus' but still has its own flaws, but thats for later. So in some way, i'm trying to rewrite cat using bash and other commands. But sadly it fails on... (2 Replies)
Discussion started by: sea
2 Replies

9. UNIX for Beginners Questions & Answers

Remove line breaks and extra spaces

Hi, I want to remove all extra spaces, line breaks . Need a new line entry only for term starting"array" For eg: my input is array(), array(), array(), and my expected output is array(), array(), array(), Is it possible using awk? (5 Replies)
Discussion started by: rsi.245
5 Replies

10. Shell Programming and Scripting

Remove single-line breaks only in document

Regarding copy/pasted text of copyright-free book from archive.org (link below), in attempt to expand single-line-break paragraph text (not section headings or paragraph breaks) to wider right margin, Justify or Wrap in LIbreOffice is not working, and Find/Replace the paragraph mark ($) wraps all... (2 Replies)
Discussion started by: p1ne
2 Replies

LEARN ABOUT DEBIAN

stag-autoschema

STAG-AUTOSCHEMA(1p)					User Contributed Perl Documentation				       STAG-AUTOSCHEMA(1p)

NAME

       stag-autoschema - writes the implicit stag-schema for a stag file

SYNOPSIS

	 stag-autoschema -w sxpr sample-data.xml

	 stag-autoschema -dtd sample-data.xml

DESCRIPTION

       Takes a stag compatible file (xml, sxpr, itext), or a file in any format plus a parser, and writes out the implicit underlying stag-schema

       stag-schema should look relatively self-explanatory.

       Here is an example stag-schema, shown in sxpr syntax:

	 (db
	  (person*
	   (name "s"
	   (address+
	    (address_type "s")
	    (street "s")
	    (street2? "s")
	    (city "s")
	    (zip? "s")))))

       The database db contains zero or more persons, each person has a mandatory name and at least one address.

       The cardinality mnemonics are as follows:

       +   1 or more

       ?   0 or one

       *   0 or more

       The default cardinality is 1

ARGUMENTS

       -p|parser FORMAT
	   FORMAT is one of xml, sxpr or itext, or the name of a perl module

	   xml assumed as default

       -dtd
	   exports schema as DTD

       -w|writer FORMAT
	   FORMAT is one of xml, sxpr or itext, or the name of a perl module, OR DTD

	   The default is sxpr

	   note that stag schemas exported as xml will be invalid xml, due to the use of symbols *, +, ? in the node names

LIMITATIONS

       not event based - memory usage becomes exhorbitant on large files; prepare a small sample beforehand

perl v5.10.0							    2008-12-23						       STAG-AUTOSCHEMA(1p)
All times are GMT -4. The time now is 02:36 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy