Removing end of line to merge multiple lines - Shell Programming and Scripting

tink · #1 (**permalink**) 10-14-2008

I'm sure this will be an easy question for you experts out there, but I have been searching the forum and working on this for a couple hours now and can't get it right.

I have a very messy data file that I am trying to tidy up - one of the issues is some records are split into multiple lines:

999999000 "Name" "this is text for line one
line two
line three"

And I've been trying all sorts of version of sed to get it to look like this:
999999000 "Name" "this is text for line one line two line three"

and yes, I have tried things like sed 's/$/ /' file1 > file2... the problem is not every line has an issue, so I'm trying to figure out how to only remove line feeds for problematic lines, not all lines

the problem lines will begin with alpha characters not numeric, so I've been trying to do something with that but to no avail

thanks

ShawnMilo · #2 (**permalink**) 10-14-2008

Code:

cat temp.txt  | perl -pe 's/\n/ /'

joeyg · #3 (**permalink**) 10-14-2008

Code:

> cat file31
999999000 "Name" "this is text for line one
line two
line three"
888888000 "Yep" "All on one line"
777777111 "Yes" "Another good text"
555555999 "Name" "this is other text for line one
line two
line three"

> cat calc_file31
rm file32
while read line
  do
  if [ `echo "$line" | tr -d " " | grep '"$'` ]
   then
    echo "$line""~" >>file32
   else
    echo "$line" >>file32
  fi
done <file31

cat file32 | tr "\n" " " | tr "~" "\n"

> calc_file31
999999000 "Name" "this is text for line one line two line three"
 888888000 "Yep" "All on one line"
 777777111 "Yes" "Another good text"
 555555999 "Name" "this is other text for line one line two line three"
>

tink · #4 (**permalink**) 10-14-2008

bloody marvelous joeyg - thanks!

This also worked for me in the end:
sed 's/"$/"|/g' file1 > file2

because the double quote was valid for the last column... so replace double quote and line end with double quote and pipe...

Thanks again

freelong · #5 (**permalink**) 10-14-2008

Code:

awk '/^[0-9]/ { print ""; printf $0}
     !/^[0-9]/ {printf $0}
     END {print ""}' filename

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
removing pattern which is spread in multiple lines	sabyasm	Shell Programming and Scripting	2	05-13-2008 05:19 AM
using tr to put multiple lines of output into one line	otes4	Shell Programming and Scripting	3	02-18-2008 10:30 AM
merge multiple lines from flat file	hnhegde	Shell Programming and Scripting	4	12-05-2006 06:13 PM
Use sed to merge multiple lines	xb88	Shell Programming and Scripting	3	08-08-2006 01:54 PM
Removing user from multiple groups via command line	jquizon62	SUN Solaris	1	10-28-2004 12:56 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread: