Remove new line starting with a numeric value and append it to the previous line


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove new line starting with a numeric value and append it to the previous line
# 1  
Old 07-12-2018
Remove new line starting with a numeric value and append it to the previous line

Hi,

i have a file with multiple entries. After some tests with sed i managed to get the file output as follows:

Code:
lsn=X-LINK-IN0,apc=661:0,state=avail,avail/links=1/1,
00,2110597,2094790,0,81,529,75649011,56435363,
lsn=TM1ITP1-AM1ITP1-LS,apc=500:0,state=avail,avail/links=1/1,
00,1019687575,1327955853,1,322,583,2810019516,1981897836,
lsn=TM1ITP1-AM1ITP2-LS,apc=501:0,state=avail,avail/links=1/1,
00,536022841,1334912507,0,277,966,2588691785,2512216939,
lsn=TM1ITP1-TMNLSTP1,apc=12309:1,state=avail,avail/links=4/4,
00,28422611,35850253,0,185,216,216892933,38975423,
01,66892965,50298069,0,250,8807,2591394100,803622868,
02,27488395,38094791,0,249,252,170335784,66760929,
03,27762094,19995809,0,251,258,216422353,2019547890,
lsn=TM1ITP1-TMNLSTP2,apc=12547:1,state=avail,avail/links=4/4,
00,80966204,16449140,0,47,121,1928336154,2818020786,
01,332655,171104,0,50,30,25432178,25498178,
02,55281799,11176343,0,93,145,4243472214,1907308254,
03,54060754,28585708,0,363,301,4174500371,4240529245,
lsn=X-LINK-IN1,apc=4882:1,state=avail,avail/links=1/1,
00,40085787,31652380,0,73,755,271023232,3802680330,

What i'm trying to perfrom now is to be able to shift any line starting with a number (in this case they all start with 0) to be shifted on to the next line. or maybe more simpler, all lines which do not begin with "lsn=" are to be appened to the previous line
Example:

Code:
lsn=X-LINK-IN0,apc=661:0,state=avail,avail/links=1/1,00,2110597,2094790,0,81,529,75649011,56435363,
....
lsn=TM1ITP1-TMNLSTP2,apc=12547:1,state=avail,avail/links=4/4,00,80966204,16449140,0,47,121,1928336154,2818020786,01,332655,171104,0,50,30,25432178,25498178,02,55281799,11176343,0,93,145,4243472214,1907308254,03,54060754,28585708,0,363,301,4174500371,4240529245,

Is there a way with sed or tr?

---------- Post updated at 02:47 PM ---------- Previous update was at 02:30 PM ----------

ok it seems this does the trick!

Code:
awk 'BEGIN {accum_line = "";} /^lsn=/{if(length(accum_line)){print accum_line; accum_line = "";}} {accum_line = accum_line " " $0;} END {if(length(accum_line)){print accum_line; }}'

# 2  
Old 07-12-2018
Good you found a solution on your own. You might want to consider to put the preliminary sed stuff into that final awk script as well.
# 3  
Old 07-12-2018
In the sample output you said you were trying to produce, there weren't any leading <space> characters at the start of your output lines and there weren't any <space> characters in the line where lines were joined. So, why does your script use:
Code:
{accum_line = accum_line " " $0;}

instead of just:
Code:
{accum_line = accum_line $0;}

?
# 4  
Old 07-12-2018
Another idea

Code:
awk 'length{gsub(/\n/, ""); print RS $0 }' RS='lsn=' infile

# 5  
Old 07-12-2018
Quote:
Originally Posted by Chubler_XL
Another idea

Code:
awk 'length{gsub(/\n/, ""); print RS $0 }' RS='lsn=' infile

This will work if you're using GNU awk.

But, according to the standards, the results are unspecified if the value assigned to RS is more than one character. On most BSD- and UNIX-systems, awk only looks at the first character of RS and ignores any remaining characters in that variable.
This User Gave Thanks to Don Cragun For This Post:
# 6  
Old 07-13-2018
Hi Don, you are correct.

in fact, I'm using the $0 now and it's working.

Thanks for the info.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Issue while append to previous line

Hi, I have data as below. 36578019,005-923887317,UNMDL,20151230,2C3CCAAG4GH135448,L,TX,20160108,62,"030916 PPT TX AFF RPRT VALID AFF IN PDP WLL FWD TO RYAN ON 031116 CB1619 ",, 36580219,611-923785453,FC,20151209,ZACCJABT9FPC19274,L,TX,20160108,83,,,... (4 Replies)
Discussion started by: JSKOBS
4 Replies

2. UNIX for Dummies Questions & Answers

How to remove fields space and append next line to previous line.?

awk 'BEGIN{FS = "Ç"} NR == 1 {p = $0; next} NF > 1 {print p; p = $0} NF <= 1 {p = (p " " $0)} END {print p}' input.txt > output.txt This is what the input data file looks like with broken lines Code: 29863 Ç890000000 Ç543209911 ÇCHNGOHG Ç000000001 Ç055 ... (4 Replies)
Discussion started by: cumeh1624
4 Replies

3. Shell Programming and Scripting

Append next line to previous lines when NF is less than 0

Hi All, This is very urgent, I've a data file with 1.7 millions rows in the file and the delimiter is cedilla and I need to format the data in such a way that if the NF in the next row is less than 1, it will append that value to previous line. Any help will be appricated. Thanks,... (17 Replies)
Discussion started by: cumeh1624
17 Replies

4. Shell Programming and Scripting

Remove previous line if next & previous lines have same 4th character.

I want to remove commands having no output. In below text file. bash-3.2$ cat abc_do_it.txt grpg10so>show trunk group all status grpg11so>show trunk group all status grpg12so>show trunk group all status GCPKNYAIGT73IMO 1440 1345 0 0 94 0 0 INSERVICE 93% 0%... (4 Replies)
Discussion started by: Raza Ali
4 Replies

5. Shell Programming and Scripting

Append next line to previous line when one pattern not found

Hi, I need help for below scenario.I have a flat file which is having records seperated by delimiters which will represent each record for oracle table.My Control file will consider each line as one record for that table. Some of the lines are aligned in two/three lines so that records are... (4 Replies)
Discussion started by: kannansr621
4 Replies

6. Shell Programming and Scripting

Append specific lines to a previous line based on sequential search criteria

I'll try explain this as best I can. Let me know if it is not clear. I have large text files that contain data as such: 143593502 09-08-20 09:02:13 xxxxxxxxxxx xxxxxxxxxxx 09-08-20 09:02:11 N line 1 test line 2 test line 3 test 143593503 09-08-20 09:02:13... (3 Replies)
Discussion started by: jesse
3 Replies

7. Shell Programming and Scripting

Append each line to next previous line in a file

Hi all, Please help me in providing sample code to append the following 4 lines in one row. Input : A1/EXT "BAPBSC10/07B/00" 523 090530 0115 RXOCF-430 HY1711 1 EXTERNAL ALARM DOOR ALARM Output should be : A1/EXT "BAPBSC10/07B/00" 523 090530 0115 ... (8 Replies)
Discussion started by: sudhakaryadav
8 Replies

8. Shell Programming and Scripting

SED or AWK "append line to the previous line"

Hi, How can I remove the line beak in the following case if the line begin with the special char “;”? TEXT Text;text ;text Text;text;text I want to convert the text to: Text;text;text Text;text;text I have already tried to use... (31 Replies)
Discussion started by: research3
31 Replies

9. UNIX for Advanced & Expert Users

append the line with the previous if it not start with 1=

How to append the line with the previous if it not start with 1=. 1=ttt, 2=xxxxxx, 3=4545 44545, 4=66666, 1=ttt, 2=xxxxxx, 3=34434 3545, 4=66666, 5=ffffff 6=uuuuuuu, 7=ooooooo 1=ttt, 2=xxxxxx, 3=311343545, 4=66666 1=ttt, 2=xxxxxx, 5=XAXAXA, 7=FDFD (3 Replies)
Discussion started by: palsevlohit_123
3 Replies

10. Shell Programming and Scripting

Append line that does not contain pipe to it previous line

Hi All, I have a file which contains data as below When we see no pipe character in the line. append those lines to the previous line with pipe character till we get the next line with pipe character with ~(concat with ~) Input file looks like: 1080530944|001|john.l.bonner|Acknowledge|CN... (11 Replies)
Discussion started by: ainuddin
11 Replies
Login or Register to Ask a Question