Remove carriage return and append the next line


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove carriage return and append the next line
# 1  
Old 05-11-2016
Remove carriage return and append the next line

Hi All,

My requirement is to remove the carriage return in from the lines which i am reading if the length is lesser than 1330 and append the next line with it. Below is the realistic example of file structure.
Input file:
Code:
Blah blah blah blah Blah blah blah blah
Blah blah blah blah Blah blah blah blah
Blah blah blah blah Blah
blah blah blah
Blah blah blah blah Blah blah blah blah

Output file:
Code:
Blah blah blah blah Blah blah blah blah
Blah blah blah blah Blah blah blah blah
Blah blah blah blah Blah blah blah blah
Blah blah blah blah Blah blah blah blah

With adding a single space in front of the 4th line i want to append it to 3rd line in input file.

I know how to do this with WHILE - DO - DONE loop but it works only well for small files. For huge files it will lead into performance issue.

So i would like to do this in AWK or SED command. Requesting your help.

Thanks.

---------- Post updated at 08:04 PM ---------- Previous update was at 08:02 PM ----------

Note I am using AIX 6.0 flavor of UNIX system.
# 2  
Old 05-11-2016
You're talking of <newline> chars, not <carriage return>?

Try
Code:
awk  '{while (length < 1330 && getline s>0) $0=$0 " " s}1'  file

This User Gave Thanks to RudiC For This Post:
# 3  
Old 05-11-2016
Hello mad man,

Could you please try following and let me know if this helps you.
Code:
awk '{gsub(/\r/,X,$0);if(length($0)<1330){Q=Q?Q OFS $0:$0};if(length($0)>1330){if(Q){print Q;Q=""};print}}'   Input_file

Thanks,
R. Singh
# 4  
Old 05-11-2016
Quote:
Originally Posted by RudiC
You're talking of <newline> chars, not <carriage return>?

Try
Code:
awk  '{while (length < 1330 && getline s>0) $0=$0 " " s}1'  file

Hi Rudi C,

I tried your solution But it made to append the impacted line's before and after lines are also to get append behind their previous lines

---------- Post updated at 08:34 PM ---------- Previous update was at 08:31 PM ----------

Quote:
Originally Posted by RavinderSingh13
Hello mad man,

Could you please try following and let me know if this helps you.
Code:
awk '{gsub(/\r/,X,$0);if(length($0)<1330){Q=Q?Q OFS $0:$0};if(length($0)>1330){if(Q){print Q;Q=""};print}}'   Input_file

Thanks,
R. Singh
Hi I tried this it does not produced any output.
# 5  
Old 05-11-2016
Hello mad man,

Not sure but the Input_file which you have shown doesn't have any line whose length is more than 1330, so if you are using same Input_file I don't think so it will show any output. You could confirm by doing following too.
Code:
awk '{print length($0)}' Input_file

In case no line is having more than 1330 length then you could change the length into above code.

Thanks,
R. Singh
This User Gave Thanks to RavinderSingh13 For This Post:
# 6  
Old 05-11-2016
What be the actual lengths of your lines?
This User Gave Thanks to RudiC For This Post:
# 7  
Old 05-11-2016
@ Ravinder singh

i executed the last command and got 1329 as maximum value in the file.
i edited the command you have given replacing all 1330 with 1329 still no luck.
Thanks

---------- Post updated at 11:57 PM ---------- Previous update was at 11:56 PM ----------

@RudiC hope my last post would have answered you too.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove Carriage Return (CRLF) within double quotes

How to remove Carriage Return (CRLF) within double quotes in a file. There are multiple CRLFs within double quotes. We are on Ubuntu 14.04.2 LTS. The file that we are importing is a csv file from unix to windows and the file was formatted to unix2dos. Therefore all lines in the file all have... (12 Replies)
Discussion started by: covina
12 Replies

2. UNIX for Dummies Questions & Answers

Remove carriage return

I need to remove the carriage return comes inbetween the record. Need to have CR only at the end. I used the below command. tr -d '\n' < filewithcarriagereturns > filewithoutcarriagereturns But its removing all the CR and giving one line output. Input File: 12345 abcdegh... (11 Replies)
Discussion started by: srvn_saru
11 Replies

3. Shell Programming and Scripting

Remove carriage return from the variable

Hi, I try to handle very large numbers with a bash script. I run ssh command in a remote server and store the output in a local variable. But this output contains a return carriage at the end. So I try to remove it by tr But I can't figure out the right notation with printf. So my problem... (6 Replies)
Discussion started by: Meacham12
6 Replies

4. Shell Programming and Scripting

Awk to remove carriage return from 65th field

Hi, I have a pipe delimited file. There are around 700 columns in the file. The 65th column has carriage return which is causing read issue with our ETL process. I would like to replace the new line characters in 65th field with "nothing" i have return the following code and need help to... (7 Replies)
Discussion started by: pinnacle
7 Replies

5. Shell Programming and Scripting

Remove carriage return in a record

Hi all gurus, I need help in removing carriage return existed within a record delimited by pipe <|>. Sample: A_01|Test1|Testing1|Remarks1 A_02|Test2|Test ing2|Remarks2 A_03|Test3|Testing3| Remarks3 Desire output: A_01|Test1|Testing1|Remarks1 A_02|Test2|Testing2|Remarks2... (10 Replies)
Discussion started by: agathaeleanor
10 Replies

6. UNIX for Dummies Questions & Answers

Remove ^M (carriage return) with string manipulation

Hello, I want remove ^M at end of my files line if I use command : tr -d '\r' <inp>out it work fine but get I the same result by manipulating the string ? I want this because in my text file I manipulate some other part I have input "the cat^M" I want output "the cat" I have made... (3 Replies)
Discussion started by: aquila_1
3 Replies

7. Shell Programming and Scripting

sqlplus returning value - remove carriage return '\r' - Please help

Guys - Simple code, i am trying to get a number back from sqlplus call to a query. After that, i need to use that number in a loop. --------------------------------- #!/bin/ksh VALUE=`sqlplus -silent sh/password@sh <<END set pagesize 0 feedback off verify off heading off echo off select... (10 Replies)
Discussion started by: sunshine1974
10 Replies

8. Shell Programming and Scripting

strip carriage return & append next line

Hello everyone, I am trying to search a file for lines that start with 'ip:' and have a carriage return after(ip:$). I then want to remove the carriage return from that line and append the next line in the file to the line containing 'ip'. I tried doing this with SED, but had no luck. Any... (3 Replies)
Discussion started by: vada010
3 Replies

9. UNIX for Dummies Questions & Answers

To remove carriage return between the line

Hi, I have a situation where I need to remove the carriage return between the lines. For.eg. The input file: 1,ad,"adc sdfd",edf 2,asd,"def fde",asd The output file should be 1,ad,adc sdfd,edf 2,asd,def fde,asd Thanks Shash (5 Replies)
Discussion started by: shash
5 Replies

10. UNIX for Dummies Questions & Answers

Remove a carriage return at end of variable

Is there a command in unix to remove a carriage return character(^M) at the end of a variable value? (5 Replies)
Discussion started by: flagship99
5 Replies
Login or Register to Ask a Question