Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Remove line feed in data

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove line feed in data
# 1  
Old 05-16-2018
Remove line feed in data
Moderator's Comments:
Mod Comment
Please use code tags for sample data


Hi
I have a file where there are line feeds in the data. I am not able to read the file from an application. I exported this data from Access database and many columns contain line feed.

My data looks like this

Code:
abcd,efgh,ijkl,mnop
abcd,ef
gh,ijkl,mnop
abcd,efgh,ij
kl,mnop

I want the data as

Code:
abcd,efgh,ijkl,mnop
abcd,efgh,ijkl,mnop
abcd,efgh,ijkl,mnop

I am thinking of looping through every line until it reaches the count of delimiter(in this case 3) and remove the line feed.

Can anyone help me out!!
Last edited by jim mcnamara; 05-16-2018 at 08:47 PM..
# 2  
Old 05-16-2018
Code:
awk -F, '
NF == 4 {if (l) print l; print $0; l=""}
NF < 4  {l=l $0; if (gsub(",", ",", l) > 2) {print l; l=""}}
END {if (l) print l}
' data

# 3  
Old 05-17-2018
Try also
Code:
awk -F, '
        {while (NF < 4) {getline X
                         $0 = $0  X
                        }
        }
1
' file

# 4  
Old 05-17-2018
Another way you could try:
Code:
awk -F, 'p!=""{$0=p $0} NF<4{p=$0; next} {p=x}1' file

# 5  
Old 05-17-2018
Hello dnat,

In case your Input_file is same as shown sample then following may also help you on same.
Code:
awk '{printf("%s%s",$0!~/^abcd/?"":(FNR==1?"":ORS),$0)} END{if($0!~/^abcd/){print ""}}'  Input_file

Thanks,
R. Singh
# 6  
Old 05-31-2018
You've got to love the charity of people on this forum. You have a question, and you get multiple solutions on how to solve it!
# 7  
Old 06-01-2018
Quote:
Originally Posted by RudiC
Try also
Code:
awk -F, '
        {while (NF < 4) {getline X
                         $0 = $0  X
                        }
        }
1
' file

Better ensure that getline was successful
Code:
awk -F, '
        {while (NF < 4 && getline X) $0 = $0  X
        }
1
' file

A sed solution
Code:
sed '
   :L
   s/,/&/3
   t
   $!N
   s/\n//
   tL
' file

This User Gave Thanks to MadeInGermany For This Post:
RudiC
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Getting an unexpected newline in my while loop line-by-line feed

Hi, I'm trying to get a line returned as is from the below input.csv file in Bash in Linux, and somehow I get an unexpected newline in the middle of my input. Here's a sample line in input.csv $> more input.csv TEST_SYSTEM,DUMMY@GMAIL.COM|JULIA H|BROWN And here's a very basic while loop... (7 Replies)
Discussion started by: ChicagoBlues
7 Replies

2. Shell Programming and Scripting

awk issue splitting a fixed-width file containing line feed in data

Hi Forum. I have the following script that splits a large fixed-width file into smaller multiple fixed-width files based on input segment type. The main command in the script is: awk -v search_col_pos=$search_col_pos -v search_str_len=$search_str_len -v segment_type="$segment_type"... (8 Replies)
Discussion started by: pchang
8 Replies

3. Shell Programming and Scripting

Want to remove a line feed depending on number of tabs in a line

Hi! I have been struggling with a large file that has stray end of line characters. I am working on a Mac (Lion). I mention this only because I have been mucking around with fixing my problem using sed, and I have learned far more than I wanted to know about Unix and Mac eol characters. I... (1 Reply)
Discussion started by: user999991
1 Replies

4. Shell Programming and Scripting

awk remove line feed

Hi, I've this file: 1, 2, 3, 4, 5, 6, I need to remove the line feed LF every 3 row. 1,2,3, 4,5,6, Thanks in advance, Alfredo (5 Replies)
Discussion started by: alfreale
5 Replies

5. Shell Programming and Scripting

Remove line feed from csv file column

Hi All, i have a csv file . In the 7th column i have data that has line feed in it. Requirement is to remove the line feed from the 7th column whenever it appears There are 11 columns in the file C1,C2,C3,C4,C5,C6,C7,C8,C9,C10,C11 The value in C7 contains line feed ( Alt + Enter ),... (2 Replies)
Discussion started by: r_t_1601
2 Replies

6. Shell Programming and Scripting

Remove line feed from csv file column

Hi All, My requirement is to remove line (3 Replies)
Discussion started by: r_t_1601
3 Replies

7. Shell Programming and Scripting

Get the 1st 99 characters and add new line feed at the end of the line

I have a file with varying record length in it. I need to reformat this file so that each line will have a length of 100 characters (99 characters + the line feed). AU * A01 EXPENSE 6990370000 CWF SUBC TRAVEL & MISC MY * A02 RESALE 6990788000 Y... (3 Replies)
Discussion started by: udelalv
3 Replies

8. Shell Programming and Scripting

SED remove line feed and add to certain area

Hi All, I have a xml file and requirement is to remove the line feed and add line feed after some element. <?xml version="1.0" ?> <AUDITRECORDS> <CARF> <HED> <VN1>20090616010622</VN1> <VN2>0</VN2> <VN3>1090</VN3> <VN4>CONFIG_DATA</VN4> ... (8 Replies)
Discussion started by: sreejitnair123
8 Replies

9. Shell Programming and Scripting

replace last form feed with line feed

Hi I have a file with lots of line feeds and form feeds (page break). Need to replace last occurrence of form feed (created by - echo "\f" ) in the file with line feed. Please advise how can i achieve this. TIA Prvn (5 Replies)
Discussion started by: prvnrk
5 Replies

10. Shell Programming and Scripting

need script-remove line feed

hi all, i have csv file with three comma separated columns i/p file First_Name, Address, Last_Name XXX, "456 New albany \n newyork, Unitedstates \n 45322-33", YYY\n ZZZ, "654 rifle park \n toronto, canada \n 43L-w3b", RRR\n is there any way i can remove \n (newline) from the second... (1 Reply)
Discussion started by: gowrish
1 Replies
Login or Register to Ask a Question