Merge lines into one

Login or Register for Dates, Times and to Reply

Thread Tools Search this Thread
# 1  
Merge lines into one

Source data file from oracle, terminated by ",". 'Cause some of fields have \r\n, then those lines were splitted into multiple lines in the expoted data file. Just vi this file, and found ^M. How to concatenate these line into one if it has a ^M at then end.

# 2  
More info

In these cases it really helps if you supply sample input data and an example of what you want to be output after the text processing.
# 3  
"2007-09-09","1-71J-1","2004-03-20 12:00:59","0-1","2006-01-16 17:27:19","1-2RRYX-6","N","xuwedong",,"xwd",,,,,,"tv","Mr.","No Match Row Id","mail","111111111",,"+8610666666",,"rmrb","^M
Building B 1503","100102",,"Active","0-5220",,"CN","Working Time",,"11111111111111X","Passport",,"Master","payment",,,,"travel",,,,
# 4  
Pl post the fix

Hello there,

Even we also have same issue and could not find any solution did you fix your problem?

Pl post the fix...

THank you,
# 5  

tr -d '\r' < your_file

# 6  
Hello Frenkline for quick update

But when I try tr -d '\r' it removed my ^M but still keeps my line as follows

Special Olympics Missouri,None,Muller+Company,MULLE001,4498,MS-80124-58-SOMO-ME-US-Special Olympics Basketball - St Louis,,Marc Hale,C1-MS-IS,,45305,2/18/2008,3/9/2008,N/A,MySpace ROS Leaderboard (728x90) ,cpm,1.45,"434,483",0,0,0%,0,"4739 Belleview
Kansas City, KS 64112
United States
",Net 30,Bill on Delivery - 3rd Party,jsydnor,N/A,Associated Profile,N/A,0,0,0,0,N/A,0.00%,N,February 2008 - February 2008,"248,276",360,0,0,N/A,0,0%,0,,N/A,N/A,N/A,"16 - 18, 18 - 24",N/A,8,N/A,United States,St.Louis-609,N/A,N/A,Feb-08,2/29/2008,2/1/2008,USD,2/18/2008,3/9/2008,,,,3832,0,452,100%,,,FIM,MySpace Standard Terms,0,,,N/A,N/A,N/A,N/A

After Belleview, Kensas City is on new line and United States also new line

I want that merge into one line.

I tried tr -d '\r' and '\n' also but still no help Smilie

Thank you,
# 7  
Question Let's find out what is truly in your file

can you do something like:

head -2 filename | od -An -t oC -w10
head -2 filename | od -An -t dC -w10 <<--displays data in decimal ASCII

Thus, if I can do the following to see my data
> head -2 uprlwr.fmt                    

But if I do
> head -2 uprlwr.fmt | od -An -t oC -w10
 113 105 131 103 117 104 105 054 062 065
 054 103 012 106 111 114 105 111 104 054
 061 065 054 103 012

I pay special attention to the octal codes, looking out for any less than 40 as these are special or control characters. 012 is line-feed, 015 is carriage-return
It is possible that you need to trap for something else. Perhaps something greater than 177.

Last edited by joeyg; 05-22-2008 at 05:25 PM.. Reason: Added command to display in decimal ASCII also (for those who don't remember octal!)
Login or Register for Dates, Times and to Reply

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #84
Difficulty: Easy
Windows 3.1, Windows 95, Windows 98, and Windows ME were all based on DOS.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge Lines

Hello I have an input as below this is test we are( ) one end of description I am looking for output this is test we are () one end of description (2 Replies)
Discussion started by: Tomlight
2 Replies

2. UNIX for Dummies Questions & Answers

How to merge every n lines into one line?

I want to merge every 16 lines into one line, how can I do that? My file looks like below: 0 . 2 2 . 0 0 . 0 0 . 0 0 . 0 0 0 0 0 (2 Replies)
Discussion started by: ml4me
2 Replies

3. Shell Programming and Scripting

Merge lines

Hello I have a file with CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 How can merge the CAR and the COLOR + SIZE (if there are COLOR,SIZE) CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 Every line begin in... (4 Replies)
Discussion started by: sharong
4 Replies

4. Shell Programming and Scripting

Merge broken lines

i have a file of this type: SEAT-RES¦$D0317.PBOUC32A.GURD3591 ¦00000100¦201203161000¦B¦32 ¦2WN¦EUS-¦MAN¦VAS¦4827¦TTL011 ¦ SEAT-RES¦$D0317.PBOUC32A.GURD3591 ¦00000101¦201203161000¦B¦25 ¦2WN¦EUS-¦MAN¦VAS¦4827¦TTL011 ¦ ... (22 Replies)
Discussion started by: ashwin_winwin
22 Replies

5. Shell Programming and Scripting

remove blank lines and merge lines in shell

Hi, I'm not a expert in shell programming, so i've come here to take help from u gurus. I'm trying to tailor a csv file that i got to make it work for the LOAD FROM command. I've a datatable csv of the below format - --in file format xx,xx,xx ,xx , , , , ,,xx, xxxx,, ,, xxx,... (11 Replies)
Discussion started by: dvah
11 Replies

6. Shell Programming and Scripting

Merge two lines using sed

Hi, I am trying to merge two lines, first line starts with a particular pattern and second line ends with a particular pattern in a file. Something like: First line starts with say ABC Second line ends with say XYZ After a merge, the line should become ABC.......XYZ I tried... (14 Replies)
Discussion started by: Sunny Arora
14 Replies

7. UNIX for Dummies Questions & Answers

Merge lines together in unix

I have a file like this. Pls help me to solve this in ksh (I should look for only Message : 111 and need to print the start time to end time Need to ignore other type of messages. Ex: if first message is 111 and second message is 000 or anything else then ignore the 2nd one and print start time... (7 Replies)
Discussion started by: mnjx
7 Replies

8. Shell Programming and Scripting

merge lines

Hi guys in input every 1st line 1st ID value located in 2nd line 1st occurrence . I need to print them down accordingly.. Thanx in advance input rs1040480_XXXXX.value rs1040481_YYYYY.value rs1040482_TXXXX.value 0.7408157 0.3410044 0.7408157 ... (7 Replies)
Discussion started by: stateperl
7 Replies

9. UNIX for Dummies Questions & Answers

want to merge two consecutive lines.

Hi All, I want to merge two consecutive lines. Currently the output is :--> crmplp1 cmis461 No Online cmis462 No Offline crmplp2 cmis462 No Online cmis463 No ... (6 Replies)
Discussion started by: pank29
6 Replies

10. Shell Programming and Scripting

Merge two lines

Hi I have two lines of data formatted as displayed below shop, price, remark, date a,#N/A,order to -fd, 20091011 and would like it to be shop:a price:#N/A remark:order to -fd date:20091011 How can I do it? Many thanks (2 Replies)
Discussion started by: lalelle
2 Replies

Featured Tech Videos