Merge lines into one

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Merge lines into one
# 1  
Old 09-18-2007
Merge lines into one

Source data file from oracle, terminated by ",". 'Cause some of fields have \r\n, then those lines were splitted into multiple lines in the expoted data file. Just vi this file, and found ^M. How to concatenate these line into one if it has a ^M at then end.

# 2  
Old 09-18-2007
More info

In these cases it really helps if you supply sample input data and an example of what you want to be output after the text processing.
# 3  
Old 09-18-2007
"2007-09-09","1-71J-1","2004-03-20 12:00:59","0-1","2006-01-16 17:27:19","1-2RRYX-6","N","xuwedong",,"xwd",,,,,,"tv","Mr.","No Match Row Id","mail","111111111",,"+8610666666",,"rmrb","^M
Building B 1503","100102",,"Active","0-5220",,"CN","Working Time",,"11111111111111X","Passport",,"Master","payment",,,,"travel",,,,
# 4  
Old 05-22-2008
Pl post the fix

Hello there,

Even we also have same issue and could not find any solution did you fix your problem?

Pl post the fix...

THank you,
# 5  
Old 05-22-2008

tr -d '\r' < your_file

# 6  
Old 05-22-2008
Hello Frenkline for quick update

But when I try tr -d '\r' it removed my ^M but still keeps my line as follows

Special Olympics Missouri,None,Muller+Company,MULLE001,4498,MS-80124-58-SOMO-ME-US-Special Olympics Basketball - St Louis,,Marc Hale,C1-MS-IS,,45305,2/18/2008,3/9/2008,N/A,MySpace ROS Leaderboard (728x90) ,cpm,1.45,"434,483",0,0,0%,0,"4739 Belleview
Kansas City, KS 64112
United States
",Net 30,Bill on Delivery - 3rd Party,jsydnor,N/A,Associated Profile,N/A,0,0,0,0,N/A,0.00%,N,February 2008 - February 2008,"248,276",360,0,0,N/A,0,0%,0,,N/A,N/A,N/A,"16 - 18, 18 - 24",N/A,8,N/A,United States,St.Louis-609,N/A,N/A,Feb-08,2/29/2008,2/1/2008,USD,2/18/2008,3/9/2008,,,,3832,0,452,100%,,,FIM,MySpace Standard Terms,0,,,N/A,N/A,N/A,N/A

After Belleview, Kensas City is on new line and United States also new line

I want that merge into one line.

I tried tr -d '\r' and '\n' also but still no help Smilie

Thank you,
# 7  
Old 05-22-2008
Question Let's find out what is truly in your file

can you do something like:

head -2 filename | od -An -t oC -w10
head -2 filename | od -An -t dC -w10 <<--displays data in decimal ASCII

Thus, if I can do the following to see my data
> head -2 uprlwr.fmt                    

But if I do
> head -2 uprlwr.fmt | od -An -t oC -w10
 113 105 131 103 117 104 105 054 062 065
 054 103 012 106 111 114 105 111 104 054
 061 065 054 103 012

I pay special attention to the octal codes, looking out for any less than 40 as these are special or control characters. 012 is line-feed, 015 is carriage-return
It is possible that you need to trap for something else. Perhaps something greater than 177.

Last edited by joeyg; 05-22-2008 at 04:25 PM.. Reason: Added command to display in decimal ASCII also (for those who don't remember octal!)
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge Lines

Hello I have an input as below this is test we are( ) one end of description I am looking for output this is test we are () one end of description (2 Replies)
Discussion started by: Tomlight
2 Replies

2. Shell Programming and Scripting

Merge lines

Hello I have a file with CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 How can merge the CAR and the COLOR + SIZE (if there are COLOR,SIZE) CAR 23 COLOR 12 CAR 44 COLOR 12 CAR 55 COLOR 20 SIZE BIG CAR 56 CAR 57 COLOR 11 Every line begin in... (4 Replies)
Discussion started by: sharong
4 Replies

3. Shell Programming and Scripting

remove blank lines and merge lines in shell

Hi, I'm not a expert in shell programming, so i've come here to take help from u gurus. I'm trying to tailor a csv file that i got to make it work for the LOAD FROM command. I've a datatable csv of the below format - --in file format xx,xx,xx ,xx , , , , ,,xx, xxxx,, ,, xxx,... (11 Replies)
Discussion started by: dvah
11 Replies

4. UNIX for Dummies Questions & Answers

To merge a few lines to 1 line

Hi Experts, This is my input file. input.txt 0 /dev/fd 25 /var 1 /tmp 1 /var/run 1. If this file has single line, then leave it, print the single line else merge the 4 lines above into 1 line as below e.g (6 Replies)
Discussion started by: streddy
6 Replies

5. Shell Programming and Scripting

Merge two lines using sed

Hi, I am trying to merge two lines, first line starts with a particular pattern and second line ends with a particular pattern in a file. Something like: First line starts with say ABC Second line ends with say XYZ After a merge, the line should become ABC.......XYZ I tried... (14 Replies)
Discussion started by: Sunny Arora
14 Replies

6. UNIX for Dummies Questions & Answers

Merge lines together in unix

I have a file like this. Pls help me to solve this in ksh (I should look for only Message : 111 and need to print the start time to end time Need to ignore other type of messages. Ex: if first message is 111 and second message is 000 or anything else then ignore the 2nd one and print start time... (7 Replies)
Discussion started by: mnjx
7 Replies

7. Shell Programming and Scripting

merge lines

Hi guys in input every 1st line 1st ID value located in 2nd line 1st occurrence . I need to print them down accordingly.. Thanx in advance input rs1040480_XXXXX.value rs1040481_YYYYY.value rs1040482_TXXXX.value 0.7408157 0.3410044 0.7408157 ... (7 Replies)
Discussion started by: stateperl
7 Replies

8. Shell Programming and Scripting

merge same pattern lines together

Hi people... I normally find with out any problem the solutions I need just by searching. But for this I'm not having any joy or jsut failing to adapt what I'ev found to work. I have applciation report that doesn't allow for manipulation at creation so I want to do some post modifcation... (2 Replies)
Discussion started by: nhatch
2 Replies

9. Shell Programming and Scripting

Merge 2 lines in file

Hi All, I have a data in flat file like below. Some of the information are in second row. 111_ABCProcess ----- ----- IN 0/0 111_PQRTrimPRocess ----- ----- OI 0/0 111_ZigZagTrimProcess ----- ----- ... (1 Reply)
Discussion started by: Amit.Sagpariya
1 Replies

10. Shell Programming and Scripting

Merge two lines

Hi I have two lines of data formatted as displayed below shop, price, remark, date a,#N/A,order to -fd, 20091011 and would like it to be shop:a price:#N/A remark:order to -fd date:20091011 How can I do it? Many thanks (2 Replies)
Discussion started by: lalelle
2 Replies
Login or Register to Ask a Question