Replace Control M (^M) character with new line


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Replace Control M (^M) character with new line
# 1  
Old 05-19-2014
Replace Control M (^M) character with new line

Hi All,
We are getting an external file in abc.csv format. When opened in excel spread sheet, it is opening alright. But when opened in notepad, I see the contents in a single line.
Ftp'd the file in binary mode to AIX UNIX host. When opened, I see Control M (^M) characters in place of New Line characters.

I did the following:
$ wc -l abc.txt
0 abc.txt
$ sed 's/^M//g' abc.txt > xyz.txt
$ sed 's/^M$//' abc.txt > xyz.txt

I'm unable to replace the ^M character with new line. Can you kindly help me with the solution?

Thanks in advance.
# 2  
Old 05-19-2014
Code:
dos2unix abc.txt abc.txt

will remove control ^M characters
# 3  
Old 05-19-2014
Makarand, we don't have this utility. Any other way to replace he ^M characters in shell script?
# 4  
Old 05-19-2014
if you have "Editplus" then save as the file and try choose file format as "Unix"
if you have "or "Notepad++" then save as the file as "unix script file"
OR
open the file in wordpad and instead of FTP it ; try to copy the file contents and then vi filename & paste in Unix
# 5  
Old 05-19-2014
Sorry Makarand but I need to do this as part of the shell script.

I also tried the below.

sed 's/'"$(printf '\015')"'//g' abc.txt > xyz.txt

It removed the ^M character but it is not replaced with newline character.

Please note that the original file is showing all data in single line with new line being displayed as ^M. When I do "wc -l abc.txt", it displays 0 rows indicating it is not recognising any new line characters.

My goal is to introduce these newline characters so that I can process the data row by row

Thanks!!

Last edited by njny; 05-19-2014 at 01:46 PM..
# 6  
Old 05-19-2014
What is the output of this command:
Code:
file abc.txt

# 7  
Old 05-19-2014
abc.txt: ascii text
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replace x-y character in line

I have a file which has n number of lines, i want to replace 3rd line position 3-5 to some text. 111111111111111111 222222222222222222 333333333333333333 444444444444444444 expected output 111111111111111111 222222222222222222 33abc3333333333333 444444444444444444 it is... (7 Replies)
Discussion started by: greenworld123
7 Replies

2. Solaris

Line too long error Replace string with new line line character

I get a file which has all its content in a single row. The file contains xml data containing 3000 records, but all in a single row, making it difficult for Unix to Process the file. I decided to insert a new line character at all occurrences of a particular string in this file (say replacing... (4 Replies)
Discussion started by: ducati
4 Replies

3. Shell Programming and Scripting

Replace last character of every second line

Hi all. I wonder if this possible.... any help advice is very much appreciated.. I n a shell script I create a latex file that looks like this \documentclass{article} \usepackage{graphics} \begin{document} \begin{figure} \begin{center} \begin{tabular}{cc} ... (10 Replies)
Discussion started by: malandisa
10 Replies

4. Shell Programming and Scripting

Replace any control character in the string

Need to replace any control character in the string in perl ---------- Post updated at 04:22 PM ---------- Previous update was at 03:50 PM ---------- Any help !!! Thanks in advance (2 Replies)
Discussion started by: hansini
2 Replies

5. UNIX for Dummies Questions & Answers

vi Search for text, Replace with <CR> or control character.

Greetings, Using vi, how can I change the following text: -I/myviews/nexus_7400rel/vobs/nexus/platforms/97400/include -I/myviews/nexus_7400rel/vobs/nexus/modules/i2c/7400/include -I/myviews/nexus_7400rel/vobs/nexus/modules/surface/7400/include Into this:... (4 Replies)
Discussion started by: omega949
4 Replies

6. Shell Programming and Scripting

how to replace character in the line

I have unix text file which has the following data aadjdfad;fa;fjjd;lakd;lkaslkd;k;k;lk;k;lk;l;lk;lkj;lj;lkj;k;lkj;lj;lkj;lkj;lkj;j sdkadk;adlf;lajf;akdjf;lkdjf;lkadjf;lkajsd;lfkj;lkj;lkj;lk;lk;lk;lk;k;lkj;k;lkm... (2 Replies)
Discussion started by: Raju Datla
2 Replies

7. Shell Programming and Scripting

replace > with new line character

<reward_data><date><datetime>071308000804</datetime></date> I want the above data to be displayed as <reward_data> <date> <datetime>071308000804</datetime> </date> How can i accomplish this. I tried the below tr "><" ">\n" < filename (4 Replies)
Discussion started by: borncrazy
4 Replies

8. Shell Programming and Scripting

Replace certain character with a new a new line.

Hello all... please help with the following. I am parsing the following type of file... W001; W003; W025;W044; W030; W022;W024;W099;W098; Would like to make it look like this... W001 W003 W025 W044 W030 W022 W024 W099 W098 (8 Replies)
Discussion started by: djsal
8 Replies

9. Shell Programming and Scripting

to replace a new line character

sample I/p: S12J LLL H77K PPP J25O LOP I73S lOP K99O PLO Required O/p: S12J LLL H77K PPP J25O LOP I73S lOP K99O PLO how to replace a new line character with space using sed command only Cheers, Chan (2 Replies)
Discussion started by: chan
2 Replies

10. Shell Programming and Scripting

Replace a character in last line

Hello Sed Experts, I have got a file which contain entries as below pmNoOfSwDownHsCong, pmUlUpswitchAttemptHigh, pmUlUpswitchAttemptLow, pmUlUpswitchSuccessHigh, pmUlUpswitchSuccessLow, pmUpswitchFachHsAttempt, ... (6 Replies)
Discussion started by: Mohammed
6 Replies
Login or Register to Ask a Question