Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Removing ^M characters from a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing ^M characters from a file
# 1  
Old 11-17-2009
Removing ^M characters from a file
Hi,

I want to removing ^M characters from a file and combine the line with the next line.

ex:

issue i have:
ABC^M^M
DEF

solution i need:
ABCDEF

I found that you by using the following command you can remove new line characters.

tr -d '\r' < infile.csv > outfile.csv

still it wont combine the two lines.

please help
# 2  
Old 11-17-2009
Code:
perl -i -ne 's/^M//g; print;' filename

^M can be typed as Ctrl-V and Ctrl-M
# 3  
Old 11-17-2009
Code:
dos2unix < inputfile | gawk -v ORS=" " '1' > output_file

SmilieSmilieSmilieSmilie
# 4  
Old 11-17-2009
tried dos2unix < inputfile | gawk -v ORS=" " '1' > output_file
but the output im getting is

ABC^M DEF

---------- Post updated at 05:44 AM ---------- Previous update was at 05:43 AM ----------

Please note that there can be one or more new line characters

---------- Post updated at 06:15 AM ---------- Previous update was at 05:44 AM ----------

And its also removing all unix terminations also. not acceptable

---------- Post updated at 06:51 AM ---------- Previous update was at 06:15 AM ----------

Wish scottn was around Smilie
# 5  
Old 11-17-2009
Quote:
Originally Posted by mwrg
tried dos2unix < inputfile | gawk -v ORS=" " '1' > output_file
but the output im getting is

ABC^M DEF

---------- Post updated at 05:44 AM ---------- Previous update was at 05:43 AM ----------

Please note that there can be one or more new line characters

---------- Post updated at 06:15 AM ---------- Previous update was at 05:44 AM ----------

And its also removing all unix terminations also. not acceptable

---------- Post updated at 06:51 AM ---------- Previous update was at 06:15 AM ----------

Wish scottn was around Smilie
what is the output dos2unix < input_file ??
# 6  
Old 11-17-2009
Code:
dos2unix file file

# 7  
Old 11-17-2009
Quote:
Originally Posted by mwrg
issue i have:
ABC^M^M
DEF

solution i need:
ABCDEF
Try this:

Code:
tr -d '\r\n' < infile.csv > outfile.csv
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing last and first characters in a file

bash-3.00$ cat temp.txt ./a/REA01/ces1/apps/ces_ces1_init3_aa.ear/ces.war/WEB-INF/classes/reds/common/environment.properties ./a/REA01/ces1/apps/ces_ces1_init3_aa.ear/commonproperties/hi/HostIntegration.properties... (9 Replies)
Discussion started by: bhas85
9 Replies

2. Shell Programming and Scripting

Removing these non-ASCII characters from a file

Hi, I have many text files which contain some non-ASCII characters. I attach the screenshots of one of the files for people to have a look at. The issue is even after issuing the non-ASCII removal commands one of the characters does not go away. The character that goes away is the black one with a... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies

3. Shell Programming and Scripting

removing file with bad characters

I have the following files in the same directory but if you look at the od output you can see one of the files has and "\n" as part of the file name. Is there a way I can only remove the file with the "\n" as part of the file name without affecting the other file. I was thinking about... (4 Replies)
Discussion started by: BeefStu
4 Replies

4. Shell Programming and Scripting

Removing Non-printable characters in unix file

Hi, We have a non printable character "®" in our file , we want to remove this character, we tried tr -dc '' < oldfile> newfile but this command is removing all new line entries along with the non printable character and all the records are coming in one line(it is changing the format of the... (2 Replies)
Discussion started by: pyaranoid
2 Replies

5. Linux

Removing non printing characters from a csv file

Hi, I have an csv file and there are some non printable characters(extended ascii) so I am trying to create a clean copy of the csv file . I am using this command: tr -cd "" < /opt/informatica/PowerCenter8.6.0/server/infa_shared/SrcFiles/ThirdParty/locations.csv > ... (4 Replies)
Discussion started by: gerkus
4 Replies

6. Shell Programming and Scripting

removing unwanted characters from a file

i have a file like this 1111_2222#$#$dudgfdk 11111111_343434#$#$334 1111_22222#43445667 i want to remove all those charachetrs from # how can i do this Thank in advance Saravanan (4 Replies)
Discussion started by: saravanan71184
4 Replies

7. Shell Programming and Scripting

Removing certain characters in a file

Hi I have a file that has semicolons in it (;) is there a way to just remove these in the file. Example name: Joe Smith; group: Group1; name: Mary White; group: Group2; (2 Replies)
Discussion started by: bombcan
2 Replies

8. Shell Programming and Scripting

Removing special characters in file

I have file special.txt with the following data. <header info> 123$ty5%98&0asd 1@356fgbv78 09*&^5jkns43( ...........some more rows. In my output file, I want to eliminate all the special characters in my file and I want all other data. need some help. (6 Replies)
Discussion started by: srivsn
6 Replies

9. Programming

Identifying and removing control characters in a file.

What is the best method to identify an remove control characters in a file. Would it be easier to do this in Unix or in C. (0 Replies)
Discussion started by: oracle8
0 Replies

10. UNIX for Dummies Questions & Answers

Removing carriage return characters from file

Hello there, I need to remove carriage return characters (\n and \r) from any input file specified. This is what I am doing right now: - dumping the file to octal format using the command 'od -c file_name - removing and \s and \n characters using sed commands What I need to do now is... (3 Replies)
Discussion started by: b1saini
3 Replies
Login or Register to Ask a Question