Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Removing ^M characters from a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing ^M characters from a file
# 8  
Old 11-17-2009
dos2inix removes windows newline characters. but still 1 character per run. even then the second line is not merged with the first.

tr -d '\r\n' < infile.csv > outfile.csv removes all terminations so it becomes a single line. (there are many records in the file and only some are having this issue)
# 9  
Old 11-17-2009
Quote:
Originally Posted by mwrg
tr -d '\r\n' < infile.csv > outfile.csv removes all terminations so it becomes a single line. (there are many records in the file and only some are having this issue)
It should be helpful if you provide a better axample of your input file and the desired output.
My solution works with your example:

Code:
ssue i have:
ABC^M^M
DEF

solution i need:
ABCDEF

# 10  
Old 11-17-2009
Quote:
Originally Posted by mwrg
... removes all terminations so it becomes a single line. (there are many records in the file and only some are having this issue)
Given a file like this:

Code:
$
$ cat -v f8
ABC^M^M^M
DEF
GHI^M
JKL
MNO^M^M
PQR
STU^M^M^M^M^M^M^M
VWX^M^M^M^M
YZ
$

I shall assume that you want to remove to:
(a) remove "^M"s
(b) join the lines
(c) and retain Unix end-of-line characters

So, if you expect the final output to look like this:

Code:
ABCDEF
GHIJKL
MNOPQR
STUVWXYZ

then, you can use Perl thusly:

Code:
$
$ perl -pi -e 's/\r+\n//g' f8
$
$ cat -v f8
ABCDEF
GHIJKL
MNOPQR
STUVWXYZ
$
$

tyler_durden
This User Gave Thanks to durden_tyler For This Post:
karthik_ak
# 11  
Old 11-17-2009
You are correct durde. thats how my file looks. in your code how can i specify the input file and output file?

---------- Post updated at 09:50 AM ---------- Previous update was at 09:31 AM ----------
Quote:
Originally Posted by durden_tyler
Given a file like this:

Code:
$
$ cat -v f8
ABC^M^M^M
DEF
GHI^M
JKL
MNO^M^M
PQR
STU^M^M^M^M^M^M^M
VWX^M^M^M^M
YZ
$

I shall assume that you want to remove to:
(a) remove "^M"s
(b) join the lines
(c) and retain Unix end-of-line characters

So, if you expect the final output to look like this:

Code:
ABCDEF
GHIJKL
MNOPQR
STUVWXYZ

then, you can use Perl thusly:

Code:
$
$ perl -pi -e 's/\r+\n//g' f8
$
$ cat -v f8
ABCDEF
GHIJKL
MNOPQR
STUVWXYZ
$
$

tyler_durden

Thanks alot durden. It worked SmilieSmilieSmilieSmilieSmilieSmilie
This User Gave Thanks to mwrg For This Post:
karthik_ak
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing last and first characters in a file

bash-3.00$ cat temp.txt ./a/REA01/ces1/apps/ces_ces1_init3_aa.ear/ces.war/WEB-INF/classes/reds/common/environment.properties ./a/REA01/ces1/apps/ces_ces1_init3_aa.ear/commonproperties/hi/HostIntegration.properties... (9 Replies)
Discussion started by: bhas85
9 Replies

2. Shell Programming and Scripting

Removing these non-ASCII characters from a file

Hi, I have many text files which contain some non-ASCII characters. I attach the screenshots of one of the files for people to have a look at. The issue is even after issuing the non-ASCII removal commands one of the characters does not go away. The character that goes away is the black one with a... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies

3. Shell Programming and Scripting

removing file with bad characters

I have the following files in the same directory but if you look at the od output you can see one of the files has and "\n" as part of the file name. Is there a way I can only remove the file with the "\n" as part of the file name without affecting the other file. I was thinking about... (4 Replies)
Discussion started by: BeefStu
4 Replies

4. Shell Programming and Scripting

Removing Non-printable characters in unix file

Hi, We have a non printable character "®" in our file , we want to remove this character, we tried tr -dc '' < oldfile> newfile but this command is removing all new line entries along with the non printable character and all the records are coming in one line(it is changing the format of the... (2 Replies)
Discussion started by: pyaranoid
2 Replies

5. Linux

Removing non printing characters from a csv file

Hi, I have an csv file and there are some non printable characters(extended ascii) so I am trying to create a clean copy of the csv file . I am using this command: tr -cd "" < /opt/informatica/PowerCenter8.6.0/server/infa_shared/SrcFiles/ThirdParty/locations.csv > ... (4 Replies)
Discussion started by: gerkus
4 Replies

6. Shell Programming and Scripting

removing unwanted characters from a file

i have a file like this 1111_2222#$#$dudgfdk 11111111_343434#$#$334 1111_22222#43445667 i want to remove all those charachetrs from # how can i do this Thank in advance Saravanan (4 Replies)
Discussion started by: saravanan71184
4 Replies

7. Shell Programming and Scripting

Removing certain characters in a file

Hi I have a file that has semicolons in it (;) is there a way to just remove these in the file. Example name: Joe Smith; group: Group1; name: Mary White; group: Group2; (2 Replies)
Discussion started by: bombcan
2 Replies

8. Shell Programming and Scripting

Removing special characters in file

I have file special.txt with the following data. <header info> 123$ty5%98&0asd 1@356fgbv78 09*&^5jkns43( ...........some more rows. In my output file, I want to eliminate all the special characters in my file and I want all other data. need some help. (6 Replies)
Discussion started by: srivsn
6 Replies

9. Programming

Identifying and removing control characters in a file.

What is the best method to identify an remove control characters in a file. Would it be easier to do this in Unix or in C. (0 Replies)
Discussion started by: oracle8
0 Replies

10. UNIX for Dummies Questions & Answers

Removing carriage return characters from file

Hello there, I need to remove carriage return characters (\n and \r) from any input file specified. This is what I am doing right now: - dumping the file to octal format using the command 'od -c file_name - removing and \s and \n characters using sed commands What I need to do now is... (3 Replies)
Discussion started by: b1saini
3 Replies
Login or Register to Ask a Question