Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

How do I remove ^M characters with VI

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers How do I remove ^M characters with VI
# 1  
Old 06-14-2011
How do I remove ^M characters with VI
I have a file with all kinds of ^M at the end of each line. How the heck can these be removed? I tried a global search and replace, but it doesn't seem to work.

Thanks!
# 2  
Old 06-14-2011
You can use a ^V in your global search and replace.

%s/^V^M//g

When you type the control-V it will actually disappear. Your command will look like this:

%s/^M//g



How to Remove Tabs in vi editor
# 3  
Old 06-15-2011
try dos2unix command
# 4  
Old 06-15-2011
Use the dos2unix command like itkamaraj suggested. The file is not in UNIX form thats why the global change didnt work. If you cat the file you wont see the ^M, only if you vi it.
# 5  
Old 06-15-2011
Quote:
Originally Posted by rookieuxixsa
Use the dos2unix command like itkamaraj suggested. The file is not in UNIX form thats why the global change didnt work. If you cat the file you wont see the ^M, only if you vi it.
cat -vet myFile will display nonpriting cahracters:
'man cat' yields:
Code:
       -v
            Displays nonprinting characters as visible characters, with the
            exception of tabs, new-lines, and form-feeds. ASCII control
            characters (octal 000-037) are printed as ^n, where n is the
            corresponding ASCII character in the octal range 100-137 (@, A, B,
            C,..., X, Y, Z, [, \, ], ^, and _); the DEL character (octal 0177)
            is printed as ^?. Other non-printable characters are printed as
            M-x, where x is the ASCII character specified by the low-order
            seven bits.

# 6  
Old 06-15-2011
Quote:
The file is not in UNIX form thats why the global change didnt work. If you cat the file you wont see the ^M, only if you vi it.
Sorry but you are incorrect. Using :%s/^V^M//g works. I have done this for years. Also you can use cat -v to show non printing bytes such as ^M.
# 7  
Old 06-15-2011
Also look at the root cause. How did a MSDOS format file get to the unix system?
Commonly this is because someone used ftp in binary mode (not text mode).
It can also happen with shared filesystems when using enviroments like Samba or Cygwin.

I prefer to convert using "tr" because dos2ux strips high order bits.

Code:
cat filename.dos | tr -d '\r' > filename.unix

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove first 2 characters and last two characters of each line

here's what im trying to do. i have a file containing lines similar to this: data.txt: 1hsRmRsbHRiSFZNTTA1dlEyMWFkbU5wUW5CSlIyeDFTVU5SYjJOSFRuWmpia0ZuWXpKV2FHTnRU 1lKUnpWMldrZFZaMG95V25oYQpSelEyWTBka2QyRklhSHBrUjA1b1kwUkJkd3BOVXpWM1lVaG5k... (5 Replies)
Discussion started by: SkySmart
5 Replies

2. Shell Programming and Scripting

Remove the last 9 characters of a filename

Hi All! Please can someone help, I have a dir with the following files: ~-rw-r--r-- 1 emmuser users 2087361 Oct 16 15:50 MPGGSN02_20131007234519_24291.20131007 -rw-r--r-- 1 emmuser users 2086837 Oct 16 15:50 MPGGSN02_20131007233529_24272.20131007 -rw-r--r-- 1 emmuser ... (7 Replies)
Discussion started by: fretagi
7 Replies

3. Shell Programming and Scripting

Remove the Characters '[' and ']' with Sed

Hi, I am new to Sed and would like to know if it is possible to remove the characters . I have a couple of files with a keyword and would like to remove the substring. I am Using sed s/// but Its not working Thanks for your Support Andrew Borg (2 Replies)
Discussion started by: andrewborg
2 Replies

4. Shell Programming and Scripting

Remove characters from text

I have a file which looks like this. I only show first 11 lines of the file followed by some text that appears at the end of every file. 1. file:///path1/path2/path3/path4/251192.dat (score 3.849384, docid 142923) 2. file:///path1/path2/path3/path4/173859.dat (score 3.831033, docid 75365) 3.... (4 Replies)
Discussion started by: shoaibjameel123
4 Replies

5. Shell Programming and Scripting

Remove characters other than ISO8859-1

Hi please help in writing a script for replacing all the non-iso8859-1 characters to question marks. I need a pattern of this kind "sed s/<non-iso char range>/?/g < ipfile > opfile" Please help me in this. (2 Replies)
Discussion started by: rprajendran
2 Replies

6. Shell Programming and Scripting

remove last 4 characters from a string

I'm tring to remove the last 4 characters from strings in a file i.e. cat /tmp/test iwishicouldremovethis icouldremovethos so i would end up with the last 4 characters from each of the above i.e. this thos I thought of using cut -c ... but I'm not sure how many characters will... (7 Replies)
Discussion started by: josslate
7 Replies

7. UNIX for Dummies Questions & Answers

remove characters from line

Hello, I have multiple lines in a file, each of which will have data that looks like this: xxxxxyyyyzzzz4abcdXYZXYZXYZ pqrstPQRST2cdPQRSTPQRST lmnopqr6abcdefgRST.3abc I want to be able to remove the number 4 + the following 4 characters (abcd) in the first line. For the second line,... (1 Reply)
Discussion started by: Gussifinknottle
1 Replies

8. UNIX for Advanced & Expert Users

remove characters

hi i have a file with these strings: 123_abc_X1116990 how to get rid of 123_abc_ and keep only X1116990? I have columns of these: 123_abc_X1134640 123_dfg_X1100237 123_tyu_X1103112 123_tyui_X1116990 thx (5 Replies)
Discussion started by: melanie_pfefer
5 Replies

9. Shell Programming and Scripting

remove space characters

hello I have this output ifspeed 100000000 ifspeed 100000000 collisions 413 collisions 10 duplex full duplex ... (1 Reply)
Discussion started by: melanie_pfefer
1 Replies

10. UNIX for Dummies Questions & Answers

How to remove Characters before '~'

Hi, I am having a file which contains records as follows: DETAIL_KEY~12344|ACTIVE_PASSIVE~Y|AVG_SIZE_OF_RESPONSE~123123131 DETAIL_KEY~12344|ACTIVE_PASSIVE~Y|AVG_SIZE_OF_RESPONSE~123123131 DETAIL_KEY~12344|ACTIVE_PASSIVE~Y|AVG_SIZE_OF_RESPONSE~123123131... (4 Replies)
Discussion started by: Amey Joshi
4 Replies
Login or Register to Ask a Question