Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Which one is faster to remove control m characters?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Which one is faster to remove control m characters?
# 1  
Old 08-15-2006
Which one is faster to remove control m characters?
I have a file with millions of records...Before I experiment, I would like to know which one is faster.

Both the commands work absolutely fine on a smaller set of records.

Please advice.

Code:
sed 's/^M//g' ${INPUT_FILE} > tmp.txt

mv  tmp.txt  ${INPUT_FILE}

Code:
tr -d "\15"  < ${INPUT_FILE} >  tmp.txt;

mv  tmp.txt  ${INPUT_FILE}

This somehow didn't work...

Code:
tr -s '[:cntrl:]' ' ' < ${INPUT_FILE}> tmp.txt

Thank you in advance.
# 2  
Old 08-15-2006
Try
perl -p -i -e 's/^M//g' ${INPUT_FILE}

This will do an inline edit of the file, if you wish to do every file in the directory
perl -p -i -e 's/^M//g' *

Regards
Craig Murray
# 3  
Old 08-15-2006
What OS? Most unix systems have some sort of program to do this job. Solaris has dos2unix, HP-UX has dos2ux, most of the other systems should have dos2unix too. Use these.
# 4  
Old 08-16-2006
if its DOS file!!
if its DOS file!! copied to unix system then use........

dos2unix filename

if viceversa...........

use unix2dos filename
# 5  
Old 08-16-2006
This is on SunSolaris box. I somehow could not use dos2unix -- I get the following message

PHP Code:
1K$ dos2unix
could not open /dev/kbd to get keyboard type US keyboard assumed
could not get keyboard type US keyboard assumed 
cpmurray suggested to use perl. I will try that option too.
# 6  
Old 08-16-2006
'man dos2unix'
Code:
NAME
     dos2unix - convert text file from DOS format to ISO format

SYNOPSIS
     dos2unix [-ascii] [-iso] [-7] [-437 | -850 | -860 |  -863  |
     -865]  originalfile convertedfile

# 7  
Old 08-16-2006
That is what I did vgersh..

PHP Code:
1K$ /usr/bin/dos2unix tmp.txt > tmp1.txt
could not open /dev/kbd to get keyboard type US keyboard assumed
could not get keyboard type US keyboard assumed 
I am not sure what this keyboard type thing is....

Is there any other faster way to strip off ^M characters? Right now, I am using sed and tr...

Please advice..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Control Characters

Hallo Team, I am trying to get rid of the dollar sign. I managed to remove all the other special characters but i am struggling with this one. -bash-3.2$ cat -e missing_revenue_20141112.csv|less|head BW0522168531211141180935668@196.23.110.141$ BW092218784121114-370120610@196.23.110.141$... (4 Replies)
Discussion started by: kekanap
4 Replies

2. UNIX for Dummies Questions & Answers

Control characters in UNIX

Hi, My files are showing some control characters in vi editor ^M ^@ and somtimes ^H I removed ^M with %s/^M//g command but how to represent ^@ and ^H e.g. for ^M it is hold ctrl then v and m.. Please help.. I am very new to unix.. (7 Replies)
Discussion started by: prabhat.diwaker
7 Replies

3. Shell Programming and Scripting

Request for advise on how to remove control characters in a UNIX file extracted from top command

Hi, Please excuse for posting new thread on control characters, I am facing some difficulties in removing the control character from a file extracted from top command, i am able to see control characters using more command and in vi mode, through cat control characters are not visible ... (8 Replies)
Discussion started by: karthikram
8 Replies

4. Shell Programming and Scripting

Faster command to remove headers for files in a directory

Good evening Im new at unix shell scripting and im planning to script a shell that removes headers for about 120 files in a directory and each file contains about 200000 lines in average. i know i will loop files to process each one and ive found in this great forum different solutions... (5 Replies)
Discussion started by: alexcol
5 Replies

5. Shell Programming and Scripting

sed replacing specific characters and control characters by escaping

sed -e "s// /g" old.txt > new.txt While I do know some control characters need to be escaped, can normal characters also be escaped and still work the same way? Basically I do not know all control characters that have a special meaning, for example, ?, ., % have a meaning and have to be escaped... (11 Replies)
Discussion started by: ijustneeda
11 Replies

6. Shell Programming and Scripting

Control Characters

Can somebody please help me with the query. ? I want a part of program of which should look for control characters in the flat file , when it finds it, displaying message that Control Characters found..! Please help me (13 Replies)
Discussion started by: iamnoone
13 Replies

7. Shell Programming and Scripting

Urgent : Control Characters

Can somebody please help me with the query. ? I want a part of program of which should look for control characters in the flat file , when it finds it, displaying message that Control Characters found..! Please help me (1 Reply)
Discussion started by: iamnoone
1 Replies

8. Shell Programming and Scripting

screen control characters

Hi, Can anyone help me with controlling the cursor position from a shell script. Things like moving left,right,up,down etc Anyone have any ideas? (2 Replies)
Discussion started by: ajcannon
2 Replies

9. UNIX for Dummies Questions & Answers

Remove control characters

Hi, When I do a man and save it into a file, I end up getting a lot of control characters. How can I remove them?? I tried this: /1,$ s/^H//g But I get an error saying "no previous regular expression". Can someone help me with this. Thanks, Aravind (5 Replies)
Discussion started by: aravind_mg
5 Replies

10. UNIX for Dummies Questions & Answers

printing control characters

using c-shell, does anyone know how to send control characters to the printer before the job? I need to set a printer to print in condensed mode HELP (1 Reply)
Discussion started by: mglinsk
1 Replies
Login or Register to Ask a Question