How to Remove Special Characters


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers How to Remove Special Characters
# 1  
Old 09-01-2009
How to Remove Special Characters

Dear Members,

We have a file which contains some special characters. I need to replace these special character by a new line character(\n).

The Special character is \x85.

I am not sure what this character means and how we can remove it.

Any inputs are greatly appreciated.

Thanks
Sandeep
# 2  
Old 09-01-2009
(Post withdrawn)

Last edited by methyl; 09-01-2009 at 06:43 PM.. Reason: Post contained errors
# 3  
Old 09-01-2009
Thanks for your reply.

I tried using your commands but it replaces the special character with a $ sign instead of new line character.

After this i again tried to replace $ with a newline character, then it replaces $ with some special symbol again.

Not sure what i am doing wrong.
# 4  
Old 09-01-2009
Oops.

Try this - it should work this time.

Code:
#!/bin/ksh
X85=`echo "\0205\c"`
cat filename | tr "${X85}" "\n"


X85 = octal 205
# 5  
Old 09-01-2009
Thanks Methyl,

Its adding new line characters now.

I am very new to UNIX, so what exactly are you doing here.

I guess you are converting from hexadecimal to octal and searching for that octal character.

Correct me if i am wrong.

Thanks
# 6  
Old 09-01-2009
I have a confession. I used the M$ Windows "calc" program to convert from hex to octal. We could of course have used unix "bc".

I've called the environment variable "X85" . It's just a name.

The special syntax to "echo" just allows you to generate any character from its octal representation. The "\c" at the end of the string stops "echo" adding a newline.

The translate program "tr" used in this way translates all occurances of one character to another character. Program "tr" and many others use "\n" to represent a newline.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove special characters?

Hi Gurus, I have file which contains some unicode charachator like "ü". I want to replace it with some charactors. I searched in internet and got command sed "s/ü/-/g", but I don't know how to type ü in unix command line. Please help me for this one. Thanks in advance (7 Replies)
Discussion started by: ken6503
7 Replies

2. Shell Programming and Scripting

How to remove some special characters in a string?

Hi, I have string like this ="Lookup Procedure" But i want the output like this Lookup Procedure =," should be removed. Please suggest me the solution. Regards, Madhuri (2 Replies)
Discussion started by: srimadhuri
2 Replies

3. Shell Programming and Scripting

Sed - remove special characters

Hi, I have a file with this line, it's always in the first line: I want to remove these special characters: ´╗┐ file1 ´╗┐\\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35 Bytes;2 ;1 I want the same file to be only \\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35... (4 Replies)
Discussion started by: nakaedu
4 Replies

4. Shell Programming and Scripting

Remove the special characters from field

Hi, In source data few of columns are having special charates(like *) due to this i am not able to display the data into flat file.it's displaying the some of junk data into the flat file. source dataExample: Address1="XDERFTG * HYJUYTG" how to remove the special charates in a string (2 Replies)
Discussion started by: koti_rama
2 Replies

5. Shell Programming and Scripting

Remove string between two special characters

Hi All, I have a variable like AVAIL="\ BACK:bkpstg:testdb3.iad.expertcity.com:backtest|\ #AUTH:authstg:testdb3.iad.expertcity.com:authiapd|\ TEST:authstg:testdb3.iad.expertcity.com:authiapd|\ " What I want to do here is that If a find # before any entry, remove the entire string... (5 Replies)
Discussion started by: engineermayur
5 Replies

6. Shell Programming and Scripting

remove special characters

hello all I am writing a perl code and i wish to remove the special characters for text. I wish to remove all extended ascii characters. If the list of special characters is huge, how can i do this using substitute command s/specialcharacters/null/g I really want to code like... (3 Replies)
Discussion started by: vasuarjula
3 Replies

7. UNIX for Dummies Questions & Answers

Files with special characters - how to remove

Hi, I have a directory that has a file which contained special characters in the filename. Can someone please advise how to remove the file, preferably with a rm -i ? Thanks in advance. Listing is as below: {oracle}> ls -1b bplog.bkup.001 bplog.bkup.002 bplog.bkup.003 bplog.bkup.004... (1 Reply)
Discussion started by: newbie_01
1 Replies

8. Shell Programming and Scripting

How to remove special characters from each line?

Hello, Is there a simpler way to remove special characters (color codes) from each lines in a log file? I use sed like in the example below but I think there should be a more simple way to achieve the same result: $ cat -vet file1 ^, , , , Maybe to convert the file somehow? ... (5 Replies)
Discussion started by: majormark
5 Replies

9. Shell Programming and Scripting

Remove special characters from string

Hi there, I'd like to write a script that removes any set of character from any string. The first argument would be the string, the second argument would be the characters to remove. For example: $ myscript "My name's Santiago. What's yours?" "atu" My nme's Snigo. Wh's yors? I wrote the... (11 Replies)
Discussion started by: chebarbudo
11 Replies

10. UNIX for Dummies Questions & Answers

remove special and unicode characters

Hi, How do I remove the lines where special characters or Unicode characters appear? The following query does work but I wonder if there is a better way. cat test.txt | egrep -v '\)|#|,|&|-|\(|\\|\/|\.' The following lines show that my query is incomplete. Warning: The word "*Khan" is... (1 Reply)
Discussion started by: shantanuo
1 Replies
Login or Register to Ask a Question