Visit Our UNIX and Linux User Community

How to Remove Special Characters

Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers How to Remove Special Characters
# 1  
Old 09-01-2009
How to Remove Special Characters

Dear Members,

We have a file which contains some special characters. I need to replace these special character by a new line character(\n).

The Special character is \x85.

I am not sure what this character means and how we can remove it.

Any inputs are greatly appreciated.

# 2  
Old 09-01-2009
(Post withdrawn)

Last edited by methyl; 09-01-2009 at 06:43 PM.. Reason: Post contained errors
# 3  
Old 09-01-2009
Thanks for your reply.

I tried using your commands but it replaces the special character with a $ sign instead of new line character.

After this i again tried to replace $ with a newline character, then it replaces $ with some special symbol again.

Not sure what i am doing wrong.
# 4  
Old 09-01-2009

Try this - it should work this time.

X85=`echo "\0205\c"`
cat filename | tr "${X85}" "\n"

X85 = octal 205
# 5  
Old 09-01-2009
Thanks Methyl,

Its adding new line characters now.

I am very new to UNIX, so what exactly are you doing here.

I guess you are converting from hexadecimal to octal and searching for that octal character.

Correct me if i am wrong.

# 6  
Old 09-01-2009
I have a confession. I used the M$ Windows "calc" program to convert from hex to octal. We could of course have used unix "bc".

I've called the environment variable "X85" . It's just a name.

The special syntax to "echo" just allows you to generate any character from its octal representation. The "\c" at the end of the string stops "echo" adding a newline.

The translate program "tr" used in this way translates all occurances of one character to another character. Program "tr" and many others use "\n" to represent a newline.

Previous Thread | Next Thread
Test Your Knowledge in Computers #756
Difficulty: Medium
The difference between EPROM and EEPROM is based on the way that the memory programs and erases.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove special characters?

Hi Gurus, I have file which contains some unicode charachator like "". I want to replace it with some charactors. I searched in internet and got command sed "s//-/g", but I don't know how to type in unix command line. Please help me for this one. Thanks in advance (7 Replies)
Discussion started by: ken6503
7 Replies

2. Shell Programming and Scripting

How to remove some special characters in a string?

Hi, I have string like this ="Lookup Procedure" But i want the output like this Lookup Procedure =," should be removed. Please suggest me the solution. Regards, Madhuri (2 Replies)
Discussion started by: srimadhuri
2 Replies

3. Shell Programming and Scripting

Sed - remove special characters

Hi, I have a file with this line, it's always in the first line: I want to remove these special characters: ╗┐ file1 ╗┐\\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35 Bytes;2 ;1 I want the same file to be only \\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35... (4 Replies)
Discussion started by: nakaedu
4 Replies

4. Shell Programming and Scripting

Remove the special characters from field

Hi, In source data few of columns are having special charates(like *) due to this i am not able to display the data into flat's displaying the some of junk data into the flat file. source dataExample: Address1="XDERFTG * HYJUYTG" how to remove the special charates in a string (2 Replies)
Discussion started by: koti_rama
2 Replies

5. Shell Programming and Scripting

Remove string between two special characters

Hi All, I have a variable like AVAIL="\|\|\|\ " What I want to do here is that If a find # before any entry, remove the entire string... (5 Replies)
Discussion started by: engineermayur
5 Replies

6. Shell Programming and Scripting

remove special characters

hello all I am writing a perl code and i wish to remove the special characters for text. I wish to remove all extended ascii characters. If the list of special characters is huge, how can i do this using substitute command s/specialcharacters/null/g I really want to code like... (3 Replies)
Discussion started by: vasuarjula
3 Replies

7. UNIX for Dummies Questions & Answers

Files with special characters - how to remove

Hi, I have a directory that has a file which contained special characters in the filename. Can someone please advise how to remove the file, preferably with a rm -i ? Thanks in advance. Listing is as below: {oracle}> ls -1b bplog.bkup.001 bplog.bkup.002 bplog.bkup.003 bplog.bkup.004... (1 Reply)
Discussion started by: newbie_01
1 Replies

8. Shell Programming and Scripting

How to remove special characters from each line?

Hello, Is there a simpler way to remove special characters (color codes) from each lines in a log file? I use sed like in the example below but I think there should be a more simple way to achieve the same result: $ cat -vet file1 ^, , , , Maybe to convert the file somehow? ... (5 Replies)
Discussion started by: majormark
5 Replies

9. Shell Programming and Scripting

Remove special characters from string

Hi there, I'd like to write a script that removes any set of character from any string. The first argument would be the string, the second argument would be the characters to remove. For example: $ myscript "My name's Santiago. What's yours?" "atu" My nme's Snigo. Wh's yors? I wrote the... (11 Replies)
Discussion started by: chebarbudo
11 Replies

10. UNIX for Dummies Questions & Answers

remove special and unicode characters

Hi, How do I remove the lines where special characters or Unicode characters appear? The following query does work but I wonder if there is a better way. cat test.txt | egrep -v '\)|#|,|&|-|\(|\\|\/|\.' The following lines show that my query is incomplete. Warning: The word "*Khan" is... (1 Reply)
Discussion started by: shantanuo
1 Replies

Featured Tech Videos