Removing special characters


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing special characters
# 8  
Old 04-29-2010
Quote:
Originally Posted by anushree.a
However its not working may be because these special characters also contain *
so Its not removing instances like follows

e.g.
DM**&^*$#)(*CT

Please suggest.
It works fine too when "*" are embedded:

Code:
$ echo "DM**&^*$#)(*CT" | sed 's/DM.*CT/DMCT/'                                   
DMCT

Please clarify.
# 9  
Old 04-29-2010
Hey friends,
great it worked.
But only one problem is yet to be solved.
I have used following two suggestions given by you

Code:
/usr/bin/tr -d '[:punct:]' < file > file.nospecialchar

and

Code:
/usr/bin/tr -d '[:punct:]' <test>

Its very well working but its replacing special characters by space. I want to remove that space without disturbing other spaces present in file. But special attention is to be given that, it shouldnt even touch other spaces in entire file as it will disturb entire machine readable file. it just have to remove space got generated between DM and CT



e.g.
Code:
DM*&%#^()*%*$|\ / ?CT

expected output
Code:
DMCT

where as existing solution is giving o/p as
DM CT (space is not expected).

Thank you for taking pains.

Last edited by Scott; 04-29-2010 at 06:28 AM.. Reason: Code tags, please...
# 10  
Old 04-29-2010
@anushree.a: can you please clarify why the sed solution I suggested doesn't work for you ?
# 11  
Old 04-29-2010
Dear Jlliagre,
I think it did not work because neighter pattern of special character is fixed nor number of special character is fixed. What is fixed is only characters DM and CT. everything appearing between them we have to remove it including spaces
in one case it can be DM^%%^$*^()*&\|/ *^CT
in other case it can be anything like DM^%#%$|?\?\%CT

I think your script can work only if provided special character pattern is fixed.


Please suggest.
# 12  
Old 04-29-2010
Did you care trying my script ?
It certainly removes spaces and whatever characters appears between DM and CT, including spaces.
# 13  
Old 04-29-2010
Have you tried the solution which I have posted ?
# 14  
Old 04-29-2010
Dear Jlliagre,
I am extremely sorry. Your solution wasn't wrking because I didnt make necessary changes in input file while testing.
I regrett. I apologize.

Now I have tested it and results are exactly as expected.

Sorry to trouble you and others.
Thank you very very much for the help.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing special ^M charecters

Hi, This code works for me for file in $(find /path/to/dir -type f); do tr -d '\r' <$file >temp.$$ && mv temp.$$ $file done However, i want this code to skip all .class files. Can you help me with the modified code. (2 Replies)
Discussion started by: mohtashims
2 Replies

2. Shell Programming and Scripting

Removing blank/white spaces and special characters

Hello All , 1. I am trying to do a task where I need to remove Blank spaces from my file , I am usingawk '{$1=$1}{print}' file>file1Input :- ;05/12/1990 ;31/03/2014 ; Output:- ;05/12/1990 ;31/03/2014 ;This command is not removing all spaces from... (6 Replies)
Discussion started by: himanshu sood
6 Replies

3. Linux

File conversion and removing special characters from a file in Linux

I have a .CSV file when I check for the special characters in the file using the command cat -vet filename.csv, i get very lengthy lines with "^@", "^I^@" and "^@^M" characters in between each alphabet in all of the records. Using the code below file filename.csv I get the output as I have a... (2 Replies)
Discussion started by: dhruuv369
2 Replies

4. Shell Programming and Scripting

Removing special characters - Control M

I have developed a small script to remove the Control M characters that get embedded when we move any file from Windows to Unix. For some reason, its not working in all scenarios. Some times I still see the ^M not being removed. Is there anything missing in the script: cd ${inputDir}... (7 Replies)
Discussion started by: vskr72
7 Replies

5. Shell Programming and Scripting

Replace special characters with Escape characters?

i need to replace the any special characters with escape characters like below. test!=123-> test\!\=123 !@#$%^&*()-= to be replaced by \!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
Discussion started by: laknar
8 Replies

6. UNIX for Dummies Questions & Answers

awk for removing special characters and extra commas

Hi, I have a .csv file which as empty lines with comma and some special characters in 3rd column as below. Source data 1,2,3,4,%#,6 ,,,,,, 1,2,3,4,5,6 Target Data 1,2,3,4,5,6I need to remove blank lines and special charcters I am trying to get this using the below awk awk -F","... (2 Replies)
Discussion started by: shruthidwh
2 Replies

7. Solaris

removing special characters, white spaces from a field in a file

what my code is doing, it is executing a sql file and the resullset of the query is getting stored in the text file in a fixed format. for that fixed format i have used the following code:: Code: awk -F":"... (2 Replies)
Discussion started by: priyanka3006
2 Replies

8. AIX

Removing a filename which has special characters passed from a pipe with xargs

Hi, On AIX 5200-07-00 I have a find command as following to delete files from a certain location that are more than 7 days old. I am being told that I cannot use -exec option to delete files from these directories. Having said that I am more curious to know how this can be done. an sample... (3 Replies)
Discussion started by: jerardfjay
3 Replies

9. Shell Programming and Scripting

removing special characters @ EOL

How to remove special chracters @ END OF EACH LINE in a file file1.txt: 0003073413^M 0003073351^M 0003073379^M 0003282724^M 0003323334^M 0003217159^M 0003102760^M 0002228911^M I used the below command but it is not working ? perl -pi -e 's/^M\/g' file1.txt (6 Replies)
Discussion started by: ali560045
6 Replies

10. Shell Programming and Scripting

Removing special characters in file

I have file special.txt with the following data. <header info> 123$ty5%98&0asd 1@356fgbv78 09*&^5jkns43( ...........some more rows. In my output file, I want to eliminate all the special characters in my file and I want all other data. need some help. (6 Replies)
Discussion started by: srivsn
6 Replies
Login or Register to Ask a Question