07-15-2016
Replacing string/special characters using a 'conversion' table
Hi,
Does anyone know if there is a script or program available out there that uses a conversion table to replace special characters from a file?
I am trying to remove some special characters from a file but there are several unprintable/control characters that some I need to remove but some I need to replace with 1/2/3 spaces instead.
For example, I want to replace CTRL-I with an underscore, tabs with 3 spaces, CTRL-M with UNIX's newline etc.
I thought it will be easier to have a conversion table that I can use to do this instead of using tr? I need to make the changes in some kind of sequence too, i.e. do the CTRL-I's first, then the tab, etc.
Anyway, here's hoping someone has done this before or know of any script/program that does it.
Any reply much appreciated. Thanks in advance.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
the problem is while replacing the old string with new one with the help of SED i am unable to replace the special characters with new strings. how can i do that?
i dont want the user to be given the trouble to write '\' before every special characters like * , . , \ , $ , &.
sed... (4 Replies)
Discussion started by: imppayel
4 Replies
2. Shell Programming and Scripting
Hi,
I have tonnes of .txt files that are written in French. I need to replace the French special characters, however, with English equivalents (e.g. é -> e and ç -> c).
I have tried this
---
#!/bin/bash
# Convert French characters to normal characters
# Treat each of the files
exec... (4 Replies)
Discussion started by: BlueberryPickle
4 Replies
3. UNIX for Dummies Questions & Answers
need some advice on the following situation.
I have a DB2 table which has a varchar Column. This varchar column can have special characters like ©, ®, ™ .
When I extract from this table to a sequential file for this varchar column I am only able to get © and ® .
To Get the ™... (1 Reply)
Discussion started by: cosec
1 Replies
4. Shell Programming and Scripting
Hello,
I have a file with many lines with below format:
\abc\\1234
jkl\\567
def\\345
\pqr\\567
\xyz\\234
Here, i need to do 2 things.
1. replace \\ with \
2. remove starting \
so output to be as below: (11 Replies)
Discussion started by: prvnrk
11 Replies
5. Programming
Hello. How can i put all of the special characters on my keyboard into a string in c++ ?
I tried this but it doesn't work.
string characters("~`!@#$%^&*()_-+=|\}]{
How can i accomplish this?
Thanks in advance. (1 Reply)
Discussion started by: cbreiny
1 Replies
6. Shell Programming and Scripting
Hi,
I am trying to replace a string in shell but it is not working correctly.
@xcom.file@
needs to be replaced with
tb137
Plz help.Thx.
Please use and tags when posting code, data or logs etc. to preserve formatting and enhance readability, thanks. (4 Replies)
Discussion started by: manish72
4 Replies
7. Shell Programming and Scripting
I am writing a ksh script. I need to replace a set of characters in an xml file.
FROM="ÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖØÙÛÚÜÝßàáâãäåçèéêëìíîïðñòóôõö¿¶ø®";
TO="AAAAAAACEEEEIIIIDNOOOOOOUUUUYSaaaaaaceeeeiiiionooooo N R"
I have used the code- sed 's/$FROM/$TO/g'<abc.xml
But its not working.
Can anyone tell me the code to do this? (3 Replies)
Discussion started by: saga20
3 Replies
8. Linux
I have a .CSV file when I check for the special characters in the file using the command cat -vet filename.csv, i get very lengthy lines with "^@", "^I^@" and "^@^M" characters in between each alphabet in all of the records. Using the code below file filename.csv I get the output as
I have a... (2 Replies)
Discussion started by: dhruuv369
2 Replies
9. UNIX for Dummies Questions & Answers
**Extremely sorry for the typos in heading
Old:CAST ('${DEFAULT_HIGH_DATE}' AS DATE FORMAT 'YYYY-MM-DD')
New :CAST(CAST('${G_DEFAULT_HIGH_DATE}' AS DATE FORMAT 'MM-DD-YYYY') as DATE FORMAT 'YYYY-MM-DD')
Need to change old format as new format
cat file1
CAST ('${DEFAULT_HIGH_DATE}' AS... (1 Reply)
Discussion started by: 100bees
1 Replies
10. UNIX for Beginners Questions & Answers
Hi,
Please find attached a file that has special characters on it. It is a copy and paste from a Micro$oft file.
I don't want to use strings as it remove all the 'indentations' / 'formatting' so I am replacing them with space instead.
I am using the sed command below
sed "s/$(printf... (1 Reply)
Discussion started by: newbie_01
1 Replies
UNTEX(1) General Commands Manual UNTEX(1)
NAME
untex - strip LaTeX comands from input
SYNOPSIS
untex [ options ] [ files ... ]
DESCRIPTION
Untex removes some LaTeX commands from the files listed in the arguments (or standard input) and prints the output to standard output.
OPTIONS
- read from standard input.
-o remove options to LaTeX commands, i. e. everything in brackets [] behind a command.
-i process "include{file}" and "input{file}" and "input file" commands.
-m (try to) remove all math code.
-u replace all "a (etc.) with ibm (CP850) characters.
-uiso replace all "a (etc.) with ISO characters.
-uascii
replace all "a (etc.) with ascii characters.
-g replace all "a (etc., from german.sty) with ibm (CP850) characters.
-giso replace all "a (etc., from german.sty) with ISO characters.
-gascii
replace all "a (etc., from german.sty) with ascii characters.
-e remove environment names.
-a remove arguments of commands (not recommended).
-g implies -u, -a implies -o.
SEE ALSO
latex, tex, detex
BUGS
The -g and -u options only work for german accented characters. Not fixed due to lack of time, any help is appreciated. The includeonly
command is ignored.
Using -u option in a UTF-8 terminal doesn't work. Using it alone in a Latin1 terminal doesn't work either, you must also add -uiso.
AUTHORS
Untex was written by Michael Staats (michael@hal6000.thp.Uni-Duisburg.DE). The -gascii and -uascii options were added by Denis Endisch
(denis@smoky.ikf.physik.uni-frankfurt.de). Thanks to Subhasish Mazumdar (mazumdar@ringer.cs.utsa.edu) for some hints for improvements and
bug reports.
4th Berkeley Distribution Version 1.2 1994 April 6 UNTEX(1)