04-14-2014
Remove Special Characters Within Text
Hi,
I have a "|" delimited file that is exported from a database.
There is one column in the file which has description/comments entered by some application user. It has "Control-M" character and "New Line" character in between the text.
Hence, when i export the data, this record with the new line character splits the record into 2.
Hence, the load fails. Following is an example :
1|user|i am happy.
2|user|i live
in india.
3|user|i am male.
I tried to replace the characters but was unable to do it between the 3rd column. And replace caused legal ones to be replaced as well.
Basically, i want to search a particular special character within the string of nth column.
Appreciate any inputs on this.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
How do I remove the lines where special characters or Unicode characters appear?
The following query does work but I wonder if there is a better way.
cat test.txt | egrep -v '\)|#|,|&|-|\(|\\|\/|\.'
The following lines show that my query is incomplete.
Warning: The word "*Khan" is... (1 Reply)
Discussion started by: shantanuo
1 Replies
2. Shell Programming and Scripting
Hi,
I am stuck with a problem here.
Suppose i have a variable which is assigned some string containing special charatcers. for eg:
$a="abcdef^bbwk#kdbcd@";
I have to remove the special characters using Perl. The text is assigned to the variable implicitly.
How to do it? (1 Reply)
Discussion started by: agarwal
1 Replies
3. UNIX for Dummies Questions & Answers
Hi All,
I have a script written that creates a new directory within the shell program and if a parameter isn't passed in, it creates a strange directory name by mistake. So I have a directory like "-_12" and I am unable to remove it. I tried removing it using double quote and many others. I have... (12 Replies)
Discussion started by: datherriault
12 Replies
4. Shell Programming and Scripting
Hello,
Is there a simpler way to remove special characters (color codes) from each lines in a log file?
I use sed like in the example below but I think there should be a more simple way to achieve the same result:
$ cat -vet file1
^, , , ,
Maybe to convert the file somehow?
... (5 Replies)
Discussion started by: majormark
5 Replies
5. UNIX for Dummies Questions & Answers
Dear Members,
We have a file which contains some special characters. I need to replace these special character by a new line character(\n).
The Special character is \x85.
I am not sure what this character means and how we can remove it.
Any inputs are greatly appreciated.
Thanks... (5 Replies)
Discussion started by: sandeep_1105
5 Replies
6. Shell Programming and Scripting
Hi All,
i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file.
I am using the following code.
while read LINE
do
echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_"
done < trial.txt > output.txt
Problem
... (10 Replies)
Discussion started by: kkb
10 Replies
7. UNIX for Dummies Questions & Answers
Hi,
I have a directory that has a file which contained special characters in the filename. Can someone please advise how to remove the file, preferably with a rm -i ?
Thanks in advance.
Listing is as below:
{oracle}> ls -1b
bplog.bkup.001
bplog.bkup.002
bplog.bkup.003
bplog.bkup.004... (1 Reply)
Discussion started by: newbie_01
1 Replies
8. Shell Programming and Scripting
hello all
I am writing a perl code and i wish to remove the special characters for text.
I wish to remove all extended ascii characters. If the list of special characters is huge, how can i do this using substitute command
s/specialcharacters/null/g
I really want to code like... (3 Replies)
Discussion started by: vasuarjula
3 Replies
9. Shell Programming and Scripting
Hi,
I have string like this ="Lookup Procedure"
But i want the output like this Lookup Procedure
=," should be removed.
Please suggest me the solution.
Regards,
Madhuri (2 Replies)
Discussion started by: srimadhuri
2 Replies
10. Shell Programming and Scripting
Hi Gurus,
I have file which contains some unicode charachator like "ü". I want to replace it with some charactors. I searched in internet and got command sed "s/ü/-/g", but I don't know how to type ü in unix command line.
Please help me for this one.
Thanks in advance (7 Replies)
Discussion started by: ken6503
7 Replies
LEARN ABOUT LINUX
erl_comment_scan
erl_comment_scan(3erl) Erlang Module Definition erl_comment_scan(3erl)
NAME
erl_comment_scan - Functions for reading comment lines from Erlang source code.
DESCRIPTION
Functions for reading comment lines from Erlang source code.
DATA TYPES
comment() = {integer(), integer(), integer(), [string()]} :
EXPORTS
file(FileName::filename() (see module file)) -> [Comment]
Types Comment = {Line, Column, Indentation, Text}
Line = integer()
Column = integer()
Indentation = integer()
Text = [string()]
Extracts comments from an Erlang source code file. Returns a list of entries representing multi-line comments, listed in order of
increasing line-numbers. For each entry, Text is a list of strings representing the consecutive comment lines in top-down order; the
strings contain all characters following (but not including) the first comment-introducing % character on the line, up to (but not
including) the line-terminating newline.
Furthermore, Line is the line number and Column the left column of the comment (i.e., the column of the comment-introducing % char-
acter). Indent is the indentation (or padding), measured in character positions between the last non-whitespace character before the
comment (or the left margin), and the left column of the comment. Line and Column are always positive integers, and Indentation is a
nonnegative integer.
Evaluation exits with reason {read, Reason} if a read error occurred, where Reason is an atom corresponding to a Posix error code;
see the module file(3erl) for details.
join_lines(Lines::[CommentLine]) -> [Comment]
Types CommentLine = {Line, Column, Indent, string()}
Line = integer()
Column = integer()
Indent = integer()
Comment = {Line, Column, Indent, Text}
Text = [string()]
Joins individual comment lines into multi-line comments. The input is a list of entries representing individual comment lines, in
order of decreasing line-numbers ; see scan_lines/1 for details. The result is a list of entries representing multi-line comments,
still listed in order of decreasing line-numbers , but where for each entry, Text is a list of consecutive comment lines in order of
increasing line-numbers (i.e., top-down).
See also: scan_lines/1 .
scan_lines(Text::string()) -> [CommentLine]
Types CommentLine = {Line, Column, Indent, Text}
Line = integer()
Column = integer()
Indent = integer()
Text = string()
Extracts individual comment lines from a source code string. Returns a list of comment lines found in the text, listed in order of
decreasing line-numbers, i.e., the last comment line in the input is first in the resulting list. Text is a single string, contain-
ing all characters following (but not including) the first comment-introducing % character on the line, up to (but not including)
the line-terminating newline. For details on Line , Column and Indent , see file/1 .
string(Text::string()) -> [Comment]
Types Comment = {Line, Column, Indentation, Text}
Line = integer()
Column = integer()
Indentation = integer()
Text = [string()]
Extracts comments from a string containing Erlang source code. Except for reading directly from a string, the behaviour is the same
as for file/1 .
See also: file/1 .
AUTHORS
Richard Carlsson <richardc@it.uu.se >
syntax_tools 1.6.7 erl_comment_scan(3erl)