12-09-2012
Quote:
Originally Posted by
RudiC
I'm a bit surprised: ASCII chr(172) (decimal 172) IS¬. What your purpose of replacing it? Or do you mean the literal string "chr(172)"?
The sed command I suggested assumes that abhi_123 wanted the literal string "chr(172)". The byte with decimal value 172 is not as ASCII character at all. (ASCII only defines bytes with values 0 through 127 and a character with the glyph ¬ is not one of them.) The EBCDIC character representing the glyph ¬ has decimal value 95. The ISO/IEC 8859-1 glyph for the character with decimal value 172 is ¬. The 8859-2 glyph for the character with decimal value 172 is Ť. The 8859-3 glyph for the character with decimal value 172 is Ĵ...
Probably more important, however, is that in UTF-8 (which is becoming more common as a code set AND appears to be the encoding used in the input abhi_123 supplied) the two byte character representing the glyph ¬ has bytes with decimal values 194 and 172 (in that order) and the single byte with decimal value 172 is an encoding error.
If abhi_123 is trying to convert an input file encoded in UTF-8 into a file encoded in 8859-1, the iconv utility should be used instead of trying to map an individual character's value into an invalid character in the output data stream being written by sed.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
i would like substitute the words containing the character "-" by any other.
i've already tried the tr command: tr '\-' 'X', for example.
But, this command doesn't work. It gave this:
Original text:
-i abcd-fe
Result text:
Xi abcdXfe
Result desired:
-i abcdXfe
Thanks! ;) (3 Replies)
Discussion started by: tmxps
3 Replies
2. Shell Programming and Scripting
Hi,
I have rows in a file, in each row string starts with "A200819097564".
I want to replace the first character A with space.So the string looks like " 200819097564"
I tried "tr -s "A2008" " 2008""
But did not get the required outpit.
Thanks. (3 Replies)
Discussion started by: pradeep_script
3 Replies
3. Shell Programming and Scripting
Can someone help me to write a script / command to read in a file, character by character, replace any unknown ASCII characters with space. then write out the file to a new filename/
Thanks! (1 Reply)
Discussion started by: raghav525
1 Replies
4. Shell Programming and Scripting
hi
i have a string var=abc.ghi.jkl.mno.pqr
now i need to replace .(dot) with _(underscore)
the result should be like "arresult=abc_def_ghi_jkl_mno_pqr"
Please help (8 Replies)
Discussion started by: satish@123
8 Replies
5. Shell Programming and Scripting
Hi All,
Was wondering how I can do the following....
I have a String as follows
"ACCTRL000005022RRWDKKEEDKDD...."
This string can be in a file called tail.out or in a Variable called $VAR2
Now I have another variable called $VAR1="000004785" (9 bytes long), I need the content of... (5 Replies)
Discussion started by: mohullah
5 Replies
6. Shell Programming and Scripting
ive tried doing
sed -i 's/h/\'/g' file.txt
to replace h with ' but it doesnt work:confused:. Any ideas would be greatly appreciated. (3 Replies)
Discussion started by: lyman1216
3 Replies
7. Shell Programming and Scripting
Hi all,
Greetings,
I have the following scenario, The contents of main file are like :
Unix|||||forum|||||||||||||||is||||||the||best
so||||||be|||||on||||||||||||||||||||||||||||||||||||||||||||it
And i need the output in the following form:
Unix=forum=is=the=best
so=be=on=it
... (3 Replies)
Discussion started by: dipanchandra
3 Replies
8. Shell Programming and Scripting
Hello,
I am trying to replace all ^Z chars in my file to a space using the following command:
cat <file> | tr '\32' ' '
But the above command is deleting all NULL in the file. Hence the field positions are being changed. Please let me know the reason, if anyone knows.
Thanks in... (15 Replies)
Discussion started by: risshanth
15 Replies
9. Shell Programming and Scripting
Hi,
i want find the character '-' in a file from position 284-298, if it occurs i need to replace it with 'O ' for the position in the file. How to do that using SED command.
thanks in advance,
Sara (9 Replies)
Discussion started by: Sara183
9 Replies
10. UNIX for Advanced & Expert Users
hello
i have file with 100k records and each one has certain value that starts at 28th column and certain value that starts at 88th column
e.g. 1st file
<25>1234567 ..... <88> 8573785485
i have aditional file with values which are related to value that starts at 88th column of the... (1 Reply)
Discussion started by: dell1520
1 Replies
LEARN ABOUT PHP
utf8_encode
UTF8_ENCODE(3) 1 UTF8_ENCODE(3)
utf8_encode - Encodes an ISO-8859-1 string to UTF-8
SYNOPSIS
string utf8_encode (string $data)
DESCRIPTION
This function encodes the string $data to UTF-8, and returns the encoded version. UTF-8 is a standard mechanism used by Unicode for
encoding wide character values into a byte stream. UTF-8 is transparent to plain ASCII characters, is self-synchronized (meaning it is
possible for a program to figure out where in the bytestream characters start) and can be used with normal string comparison functions for
sorting and such. PHP encodes UTF-8 characters in up to four bytes, like this:
UTF-8 encoding
+------+-------------------------------------+---+
|bytes | | |
| | | |
| | bits | |
| | | |
| | representation | |
| | | |
+------+-------------------------------------+---+
| 1 | | |
| | | |
| | 7 | |
| | | |
| | 0bbbbbbb | |
| | | |
| 2 | | |
| | | |
| | 11 | |
| | | |
| | 110bbbbb 10bbbbbb | |
| | | |
| 3 | | |
| | | |
| | 16 | |
| | | |
| | 1110bbbb 10bbbbbb 10bbbbbb | |
| | | |
| 4 | | |
| | | |
| | 21 | |
| | | |
| | 11110bbb 10bbbbbb 10bbbbbb 10bbbbbb | |
| | | |
+------+-------------------------------------+---+
Each b represents a bit that can be used to store character data.
PARAMETERS
o $data
- An ISO-8859-1 string.
RETURN VALUES
Returns the UTF-8 translation of $data.
SEE ALSO
utf8_decode(3).
PHP Documentation Group UTF8_ENCODE(3)