11-17-2010
Convert Windows Metacharacters to Regular Text
Hi, all.
I have a need to take a flat file FTP'd from Windows to Unix and convert it for loading into a MySQL database without manual intervention. However, some characters are "fancified" (e.g. the fancy Beginning and End double-quotes from Windows) that show up as codes using vi. I need to convert these to regular text in Unix. The codes are below:
<85>=...
<92>=‘
<93>=“
<94>=”
Example Text in WordPad
===================
(like a telephone, except “0” at top left
Same Text in Unix
===================
(like a telephone, except <93>0<94> at top left
[Note the difference in the double quotes.]
The codes show up in Putty vi as blue, so I know it recognizes they are metacharacters, but none of the methods I've tried in Unix (sed, awk) to search for metacharacters seems to find these.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
How do I convert unix text files into readable text for windows.
Dave (1 Reply)
Discussion started by: nucca
1 Replies
2. Solaris
I have a Windows 2000 Terminal, which I want to convert into Solaris 10. I am connected to windows terminal remotely via iLO and then inserted the solaris DVD in my local drive. Now when I connect to Windows machine from 'RDP' - I can see local DVD in there - and IF I then reboot remote machine... (1 Reply)
Discussion started by: panchpan
1 Replies
3. UNIX for Dummies Questions & Answers
Hello Gurus,
I have a text file containing nearly 12,000 tab delimited characters with 4000 rows. If the file size is small, excel can convert the text into coloumns. However, the file that I have is very big. Can some body help me in solving this problem?
The input file example,
... (6 Replies)
Discussion started by: Unilearn
6 Replies
4. Shell Programming and Scripting
Hello:
(exp) : match "exp",the matched text is stored in auto named arrays.
How can I get the matched text ? What is the name of the auto named arrays on linux shell ? (4 Replies)
Discussion started by: 915086731
4 Replies
5. UNIX for Dummies Questions & Answers
Hi All,
I'm hoping this is an easy question, but I'm having a weird problem trying to simply copy and paste text from MS Windows (XP) Notepad and then pasting into vi or vim in AIX. When I type "oslevel" I get "5.3.0.0". The problem is that once the text is pasted, there are sections of text... (2 Replies)
Discussion started by: PlainInverted
2 Replies
6. Shell Programming and Scripting
hey im trying to get the hex diffrences in two files ones called new and the other is named old i want it to phrase into my script,
heres how i need the info:
input='\x'94 #the new 1 byte hex change
offset=00000000 #the 1st offset of the difference
patch
unset input offset
input='\x'34... (5 Replies)
Discussion started by: lewisdenny
5 Replies
7. Shell Programming and Scripting
Hi guys,
I am been banging my head for days on something that appears too simple to be so hard for me.
I have this bash script which I used just fine on my windows PC.
I took this file over to my Macbook and try to run it and it fails like no tomorrow.
This is the contents of the file:... (3 Replies)
Discussion started by: richsark
3 Replies
8. Windows & DOS: Issues & Discussions
Hmmm I think I found the correct subforum to ask my question...
I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this?... (1 Reply)
Discussion started by: frys_hp
1 Replies
9. UNIX for Dummies Questions & Answers
Hi all,
I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this? Or just reinsert thousands of line breaks again :eek: ? (2 Replies)
Discussion started by: frys_hp
2 Replies
10. Shell Programming and Scripting
Hello all
i have utf-8 file that i try to convert to WINDOWS-1251 on linux
without any success
the file name is utf-8 when i try to do :
file -bi test.txt
it gives me :
text/plain; charset=utf-8
when i try to convert the file i do :
/usr/bin/iconv -f UTF-8 -t WINDOWS-1251 test.txt >... (1 Reply)
Discussion started by: umen
1 Replies
LEARN ABOUT CENTOS
th_tis2uni_line
thai/thwchar.h(3) libthai thai/thwchar.h(3)
NAME
thai/thwchar.h -
Wide char support for Thai.
SYNOPSIS
Macros
#define THWCHAR_ERR (~(thwchar_t)0)
Wide-character value indicating error.
Typedefs
typedef wchar_t thwchar_t
Thai character type for storing Unicode character.
Functions
thwchar_t th_tis2uni (thchar_t c)
Convert character code from TIS-620 to Unicode.
int th_tis2uni_line (const thchar_t *s, thwchar_t *result, size_t n)
Convert string from TIS-620 to Unicode.
thwchar_t th_winthai2uni (thchar_t c)
Convert character code from Thai Windows extended code to Unicode.
thwchar_t th_macthai2uni (thchar_t c)
Convert character code from Mac Thai extended code to Unicode.
thchar_t th_uni2tis (thwchar_t wc)
Convert character code from Unicode to TIS-620.
int th_uni2tis_line (const thwchar_t *s, thchar_t *result, size_t n)
Convert string from Unicode to TIS-620.
thchar_t th_uni2winthai (thwchar_t wc)
Convert character code from Unicode to Thai Windows extended code.
thchar_t th_uni2macthai (thwchar_t wc)
Convert character code from Unicode to Mac Thai extended code.
Detailed Description
Wide char support for Thai.
Function Documentation
thwchar_t th_macthai2uni (thchar_tc)
Convert character code from Mac Thai extended code to Unicode.
Parameters:
c : Mac Thai character/glyph to convert
Returns:
Corresponding Unicode code
thwchar_t th_tis2uni (thchar_tc)
Convert character code from TIS-620 to Unicode.
Parameters:
c : TIS-620 character to convert
Returns:
Corresponding Unicode code
int th_tis2uni_line (const thchar_t *s, thwchar_t *result, size_tn)
Convert string from TIS-620 to Unicode.
Parameters:
s : source TIS-620 string (null-terminated)
result : buffer for storing resulting Unicode string
n : size of result buffer (as number of elements)
Returns:
the length of the output Unicode string
thchar_t th_uni2macthai (thwchar_twc)
Convert character code from Unicode to Mac Thai extended code.
Parameters:
wc : Unicode code to convert
Returns:
Corresponding Mac Thai extended code, or TH_ERR if conversion is impossible
thchar_t th_uni2tis (thwchar_twc)
Convert character code from Unicode to TIS-620.
Parameters:
wc : Unicode character to convert
Returns:
Corresponding TIS-620 code, or TH_ERR if conversion is impossible
int th_uni2tis_line (const thwchar_t *s, thchar_t *result, size_tn)
Convert string from Unicode to TIS-620.
Parameters:
s : source Unicode string (null-terminated)
result : buffer for storing resulting TIS-620 string
n : size of result buffer (as number of elements)
Returns:
the length of the output TIS-620 string
Note that, since the conversion is lossy, some characters in the convesion result may be TH_ERR, indicating conversion error.
thchar_t th_uni2winthai (thwchar_twc)
Convert character code from Unicode to Thai Windows extended code.
Parameters:
wc : Unicode code to convert
Returns:
Corresponding Thai Windows extended code, or TH_ERR if conversion is impossible
thwchar_t th_winthai2uni (thchar_tc)
Convert character code from Thai Windows extended code to Unicode.
Parameters:
c : Thai Windows character/glyph to convert
Returns:
Corresponding Unicode code
Author
Generated automatically by Doxygen for libthai from the source code.
Version 0.1.14 Tue Jun 17 2014 thai/thwchar.h(3)