Sponsored Content
Top Forums Shell Programming and Scripting Convert Windows Metacharacters to Regular Text Post 302472623 by superdelic on Wednesday 17th of November 2010 04:07:58 PM
Old 11-17-2010
Convert Windows Metacharacters to Regular Text

Hi, all.

I have a need to take a flat file FTP'd from Windows to Unix and convert it for loading into a MySQL database without manual intervention. However, some characters are "fancified" (e.g. the fancy Beginning and End double-quotes from Windows) that show up as codes using vi. I need to convert these to regular text in Unix. The codes are below:
<85>=...
<92>=‘
<93>=“
<94>=”

Example Text in WordPad
===================
(like a telephone, except “0” at top left

Same Text in Unix
===================
(like a telephone, except <93>0<94> at top left

[Note the difference in the double quotes.]

The codes show up in Putty vi as blue, so I know it recognizes they are metacharacters, but none of the methods I've tried in Unix (sed, awk) to search for metacharacters seems to find these.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How do I convert unix text to to win text?

How do I convert unix text files into readable text for windows. Dave (1 Reply)
Discussion started by: nucca
1 Replies

2. Solaris

convert windows OS as Solaris remotely

I have a Windows 2000 Terminal, which I want to convert into Solaris 10. I am connected to windows terminal remotely via iLO and then inserted the solaris DVD in my local drive. Now when I connect to Windows machine from 'RDP' - I can see local DVD in there - and IF I then reboot remote machine... (1 Reply)
Discussion started by: panchpan
1 Replies

3. UNIX for Dummies Questions & Answers

How to convert text to columns in tab delimited text file

Hello Gurus, I have a text file containing nearly 12,000 tab delimited characters with 4000 rows. If the file size is small, excel can convert the text into coloumns. However, the file that I have is very big. Can some body help me in solving this problem? The input file example, ... (6 Replies)
Discussion started by: Unilearn
6 Replies

4. Shell Programming and Scripting

How can I get the matched text when using regular expression.

Hello: (exp) : match "exp",the matched text is stored in auto named arrays. How can I get the matched text ? What is the name of the auto named arrays on linux shell ? (4 Replies)
Discussion started by: 915086731
4 Replies

5. UNIX for Dummies Questions & Answers

Copying text from Windows to AIX - missing text?

Hi All, I'm hoping this is an easy question, but I'm having a weird problem trying to simply copy and paste text from MS Windows (XP) Notepad and then pasting into vi or vim in AIX. When I type "oslevel" I get "5.3.0.0". The problem is that once the text is pasted, there are sections of text... (2 Replies)
Discussion started by: PlainInverted
2 Replies

6. Shell Programming and Scripting

help with organizing some non regular text

hey im trying to get the hex diffrences in two files ones called new and the other is named old i want it to phrase into my script, heres how i need the info: input='\x'94 #the new 1 byte hex change offset=00000000 #the 1st offset of the difference patch unset input offset input='\x'34... (5 Replies)
Discussion started by: lewisdenny
5 Replies

7. Shell Programming and Scripting

Convert this Windows script so I can use it on Macbook

Hi guys, I am been banging my head for days on something that appears too simple to be so hard for me. I have this bash script which I used just fine on my windows PC. I took this file over to my Macbook and try to run it and it fails like no tomorrow. This is the contents of the file:... (3 Replies)
Discussion started by: richsark
3 Replies

8. Windows & DOS: Issues & Discussions

Convert UNIX text file in Windows to recognize line breaks

Hmmm I think I found the correct subforum to ask my question... I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this?... (1 Reply)
Discussion started by: frys_hp
1 Replies

9. UNIX for Dummies Questions & Answers

Convert UNIX text file in Windows to recognize line breaks

Hi all, I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this? Or just reinsert thousands of line breaks again :eek: ? (2 Replies)
Discussion started by: frys_hp
2 Replies

10. Shell Programming and Scripting

Trying to convert utf-8 to WINDOWS-1251

Hello all i have utf-8 file that i try to convert to WINDOWS-1251 on linux without any success the file name is utf-8 when i try to do : file -bi test.txt it gives me : text/plain; charset=utf-8 when i try to convert the file i do : /usr/bin/iconv -f UTF-8 -t WINDOWS-1251 test.txt >... (1 Reply)
Discussion started by: umen
1 Replies
thai/thwchar.h(3)						      libthai							 thai/thwchar.h(3)

NAME
thai/thwchar.h - Wide char support for Thai. SYNOPSIS
Macros #define THWCHAR_ERR (~(thwchar_t)0) Wide-character value indicating error. Typedefs typedef wchar_t thwchar_t Thai character type for storing Unicode character. Functions thwchar_t th_tis2uni (thchar_t c) Convert character code from TIS-620 to Unicode. int th_tis2uni_line (const thchar_t *s, thwchar_t *result, size_t n) Convert string from TIS-620 to Unicode. thwchar_t th_winthai2uni (thchar_t c) Convert character code from Thai Windows extended code to Unicode. thwchar_t th_macthai2uni (thchar_t c) Convert character code from Mac Thai extended code to Unicode. thchar_t th_uni2tis (thwchar_t wc) Convert character code from Unicode to TIS-620. int th_uni2tis_line (const thwchar_t *s, thchar_t *result, size_t n) Convert string from Unicode to TIS-620. thchar_t th_uni2winthai (thwchar_t wc) Convert character code from Unicode to Thai Windows extended code. thchar_t th_uni2macthai (thwchar_t wc) Convert character code from Unicode to Mac Thai extended code. Detailed Description Wide char support for Thai. Function Documentation thwchar_t th_macthai2uni (thchar_tc) Convert character code from Mac Thai extended code to Unicode. Parameters: c : Mac Thai character/glyph to convert Returns: Corresponding Unicode code thwchar_t th_tis2uni (thchar_tc) Convert character code from TIS-620 to Unicode. Parameters: c : TIS-620 character to convert Returns: Corresponding Unicode code int th_tis2uni_line (const thchar_t *s, thwchar_t *result, size_tn) Convert string from TIS-620 to Unicode. Parameters: s : source TIS-620 string (null-terminated) result : buffer for storing resulting Unicode string n : size of result buffer (as number of elements) Returns: the length of the output Unicode string thchar_t th_uni2macthai (thwchar_twc) Convert character code from Unicode to Mac Thai extended code. Parameters: wc : Unicode code to convert Returns: Corresponding Mac Thai extended code, or TH_ERR if conversion is impossible thchar_t th_uni2tis (thwchar_twc) Convert character code from Unicode to TIS-620. Parameters: wc : Unicode character to convert Returns: Corresponding TIS-620 code, or TH_ERR if conversion is impossible int th_uni2tis_line (const thwchar_t *s, thchar_t *result, size_tn) Convert string from Unicode to TIS-620. Parameters: s : source Unicode string (null-terminated) result : buffer for storing resulting TIS-620 string n : size of result buffer (as number of elements) Returns: the length of the output TIS-620 string Note that, since the conversion is lossy, some characters in the convesion result may be TH_ERR, indicating conversion error. thchar_t th_uni2winthai (thwchar_twc) Convert character code from Unicode to Thai Windows extended code. Parameters: wc : Unicode code to convert Returns: Corresponding Thai Windows extended code, or TH_ERR if conversion is impossible thwchar_t th_winthai2uni (thchar_tc) Convert character code from Thai Windows extended code to Unicode. Parameters: c : Thai Windows character/glyph to convert Returns: Corresponding Unicode code Author Generated automatically by Doxygen for libthai from the source code. Version 0.1.14 Tue Jun 17 2014 thai/thwchar.h(3)
All times are GMT -4. The time now is 11:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy