Sponsored Content
Operating Systems AIX Locales and conversion tables confusion - Some characters don't get translated Post 302503376 by Adamm on Thursday 10th of March 2011 10:37:12 AM
Old 03-10-2011
Locales and conversion tables confusion - Some characters don't get translated

Hello,

my program running on AIX receives a message (from MQ) which is in CCSID 870 (LATIN-2 EBCDIC). It needs to convert it to CCSID 912 (ISO-8859-2). For this conversion, it uses the Websphere MQ functionality, but which, according to the manual, uses AIX's system conversion tables. (Btw - it only works like this on AIX. On Linux or Windows, Websphere MQ uses its own coversion logic, ignoring system conversion tables - and it works there.)

The problem is, that some characters like š,č,ť,ž get translated to chr(26).

My checklist was:
1. The LANG environment variable is set to sk_SK
2. Conversion tables seem to be there
(root):/usr/lib/nls/loc/iconvTable# ls -l
...
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1250_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1282_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1284_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1285_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1250
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1282
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1284
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1285
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-852
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-870
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_ISO8859-2
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-852_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-870_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 ISO8859-2_IBM-5346

Can you please help me find out what am I forgeting? Thanx.
 

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Locales - Solaris 8

Can anyone tell me the difference between the 2 Locales: North American Partial Locales en_US.ISO8859-1 en_US.ISO8859-15 Does it matter which one to use? What are the differences? Thanks. -I have found the below info but I don't know what it means(Also no RFC# for 8859-15): ... (2 Replies)
Discussion started by: finster
2 Replies

2. AIX

Locales in AIX

Currently we have the following locales installed on two of our servers SERVER-1 $ locale -a C POSIX en_US en_US.8859-15 en_US.ISO8859-1 EN_US EN_US.UTF-8 ZH_CN ZH_CN.UTF-8 HI_IN HI_IN.UTF-8 ko_KR ko_KR.IBM-eucKR zh_TW zh_TW.IBM-eucTW SERVER-2 (0 Replies)
Discussion started by: voorkey
0 Replies

3. Shell Programming and Scripting

Converting tables of row data into columns of tables

I am trying to transpose tables listed in the format into format. Any help would be greatly appreciated. Input: test_data_1 1 2 90% 4 3 91% 5 4 90% 6 5 90% 9 6 90% test_data_2 3 5 92% 5 4 92% 7 3 93% 9 2 92% 1 1 92% ... Output:... (7 Replies)
Discussion started by: justthisguy
7 Replies

4. AIX

SMTP and characters conversion

Hello, I'm working with an AIX 5.3 This server receive emails from an application (ServiceDesk management) and these emails are read and integrated in another application via an EAI. I work for a french company with french people that write in french : with accentued characters (é,ç,à,...). Sadly,... (2 Replies)
Discussion started by: Djizus
2 Replies

5. Shell Programming and Scripting

Setting locales

I'm having a problem with my locale setting. Essentially, when using Xmgrace or Awk, all . are replaced with , leading to wrong arithmetic. Here is an explanation of the problem: awk printing thousands with commas. see LC_ALL=en_US.UTF-8 How can I permanently set the locale... (1 Reply)
Discussion started by: chrisjorg
1 Replies

6. IP Networking

Does Translated IP Matter For Proxy Server (SQUID)

I am using Squid to create a proxy server for framework related to an application. My users sit on a private network in 191.xx.xx.xx space and my proxy sits in a different private network in 188.xx.xx.xx space. There will be a NAT in place to allow bidirectional communications but is there an... (5 Replies)
Discussion started by: BobSpero
5 Replies

7. Linux

File conversion and removing special characters from a file in Linux

I have a .CSV file when I check for the special characters in the file using the command cat -vet filename.csv, i get very lengthy lines with "^@", "^I^@" and "^@^M" characters in between each alphabet in all of the records. Using the code below file filename.csv I get the output as I have a... (2 Replies)
Discussion started by: dhruuv369
2 Replies

8. UNIX for Beginners Questions & Answers

Replacing string/special characters using a 'conversion' table

Hi, Does anyone know if there is a script or program available out there that uses a conversion table to replace special characters from a file? I am trying to remove some special characters from a file but there are several unprintable/control characters that some I need to remove but some I... (2 Replies)
Discussion started by: newbie_01
2 Replies
iconv(5)						Standards, Environments, and Macros						  iconv(5)

NAME
iconv - code set conversion tables DESCRIPTION
The following code set conversions are supported: Code Set Conversions Supported Code Symbol Target Code Symbol Target Output ISO 646 646 ISO 8859-1 8859 US ASCII ISO 646de 646de ISO 8859-1 8859 German ISO 646da 646da ISO 8859-1 8859 Danish ISO 646en 646en ISO 8859-1 8859 English ASCII ISO 646es 646es ISO 8859-1 8859 Spanish ISO 646fr 646fr ISO 8859-1 8859 French ISO 646it 646it ISO 8859-1 8859 Italian ISO 646sv 646sv ISO 8859-1 8859 Swedish ISO 8859-1 8859 ISO 646 646 7 bit ASCII ISO 8859-1 8859 ISO 646de 646de German ISO 8859-1 8859 ISO 646da 646da Danish ISO 8859-1 8859 ISO 646en 646en English ASCII ISO 8859-1 8859 ISO 646es 646es Spanish ISO 8859-1 8859 ISO 646fr 646fr French ISO 8859-1 8859 ISO 646it 646it Italian ISO 8859-1 8859 ISO 646sv 646sv Swedish ISO 8859-16 iso16 ISO 8859-2 iso2 ISO Latin 2 ISO 8859-2 iso2 ISO 8859-16 iso16 ISO Latin 10 ISO 8859-16 iso16 IBM 850 ibm850 IBM 850 code page ISO 8859-16 iso16 IBM 870 ibm870 IBM 870 code page ISO 8859-2 iso2 MS 1250 win2 Windows Latin 2 ISO 8859-2 iso2 MS 852 dos2 MS-DOS Latin 2 ISO 8859-2 iso2 Mazovia maz Mazovia IBM 850 ibm850 ISO 8859-16 iso16 ISO Latin 10 IBM 870 ibm870 ISO 8859-16 iso16 ISO Latin 10 MS 1250 win2 DHN dhn Dom Handlowy Nauki MS 852 dos2 ISO 8859-2 iso2 ISO Latin 2 MS 852 dos2 MS 1250 win2 Windows Latin 2 MS 852 dos2 Mazovia maz Mazovia MS 852 dos2 DHN dhn Dom Handlowy Nauki Mazovia maz ISO 8859-2 iso2 ISO Latin 2 Mazovia maz MS 1250 win2 Windows Latin 2 Mazovia maz MS 852 dos2 MS-DOS Latin 2 Mazovia maz DHN dhn Dom Handlowy Nauki DHN dhn ISO 8859-2 iso2 ISO Latin 2 DHN dhn MS 1250 win2 Windows Latin 2 DHN dhn MS 852 dos2 MS-DOS Latin 2 DHN dhn Mazovia maz Mazovia ISO 8859-5 iso5 KOI8-R koi8 KOI8-R ISO 8859-5 iso5 PC Cyrillic alt Alternative PC Cyrillic ISO 8859-5 iso5 MS 1251 win5 Windows Cyrillic ISO 8859-5 iso5 Mac Cyrillic mac Macintosh Cyrillic KOI8-R koi8 ISO 8859-5 iso5 ISO 8859-5 Cyrillic KOI8-R koi8 PC Cyrillic alt Alternative PC Cyrillic KOI8-R koi8 MS 1251 win5 Windows Cyrillic KOI8-R koi8 Mac Cyrillic mac Macintosh Cyrillic PC Cyrillic alt ISO 8859-5 iso5 ISO 8859-5 Cyrillic PC Cyrillic alt KOI8-R koi8 KOI8-R PC Cyrillic alt MS 1251 win5 Windows Cyrillic PC Cyrillic alt Mac Cyrillic mac Macintosh Cyrillic MS 1251 win5 ISO 8859-5 iso5 ISO 8859-5 Cyrillic MS 1251 win5 KOI8-R koi8 KOI8-R MS 1251 win5 PC Cyrillic alt Alternative PC Cyrillic MS 1251 win5 Mac Cyrillic mac Macintosh Cyrillic Mac Cyrillic mac ISO 8859-5 iso5 ISO 8859-5 Cyrillic Mac Cyrillic mac KOI8-R koi8 KOI8-R Mac Cyrillic mac PC Cyrillic alt Alternative PC Cyrillic Mac Cyrillic mac MS 1251 win5 Windows Cyrillic CONVERSIONS
The conversions are performed according to the tables contained in the manual pages cross-referenced in the Index of Conversion Code Tables below. +--------------------------------------------------------------+ | Index of Conversion Code Tables | +--------------------+--------------------+--------------------+ | Code | Target Code | See Manual Page | +--------------------+--------------------+--------------------+ |ISO 646 |ISO 8859-1 | iconv_646(5) | +--------------------+--------------------+--------------------+ |ISO 646de |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646da |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646en |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646es |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646fr |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646it |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 646sv |ISO 8859-1 | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646 | iconv_8859-1(5) | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646de | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646da | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646en | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646es | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646fr | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646it | | +--------------------+--------------------+--------------------+ |ISO 8859-1 |ISO 646sv | | +--------------------+--------------------+--------------------+ |ISO 8859-2 |MS 1250 | iconv_8859-2(5) | +--------------------+--------------------+--------------------+ |ISO 8859-2 |MS 852 | | +--------------------+--------------------+--------------------+ |ISO 8859-2 |Mazovia | | +--------------------+--------------------+--------------------+ |ISO 8859-2 |DHN | | +--------------------+--------------------+--------------------+ |MS 1250 |ISO 8859-2 | iconv_1250(5) | +--------------------+--------------------+--------------------+ |MS 1250 |MS 852 | | +--------------------+--------------------+--------------------+ |MS 1250 |Mazovia | | +--------------------+--------------------+--------------------+ |MS 1250 |DHN | | +--------------------+--------------------+--------------------+ |MS 852 |ISO 8859-2 | iconv_852(5) | +--------------------+--------------------+--------------------+ |MS 852 |MS 1250 | | +--------------------+--------------------+--------------------+ |MS 852 |Mazovia | | +--------------------+--------------------+--------------------+ |MS 852 |DHN | | +--------------------+--------------------+--------------------+ |Mazovia |ISO 8859-2 | iconv_maz(5) | +--------------------+--------------------+--------------------+ |Mazovia |MS 1250 | | +--------------------+--------------------+--------------------+ |Mazovia |MS 852 | | +--------------------+--------------------+--------------------+ |Mazovia |DHN | | +--------------------+--------------------+--------------------+ +--------------------------------------------------------------+ | Index of Conversion Code Tables | +--------------------+--------------------+--------------------+ | Code | Target Code | See Manual Page | +--------------------+--------------------+--------------------+ |DHN |ISO 8859-2 | iconv_dhn(5) | +--------------------+--------------------+--------------------+ |DHN |MS 1250 | | +--------------------+--------------------+--------------------+ |DHN |MS 852 | | +--------------------+--------------------+--------------------+ |DHN |Mazovia | | +--------------------+--------------------+--------------------+ |ISO 8859-5 |KOI8-R | iconv_8859-5(5) | +--------------------+--------------------+--------------------+ |ISO 8859-5 |PC Cyrillic | | +--------------------+--------------------+--------------------+ |ISO 8859-5 |MS 1251 | | +--------------------+--------------------+--------------------+ |ISO 8859-5 |Mac Cyrillic | | +--------------------+--------------------+--------------------+ |KOI8-R |ISO 8859-5 | iconv_koi8-r(5) | +--------------------+--------------------+--------------------+ |KOI8-R |PC Cyrillic | | +--------------------+--------------------+--------------------+ |KOI8-R |MS 1251 | | +--------------------+--------------------+--------------------+ |KOI8-R |Mac Cyrillic | | +--------------------+--------------------+--------------------+ |PC Cyrillic |ISO 8859-5 | iconv_pc_cyr(5) | +--------------------+--------------------+--------------------+ |PC Cyrillic |KOI8-R | | +--------------------+--------------------+--------------------+ |PC Cyrillic |MS 1251 | | +--------------------+--------------------+--------------------+ |PC Cyrillic |Mac Cyrillic | | +--------------------+--------------------+--------------------+ |MS 1251 |ISO 8859-5 | iconv_1251(5) | +--------------------+--------------------+--------------------+ |MS 1251 |KOI8-R | | +--------------------+--------------------+--------------------+ |MS 1251 |PC Cyrillic | | +--------------------+--------------------+--------------------+ |MS 1251 |Mac Cyrillic | | +--------------------+--------------------+--------------------+ |Mac Cyrillic |ISO 8859-5 | iconv_mac_cyr(5) | +--------------------+--------------------+--------------------+ |Mac Cyrillic |KOI8-R | | +--------------------+--------------------+--------------------+ |Mac Cyrillic |PC Cyrillic | | +--------------------+--------------------+--------------------+ |Mac Cyrillic |MS 1251 | | +--------------------+--------------------+--------------------+ FILES
/usr/lib/iconv/*.so conversion modules /usr/lib/iconv/*.t Conversion tables. /usr/lib/iconv/geniconvtbl/binarytables/*.bt Conversion binary tables. /usr/lib/iconv/iconv_data List of conversions supported by conversion tables. SEE ALSO
iconv(1), iconv(3C), iconv_1250(5), iconv_1251(5), iconv_646(5), iconv_852(5), iconv_8859-1(5), iconv_8859-2(5), iconv_8859-5(5), iconv_dhn(5), iconv_koi8-r(5), iconv_mac_cyr(5), iconv_maz(5), iconv_pc_cyr(5), iconv_unicode(5) SunOS 5.10 5 Dec 2001 iconv(5)
All times are GMT -4. The time now is 11:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy