03-10-2011
Locales and conversion tables confusion - Some characters don't get translated
Hello,
my program running on AIX receives a message (from MQ) which is in CCSID 870 (LATIN-2 EBCDIC). It needs to convert it to CCSID 912 (ISO-8859-2). For this conversion, it uses the Websphere MQ functionality, but which, according to the manual, uses AIX's system conversion tables. (Btw - it only works like this on AIX. On Linux or Windows, Websphere MQ uses its own coversion logic, ignoring system conversion tables - and it works there.)
The problem is, that some characters like š,č,ť,ž get translated to chr(26).
My checklist was:
1. The LANG environment variable is set to sk_SK
2. Conversion tables seem to be there
(root):/usr/lib/nls/loc/iconvTable# ls -l
...
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1250_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1282_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1284_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-1285_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1250
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1282
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1284
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-1285
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-852
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_IBM-870
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-5346_ISO8859-2
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-852_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 IBM-870_IBM-5346
-r--r--r-- 1 bin bin 288 Aug 12 2010 ISO8859-2_IBM-5346
Can you please help me find out what am I forgeting? Thanx.
8 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Can anyone tell me the difference between the 2 Locales:
North American Partial Locales
en_US.ISO8859-1
en_US.ISO8859-15
Does it matter which one to use?
What are the differences?
Thanks.
-I have found the below info but I don't know what it means(Also no RFC# for 8859-15):
... (2 Replies)
Discussion started by: finster
2 Replies
2. AIX
Currently we have the following locales installed on two of our servers
SERVER-1
$ locale -a
C
POSIX
en_US
en_US.8859-15
en_US.ISO8859-1
EN_US
EN_US.UTF-8
ZH_CN
ZH_CN.UTF-8
HI_IN
HI_IN.UTF-8
ko_KR
ko_KR.IBM-eucKR
zh_TW
zh_TW.IBM-eucTW
SERVER-2 (0 Replies)
Discussion started by: voorkey
0 Replies
3. Shell Programming and Scripting
I am trying to transpose tables listed in the format into format. Any help would be greatly appreciated.
Input:
test_data_1
1 2 90%
4 3 91%
5 4 90%
6 5 90%
9 6 90%
test_data_2
3 5 92%
5 4 92%
7 3 93%
9 2 92%
1 1 92%
...
Output:... (7 Replies)
Discussion started by: justthisguy
7 Replies
4. AIX
Hello,
I'm working with an AIX 5.3
This server receive emails from an application (ServiceDesk management) and these emails are read and integrated in another application via an EAI. I work for a french company with french people that write in french : with accentued characters (é,ç,à,...). Sadly,... (2 Replies)
Discussion started by: Djizus
2 Replies
5. Shell Programming and Scripting
I'm having a problem with my locale setting.
Essentially, when using Xmgrace or Awk, all . are replaced with ,
leading to wrong arithmetic.
Here is an explanation of the problem:
awk printing thousands with commas. see LC_ALL=en_US.UTF-8
How can I permanently set the locale... (1 Reply)
Discussion started by: chrisjorg
1 Replies
6. IP Networking
I am using Squid to create a proxy server for framework related to an application. My users sit on a private network in 191.xx.xx.xx space and my proxy sits in a different private network in 188.xx.xx.xx space. There will be a NAT in place to allow bidirectional communications but is there an... (5 Replies)
Discussion started by: BobSpero
5 Replies
7. Linux
I have a .CSV file when I check for the special characters in the file using the command cat -vet filename.csv, i get very lengthy lines with "^@", "^I^@" and "^@^M" characters in between each alphabet in all of the records. Using the code below file filename.csv I get the output as
I have a... (2 Replies)
Discussion started by: dhruuv369
2 Replies
8. UNIX for Beginners Questions & Answers
Hi,
Does anyone know if there is a script or program available out there that uses a conversion table to replace special characters from a file?
I am trying to remove some special characters from a file but there are several unprintable/control characters that some I need to remove but some I... (2 Replies)
Discussion started by: newbie_01
2 Replies
XOSD(1xosd) XOSD(1xosd)
NAME
osd_cat - X on-screen file displayer
SYNOPSIS
osd_cat [OPTION] [FILE]...
osd_cat -b percentage|slider [OPTION]
DESCRIPTION
Display FILE, or standard input, on X screen.
-p, --pos=POS
This option tells osd_cat where to display the text. POS can be top, middle, or bottom. The default is top.
-o, --offset=OFFSET
This option specifies the offset from the top or bottom of screen the text is displayed. The default is 0.
-A, --align=ALIGN
This option tells osd_cat where to display the text. ALIGN can be left, right or center. The default is left.
-i, --indent=OFFSET
This option specifies the INDENT from the left of screen the text is displayed. The default is 0.
-f, --font=FONT
This option specifies the FONT to be used for displaying the text. The default is fixed.
-c, --color=COLOR
This option specifies the COLOR to be used for displaying the text. The default is red.
-d, --delay=TIME
This option specifies the number of seconds the text is displayed. The default is 5 seconds.
-l, --lines=LINES
This option specifies the number of LINES to scroll the display over. The default is 5.
-s, --shadow=OFFSET
This option specifies the OFFSET of the text shadow. The default is 0, which means no text shadow is created.
-a, --age[=SCROLL_AGE]
This option affects screen redrawing. If SCROLL_AGE seconds pass before a new line is ready (for example, you're reading from a
pipe), all lines are cleared at once instead of being scrolled off as new lines replace old lines. The default is 0.
When no SCROLL_AGE is explicitly given, the current value from DELAY is used.
-w, --wait
This option also affects screen redrawing. When there is data ready to be put on screen, this option will cause osd_cat to wait
until the display is clear. An alternative to scrolling.
-b, --barmode=TYPE
Lets you display a percentage or slider bar instead of just text. TYPE may be percentage or slider. In this mode no text is read
from any file, but the following options can be used:
-P, --percentage=PERCENTAGE
This option specified the position of the percentage / slider bar. PERCENTAGE may be in the range from 0 to 100, the default is 50.
-T, --text=TEXT
This option specifies an optional TEXT which gets displayed above the percentage bar. The default is empty, so no additional text
is displayed.
-h, --help
display help (which is often more up to date) and exit
With no FILE, or when FILE is -, read standard input.
AUTHOR
Martijn van de Streek <martijn@foodfight.org>, Some patching done by Malcolm Valentine <farkit@iprimus.com.au> and Tim Wright
<tim@ignavus.net>.
xosd was written by Andre Renaud <andre@ignavus.net> and is maintained by Tim Wright <tim@ignavus.net>
SEE ALSO
More information on the X OSD Library and its author can be found on http://www.ignavus.net/software.html
<http://www.ignavus.net/software.html>
COPYRIGHT
It is distributed under the GNU General Public License.
X OSD cat January 2001 XOSD(1xosd)