Sponsored Content
Top Forums Shell Programming and Scripting extra character with iconv encoding Post 302530936 by fpmurphy on Wednesday 15th of June 2011 11:31:08 AM
Old 06-15-2011
Quote:
Originally Posted by yazu
It's alright. Change coding on your terminal or in your editor to shift_jis and you can see "pure" Cyrillic letters. Sometimes you can see ツ (like so ツА ツБ ツВ ツГ ツД ツИ ツЙ ツК ツЛ) - it's the leading symbol for Cyrillic (and some another) letters.
Out of curiosity, why did you recommend changing to Shift-JS which is a Japanese language encoding? CP866 does not map to Shift-JS. The single-byte characters from 0xA1 to 0xDF map to the half-width katakana characters in JIS X 0201.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

iconv -l and ANSEL character set

I am forced to use the ANSEL character set for some GEDCOM documents but must convert them to a more modern set for another app which doesn't recognize ANSEL. I am unable to locate an ISO code for ANSEL in a search of the web. Would someone plese identify the ANSEL character set from the list given... (4 Replies)
Discussion started by: Whiterock
4 Replies

2. UNIX for Dummies Questions & Answers

character encoding in Fedora6

Hello, After upgrading the OS from Fedora4 to Fedora6, the firefox view>character encoding doesn't work anymore. None of the foreign characters can be displayed, no matter what character encoding to select. Any suggestions? Thanks, bsky :confused (1 Reply)
Discussion started by: bsky
1 Replies

3. AIX

Vacation message character encoding

I am trying to send a vacation message (.vacation.msg) from my AIX 5.3 server. Message is UTF-8 characters. Some email clients (like apple mail) have no problems displaying the correct text, however, some, like Windows Outlook, display garbage. Is there a way of forcing the client to use proper... (0 Replies)
Discussion started by: lanny
0 Replies

4. Shell Programming and Scripting

sort file adding extra character

HI all i have this script : #!/bin/bash sort /usr/tmp/"REPORT"$1 -o \ /usr/tmp/"SREPORT"$1 -k 1,7 -S 150 end of script now i'm doing this command : ls -lsgt *REPORT* 4 -rw-r--r-- 300 Sep 16 REPORT54784 4 -rw-r--r-- 301 Sep 16 SREPORT54784 as you can see the sorted file... (5 Replies)
Discussion started by: naamas03
5 Replies

5. Shell Programming and Scripting

how to delete extra character in a line?

And I want to delete the characters longer than 20 for each line start with #. The other lines should remain the same. I think this can be done by sed. Could anyone help me with this? Thanks! my input file: #ZP_05494889.1_Clostridium_papyrosolvens... (3 Replies)
Discussion started by: ritacc
3 Replies

6. Shell Programming and Scripting

Remove extra character

Hi I am using cat <filename> command in one of my datastage job(Command Activity). It is giving actual value but giving extra line. Eg: Displayed Output: 1 and showing extraline(Eg: 1 ) I had checked even wc -c it is giving one character extra. If the file contains 11. wc -c says 3. ... (3 Replies)
Discussion started by: cnrj
3 Replies

7. HP-UX

how to find the character encoding of a file in hp_ux

how to find the character encoding of a file in hp_ux (1 Reply)
Discussion started by: alokjyotibal
1 Replies

8. Shell Programming and Scripting

Awk while-loop printing extra character

Hi, I'm using a while-loop in an awk script. If it matches a regular expression, it prints a line. Unfortunately, each line that is printed in this loop is followed by an extra character, "1". While-statement extracted from my script: getline temp; while (temp ~ /.* x .*/) print temp... (3 Replies)
Discussion started by: redbluefish
3 Replies

9. Solaris

connect to ILOM via ssh character encoding

Hello all, I am connecting to ILOM using ssh client (putty) but when RedHat start booting everything look chinese for me... Probably i have to configure the character set, i tried also utf-8 but the issue remain. Any idea? Thanks in advance (0 Replies)
Discussion started by: @dagio
0 Replies

10. Shell Programming and Scripting

sed removing extra character from end

Hi, Searching through forum I found "sed 's/*$//'" can be used to remove trailing whitespaces and tabs from file. The command works fine but I see minor issue as below. Can you please suggest if I am doing something wrong here. $ cat a.txt upg_prod_test upg_prod_new $ cat a.txt |sed... (11 Replies)
Discussion started by: bhupinder08
11 Replies
shiftjis(5)							File Formats Manual						       shiftjis(5)

NAME
shiftjis, SJIS - A character encoding system (codeset) for Japanese DESCRIPTION
The Shift JIS (SJIS) codeset consists of the following character sets: JIS X0201 JIS X0208 User-Defined Characters (UDC) Shift JIS Encoding Shift JIS character codes use a combination of single-byte data and 2-byte data to represent characters defined in the JIS X0201 and JIS X0208 standards and in the UDC area. All JIS X0201 characters are represented in the form of single-byte data. The Roman letters in JIS X0201 are encoded by setting the most significant bit (MSB) of each byte to off, while the Katakana characters are encoded by setting the most significant bit (MSB) of each byte to on. For more information on JIS X0201 characters, refer to deckanji(5). In the Super DEC Kanji codeset, the code ranges for JIS X0201 characters are as follows: For Roman letters, 00 to 7F For Katakana characters, A1 to DF JIS X0208 characters are encoded in 2-byte values. The values for the first bytes are encoded so that they fall outside the range of byte values for JIS X0201 characters (in other words, the JIS X0208 first byte ranges are from 81 to 9F and from E0 to FC). In this manner, characters from the two different standards can be supported by the same codeset. The range for the second byte of a JIS X0208 character is 40 to FC (except for 7F). For more information on JIS X0208 characters, refer to deckanji(5). The Shift JIS codeset provides for 2444 UDC characters. These are encoded as 2-byte values whose code range is F040 to FCFC. Font Support for Super DEC Kanji For display devices, the operating system supports Super DEC Kanji encoding by conversion to DEC Kanji encoding and then using fonts avail- able for DEC Kanji. Refer to the iconv_intro(5) reference page for information on codeset conversion. For printers, the operating system supports only printer-resident fonts; therefore, Super DEC Kanji fonts cannot be dynamically loaded to a printer. For general information on printing non-English text, refer to i18n_printing(5). SEE ALSO
Commands: locale(1) Others: ascii(5), deckanji(5), eucJP(5), i18n_intro(5), i18n_printing(5), iconv_intro(5), iso2022jp(5), Japanese(5), jiskanji(5), l10n_intro(5), sdeckanji(5) shiftjis(5)
All times are GMT -4. The time now is 01:23 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy