Linux and UNIX Man Pages

Linux & Unix Commands - Search Man Pages

tcs(1) [plan9 man page]

TCS(1)							      General Commands Manual							    TCS(1)

tcs - translate character sets SYNOPSIS
tcs [ -slcv ] [ -f ics ] [ -t ocs ] [ file ... ] DESCRIPTION
Tcs interprets the named file(s) (standard input default) as a stream of characters from the ics character set or format, converts them to runes, and then converts them into a stream of characters from the ocs character set or format on the standard output. The default value for ics and ocs is utf, the UTF encoding described in utf(6). The -l option lists the character sets known to tcs. Processing continues in the face of conversion errors (the -s option prevents reporting of these errors). The -c option forces the output to contain only cor- rectly converted characters; otherwise, 0x80 characters will be substituted for UTF encoding errors and 0xFFFD characters will substituted for unknown characters. The -v option generates various diagnostic and summary information on standard error, or makes the -l output more verbose. Tcs recognizes an ever changing list of character sets. In particular, it supports a variety of Russian and Japanese encodings. Some of the supported encodings are utf The Plan 9 UTF encoding, known by ISO as UTF-8 utf1 The deprecated original UTF encoding from ISO 10646 ascii 7-bit ASCII 8859-1 Latin-1 (Central European) 8859-2 Latin-2 (Czech .. Slovak) 8859-3 Latin-3 (Dutch .. Turkish) 8859-4 Latin-4 (Scandinavian) 8859-5 Part 5 (Cyrillic) 8859-6 Part 6 (Arabic) 8859-7 Part 7 (Greek) 8859-8 Part 8 (Hebrew) 8859-9 Latin-5 (Finnish .. Portuguese) koi8 KOI-8 (GOST 19769-74) jis-kanji ISO 2022-JP ujis EUC-JX: JIS 0208 ms-kanji Microsoft, or Shift-JIS jis (from only) guesses between ISO 2022-JP, EUC or Shift-Jis gb Chinese national standard (GB2312-80) big5 Big 5 (HKU version) unicode Unicode Standard 1.0 tis Thai character set plus ASCII (TIS 620-1986) msdos IBM PC: CP 437 atari Atari-ST character set EXAMPLES
tcs -f 8859-1 Convert 8859-1 (Latin-1) characters into UTF format. tcs -s -f jis Convert characters encoded in one of several shift JIS encodings into UTF format. Unknown Kanji will be converted into 0xFFFD char- acters. tcs -lv Print an up to date list of the supported character sets. SOURCE
/sys/src/cmd/tcs SEE ALSO
ascii(1), rune(2), utf(6). TCS(1)

Check Out this Related Man Page

auto_ef(1)							   User Commands							auto_ef(1)

auto_ef - auto encoding finder SYNOPSIS
/usr/bin/auto_ef [-e encoding_list] [-a] [-l level] [file ...] /usr/bin/auto_ef -h DESCRIPTION
The auto_ef utility identifies the encoding of a given file. The utility judges the encoding by using the iconv code conversion, determin- ing whether a certain code conversion was successful with the file, and also by performing frequency analyses on the character sequences that appear in the file. The auto_ef utility might produce unexpected output if the string is binary, a character table, a localized digit list, or a chronogram, or if the string or file is very small in size (for example, less than one 100 bytes). ASCII JIS ISO-2022-JP eucJP Japanese EUC PCK Japanese PC Kanji, CP932, Shift JIS UTF-8 Korean EUC ko_KR.euc ko_KR.cp949 Unified Hangul ISO-2022-KR ISO-2022 Korean zh_CN.iso2022-CN ISO-2022 CN/CN-EXT zh_CN.euc Simplified Chinese EUC, GB2312 GB18030 Simplified Chinese GB18030/GBK zh_TW-big5 BIG5 zh_TW-euc Traditional Chinese EUC zh_TW.hkscs Hong Kong BIG5 iso-8859-1 West European, and similar iso-8859-2 East European, and similar iso-8859-5 Cyrillic, and similar iso-8859-6 Arabic iso-8859-7 Greek iso-8859-8 Hebrew CP1250 windows-1250, corresponding to ISO-8859-2 CP1251 windows-1251, corresponding to ISO-8859-5 CP1252 windows-1252, corresponding to ISO-8859-1 CP1253 windows-1253, corresponding to ISO-8859-7 CP1255 windows-1255, corresponding to ISO-8859-8 koi8-r corresponding to iso-8859-5 By default, auto_ef returns a single, most likely encoding for text in a specified file. To get all possible encodings for the file, use the -a option. Also by default, auto_ef uses the fastest process to examine the file. For more accurate results, use the -l option. To examine data with a limited set of encodings, use the -e option. OPTIONS
The following options are supported: -a Shows all possible encodings in order of possibility, with scores in the range between 0.0 and 1.0. A higher score means a higher possibility. For example, example% auto_ef -a test_file eucJP 0.89 zh_CN.euc 0.04 ko_KR.euc 0.01 Without this option, only one encoding with the highest score is shown. -e encoding_list Examines data only with specified encodings. For example, when encoding_list is specified as "ko_KR.euc:ko_KR.cp949", auto_ef examines text only with CP949 and ko_KR.euc. Without this option, auto_ef examines text with all encodings. Multiple encodings can be specified by separating the encodings using a colon (:). -h Shows the usage message. -l level Specifies the level of judgment. The value of level can be 0, 1, 2, or 3. Level 3 produces the best result but can be slow. Level 0 is fastest but results can be less accurate than in higher levels. The default is level 0. OPERANDS
The following operands are supported: file File name to examine. EXAMPLES
Example 1 Examining encoding of a file example% auto_ef file_name Example 2 Examining encoding of a file at level 2. example% auto_ef -l 2 file_name Example 3 Examining encoding of a file with only eucJP or ko_KR.euc example% auto_ef -e "eucJP:ko_KR.euc" file_name EXIT STATUS
The following exit values are returned: 0 Successful completion 1 An error occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWautoef | +-----------------------------+-----------------------------+ |Interface Stability |See below. | +-----------------------------+-----------------------------+ Interface Stability of output format, when option -a is specified, is Evolving. Other interfaces are Stable. SEE ALSO
auto_ef(3EXT), libauto_ef(3LIB), attributes(5) International Language Environments Guide SunOS 5.11 26 Sep 2004 auto_ef(1)
Man Page