Sponsored Content
Top Forums Shell Programming and Scripting ESC[70G[ and ^M characters in text file Post 302701287 by RudiC on Saturday 15th of September 2012 12:15:22 PM
Old 09-15-2012
Good solution for the ESC sequences, but you did not remove the <carriage return> (^M, 0x0D) chars, so mail should still complain...?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read text from a file between two characters..

I have a requirement where i have to read from a .sh file a text lying bet characters like 'SELECT' & ';'...Please help me out in this. I am new to shell scripting. (2 Replies)
Discussion started by: goutam_igate
2 Replies

2. Shell Programming and Scripting

Remove special characters from text file

Hi All, i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file. I am using the following code. while read LINE do echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_" done < trial.txt > output.txt Problem ... (10 Replies)
Discussion started by: kkb
10 Replies

3. UNIX for Dummies Questions & Answers

Help with deleting characters from text file

I have a text file that looks like this: I want to delete the last character of first column in all rows so that my output looks like this: Thanks a lot! (1 Reply)
Discussion started by: evelibertine
1 Replies

4. UNIX for Dummies Questions & Answers

Any way to get rid of ^M characters in a text file using pr?

When I use vi to see what's in the file I get this: int add1(int x) {^M return x + 1;^M} ^Mint subtract1(int x) {^M return x - 1;^M} ^Mint double_it(int x) {^M return x * 2;^M} ^Mint halve_it(int x) {^Mreturn x / 2;^M} ^Mint main() {^M int myint;^M int result;^M ... (2 Replies)
Discussion started by: Nonito84
2 Replies

5. Shell Programming and Scripting

Counting 2 characters with into 2 categories from a text file

I have a tab delimited file of the following format 2 L a 2 G b 2 L c 2 G a 3 G a 3 G b 3 L c 4 L a 4 G a 4 G b 4 L c 4 G a .. ... I want to count the number of G's and L's with in the first column and the third column/categories such that I would get an output file: (6 Replies)
Discussion started by: Lucky Ali
6 Replies

6. Shell Programming and Scripting

Check if the text file has more than 2 characters

Guys, I know that the below command will cut the 13th field from test.txt file awk -F"|" '{print $13}' test.txt The answer would be, CA CN Ohio If we see the 3 rd one, it has more than 2 characters. So i wanted to check this in if condition and i want to get the output if the 13th... (4 Replies)
Discussion started by: AraR87
4 Replies

7. UNIX for Dummies Questions & Answers

^H characters appear when opening text file using vi - RHEL

Version Info: $ cat /etc/redhat-release Red Hat Enterprise Linux Server release 5.8 (Tikanga) $ $ uname -a Linux stryker138 2.6.18-308.13.1.el5 #1 SMP Thu Jul 26 05:45:09 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux I redirected manpage of ksh command's output to a text file as shown... (6 Replies)
Discussion started by: kraljic
6 Replies

8. Shell Programming and Scripting

Remove all junk characters from a text file

I am using flatfile, in that flat file we are getting the junk chars 1)I21001f<82>^Me<85>!h49 Service Charge 2) I21001f‚ e...!h49 Service Charge please tell me how to remove all junk chars in unix scripts. (1 Reply)
Discussion started by: Talari
1 Replies

9. UNIX for Dummies Questions & Answers

How to enter special characters in a text file using vi?

Hi, I need to create a test text file with the special characters \342\200\223 in it and to be able to use sed maybe to delete them I tried doing it using vi by pressing CTRL-V and then typing 342 but it does not work. After pressing CTRL-V and typing 342 it seems to just insert the numbers... (1 Reply)
Discussion started by: newbie_01
1 Replies

10. UNIX for Beginners Questions & Answers

File name starts with esc character.

How can I refer to a file named esc[G ? I need to delete it or move it. TIA (5 Replies)
Discussion started by: wbport
5 Replies
jiskanji(5)							File Formats Manual						       jiskanji(5)

NAME
jiskanji, jiskanji7, JIS7 - A character encoding system (codeset) for Japanese DESCRIPTION
JIS Kanji is a codeset that uses the JIS X0202 symbol extension method for encoding the JIS X0208 and JIS X0201 character sets. There are two types of JIS Kanji encoding: 7-bit JIS Kanji code and 8-bit JIS Kanji code. 7-bit JIS Kanji Code In 7-bit JIS Kanji encoding, all character values are 7-bit bytes. Characters are interpreted according to preceding in and out sequences as follows: Kanji in sequence (ESC $ B) The code values following the Kanji in sequence (ESC $ B) are treated as characters in the JIS X0208 Kanji character set. Kanji out sequence (ESC ( B) The code values following the Kanji out sequence (ESC ( B) are treated as ASCII characters. Supplementary Kanji in sequence (ESC $ ( D) The code values following the supplementary Kanji in sequence (ESC $ ( D) are treated as characters in the JIS X0212 supplementary Kanji character set. User-Defined Character (UDC) in sequence (ESC $ ( 0) The code values following the UDC in sequence (ESC $ ( 0) are treated as characters in the vendor-defined or user-defined character set. Kana in (SO) and Kana out (SI) sequences The code values following SO(0x0e) and preceding SI(0x0f) are treated as characters in the JIS X0201 Katakana character set. Katakana in sequence (ESC ( I) Code values following the Katakana in sequence (ESC ( I) are treated as characters in the JIS X0201 Katakana character set. In this case, the Kanji out sequence is used to switch back to ASCII code. The Katakana in and Kanji out sequences are an alternative to using the Kana in and out sequences (SO/SI). 8-bit JIS Kanji Code In 8-bit JIS Kanji encoding, the JIS X0201 Katakana characters are represented as 8-bit bytes. Using this form of encoding, in and out sequences have the following effect: Kanji in sequence (ESC $ B) Code values following the Kanji in sequence (ESC $ B) are treated as characters in the JIS X0208 Kanji character set. Supplementary Kanji in sequence (ESC $ ( D) Code values following the supplementary Kanji in sequence (ESC $ ( D) are treated as characters in the JIS X0212 supplementary Kanji character set. User-Defined Character (UDC) in sequence (ESC $ ( 0) Code values following the UDC in sequence (ESC $ ( 0) are treated as vendor-defined or user-defined characters. Kanji out sequence (ESC ( B) Code values following the Kanji out sequence (ESC ( B) are treated as ASCII characters. Kana in and out sequences (SI/SO) These sequences are ignored. Codeset Conversion The following codeset converter pairs are available for converting Japanese characters between jiskanji7 or JIS7 and other encoding for- mats. The RESTRICTIONS section discusses some conversion limitations that apply to these converters. Refer to iconv_intro(5) for an introduction to codeset conversion. For more information about the other codeset for which jiskanji7 or JIS7 is the input or output, see the reference page specified in the list item. deckanji_jiskanji7 or deckanji_JIS7, jiskanji7_deckanji or JIS7_deckanji Converting from and to the DEC Kanji codeset: deckanji(5). eucJP_jiskanji7 or eucJP_JIS7, jiskanji7_eucJP or JIS7_eucJP Converting from and to Japanese Extended UNIX Code: eucJP(5). eucTW_jiskanji7 or eucTW_JIS7, jiskanji7_eucTW or JIS7_eucTW Converting from and to Taiwanese Extended UNIX Code: eucTW(5). sdeckanji_jiskanji7 or sdeckanji_JIS7, jiskanji7_sdeckanji or JIS7_sdeckanji Converting from and to the Super DEC Kanji codeset: sdeckanji(5). SJIS_jiskanji7 or SJIS_JIS7, jiskanji7_SJIS or JIS7_SJIS Converting from and to Shift JIS format: SJIS(5). Shift JIS encoding format is identical to encoding in Microsoft code-pages used on PC systems. Therefore, you can use these convert- ers to convert Japanese characters between JIS Kanji and PC code-page format. For general information on how the operating system supports PC code pages, see code_page(5). RESTRICTIONS
The JIS Kanji codeset is not supported directly by a locale but through code conversion (through the iconv utility, Japanese terminal (tty) code conversion, and so forth). In the codeset naming conventions used by the iconv utility, the string JIS7 indicates 7-bit JIS Kanji code that follows a Katakana in sequence and the string jiskanji7 indicates 7-bit JIS Kanji code entered between Kana in and out sequences. The following sequences are valid for input to the iconv utility but are not generated when code is converted to jiskanji7: Kanji in (ESC $ @) Kanji in (ESC & @ ESC $ B) Kanji in (ESC $ ( B) Kanji in (ESC $ ( @) Supplementary Kanji in (ESC $ D) Kana in (ESC ( J) Kana in (ESC ( H) In the code naming conventions of the Japanese terminal, the string jis7 indicates 7-bit JIS Kanji code and the string jis8 indicates 8-bit JIS Kanji code. When the terminal code is set to jis7, the Kana in and out sequences (SI/SO) are used for JIS X0201 Katakana character rep- resentation. SEE ALSO
Commands: locale(1) Others: ascii(5), code_page(5), deckanji(5), eucJP(5), i18n_intro(5), i18n_printing(5), iconv_intro(5), iso2022jp(5), Japanese(5), l10n_intro(5), sdeckanji(5), shiftjis(5) jiskanji(5)
All times are GMT -4. The time now is 11:24 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy