Sponsored Content
Full Discussion: Help with iconv command
Top Forums Shell Programming and Scripting Help with iconv command Post 302570684 by Shruthi8818 on Friday 4th of November 2011 04:46:33 AM
Old 11-04-2011
Help with iconv command

Hi ,

I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character.
But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the conversion it is working.

Please let me know how this iconv command works.
And also any way by which this error can be resolved.

Thanks,
Shruthi

Last edited by Scott; 11-04-2011 at 05:50 AM.. Reason: Double post. Closed.
 

10 More Discussions You Might Find Interesting

1. Programming

about iconv

I want to use iconv.h to convert some text to another charset. The code is below: #include <stdio.h> #include <stdlib.h> #include <iconv.h> int main() { iconv_t cd; char instr="汉字"; char *inbuf; char *outbuf; unsigned int insize=7; ... (4 Replies)
Discussion started by: yong
4 Replies

2. UNIX for Advanced & Expert Users

iconv and xmllint

Here is my question, volume of records processed : 5M ( approx ) Its basically very simple operation that am trying to do and I had achieved the output that am interested. What am looking for really is to improve the performance, an optimized way to do that. with respect to iconv, am... (3 Replies)
Discussion started by: matrixmadhan
3 Replies

3. Shell Programming and Scripting

calling iconv from within a script

hi, i am new to unix shell scripting and really desparate about this, so i appreciate any help on this matter. it maybe something obvious as well. two different scripts, the first one is working fine, the second one is not: #!/bin/bash if then echo "usage: $0 <Input file> <Output... (1 Reply)
Discussion started by: ssulger
1 Replies

4. Shell Programming and Scripting

initial setup for iconv

hi I am trying iconv on my linux machine for conversion of RUSSIAN to ENGLISH, but i am not able to get exact result. i want to know what initial setting in linux machine we need to do to get desired output I created sample russian file using google translate in CP866 endcoding and full... (5 Replies)
Discussion started by: peeyushgehlot
5 Replies

5. UNIX for Dummies Questions & Answers

Help with iconv command

Hi , I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character. But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (2 Replies)
Discussion started by: Shruthi8818
2 Replies

6. Shell Programming and Scripting

Characterset conversion problem using iconv command

Hi Friends, I am not able to conver character set from UTF-8 to IBM-284 throwing an error "cannot open convertor" . Could you please help me how to get out of this error. Below command is working fine iconv -f ISO8859-15 -t UTF-8 fromfile.txt > tofile.txt But the below command is... (2 Replies)
Discussion started by: sivakumarl
2 Replies

7. Shell Programming and Scripting

Help with command iconv

I need to convert a utf16 file to utf8. When i use the iconv command to do so it gives an error saying invalid function. When I ran the iconv -l function it did not list the utf16 and utf8 as part of its internal table. Is there anyway I can add these encodings in the library? Is there any other... (3 Replies)
Discussion started by: gaun
3 Replies

8. Shell Programming and Scripting

Iconv for large files

Hi I am using iconv command to convert the encoding of files. Below is the command used: iconv -f UCS-2 -t UTF-8 inputfile.txt> outputfile.txt The command is working fine for files less than 2GB. When I try converting the files of more than 2GB size I get an error as 'Can't open file'. I... (2 Replies)
Discussion started by: vrcr
2 Replies

9. UNIX for Advanced & Expert Users

Iconv on large files

Hi All, I am using iconv to convert huge files. the process is getting killed. I tried the option in below link https://www.unix.com/shell-programming-and-scripting/258825-iconv-large-files.html i.e iconv -f UCS-2 -t UTF-8 < inputfile.txt > outputfile.txt However, the process still gets... (4 Replies)
Discussion started by: tostay2003
4 Replies

10. UNIX for Beginners Questions & Answers

Explain iconv command

I have a requirement to remove all non-ascii characters from a fixed length file. I used the below command which is removing special characters but somehow the total record length is being truncated to one space less. If it is a multi-byte string then many characters at the end are being truncated.... (8 Replies)
Discussion started by: eskay
8 Replies
iconv(1)						      General Commands Manual							  iconv(1)

NAME
iconv - Converts encoded characters to another codeset SYNOPSIS
iconv -f from_code -t to_code [file...] STANDARDS
Interfaces documented on this reference page conform to industry standards as follows: iconv: XCU5.0 Refer to the standards(5) reference page for more information about industry standards and associated tags. OPTIONS
Specifies the input codeset. Specifies the output codeset. OPERANDS
Specifies one or more files that contain the data to be converted. If this operand is omitted, the standard input is used. DESCRIPTION
The iconv command converts the encoding of characters in file from one coded character set to another and writes the results to standard output. The input and output coded character sets are identified by from_code and to_code. If the file operand is not specified on the command line, the iconv command reads the standard input. The result of specifying invalid characters in the input stream is that the input value is translated to the substitute character. [Tru64 UNIX] Current industry standards do not specify the name format, implementation, and location of the codeset converters used by this command. On this operating system, the command searches directories of algorithmic and table converters to find one that performs the requested conversion. The names of codeset converters adhere to the following format: fromcode_tocode EXIT STATUS
Success. An error occurred. ERRORS
[Tru64 UNIX] You can view the diagnostic messages that may be returned by the iconv command by entering the following commands: cd /usr/lib/nls/msg/en_US.ISO8859-1 dspcat iconv.cat EXAMPLES
The following examples use the iconv command: To convert the contents of the eucJP_data file from the eucJP to the SJIS codeset and save the results in the sjis_data file, enter: iconv -f eucJP -t SJIS eucJP_data > sjis_data To convert the contents of the eucJP_data file from the eucJP codeset to the UCS-4 codeset and save the results in the UCS_4_data file, enter: iconv -f eucJP -t UCS-4 eucJP_data > UCS_4_data ENVIRONMENT VARIABLES
The following environment variables (see i18n_intro(5) and l10n_intro(5)) affect the execution of the iconv command: Specifies a default value for the locale category variables that are not set. If set to a nonempty string value, overrides the values of all other locale variables, including LANG. Determines the locale for interpreting byte sequences as characters in, for example, command parameters. Spec- ifies the locale used to find translations, if any, for the command's message catalogs. [Tru64 UNIX] Specifies the search path used to find locales and the subdirectories that contain codeset converters. The default is /usr/lib/nls/loc. Determines the location of message catalogs for the processing of LC_MESSAGES. FILES
[Tru64 UNIX] Algorithmic converters. [Tru64 UNIX] Table converters. SEE ALSO
Commands: genxlt(1) Functions: iconv(3), iconv_close(3), iconv_open(3) Others: i18n_intro(5), iconv_intro(5), l10n_intro(5), standards(5) Writing Software for the International Market iconv(1)
All times are GMT -4. The time now is 07:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy