11-18-2011
Convert to UTF8 File - Unix
All,
I have several *.dat files which is created in windows (ANSI Endoing) Or PC File format, once I copy those files to unix.
How can I convert those file to utf8 encoding ?
I tired iconv, it says not supported
Please help
Thanks
- S
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
:) Hi
i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error
Function i used it as
$ iconv -f UTF8 -t ANSI filename
Error iam getting is NOT Supported UTF8 to ANSI
please some help me out on this.........Let me... (1 Reply)
Discussion started by: rajreddy
1 Replies
2. UNIX for Dummies Questions & Answers
:confused: Hi
i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error
Function i used it as
$ iconv -f UTF8 -t ANSI filename
Error iam getting is NOT Supported UTF8 to ANSI
please some help me out on... (9 Replies)
Discussion started by: rajreddy
9 Replies
3. Shell Programming and Scripting
Hi,
I have a file in my desktop which is a unicode format. After this file is transferred to Unix using FTP, we are seeing some special character (like rectangle box type) at the first line. The same file is saved as UTF8 (using textpad tool, selecting encode to UTF-8 option) on my desktopand... (7 Replies)
Discussion started by: vfrg
7 Replies
4. Shell Programming and Scripting
Hello all,
I'd like to replace "," by "/" in a utf8 file from postion X to Y. Comma "," is also defined as delimiter.
12345678901234567890,123456789012345,12345678901234567890,
aaaa,aaaa,aaaaa ,bbb,bbbb,bbbbb ,cccccc,cc ,
Result should be... (1 Reply)
Discussion started by: fmofmo
1 Replies
5. Shell Programming and Scripting
Hi,
We have a couple of ms excel files in unix server.We need convert the excel files to files TAB limiter format file with using unix script.
Could you please advise on this (2 Replies)
Discussion started by: koti_rama
2 Replies
6. Shell Programming and Scripting
Asking for a Linux command line to
convert all files in current folder from UTF8 to ANSI, name unchanged.
Best Regards
Pei (3 Replies)
Discussion started by: jiapei100
3 Replies
7. UNIX Desktop Questions & Answers
we have a file that shows encoding as small-endian (in NotePad+). I can not read this file in my program. If I change it to ANSI (again in Notepad+) and save it, I am able to read it in my program.
Can I use the iconv function to change this file to ANSI ?
Thanks in advance for your help. (4 Replies)
Discussion started by: ricka360
4 Replies
8. Linux
Hey i try to create empty text file with utf-8 encoding
without success
what is the right way to do this ?
tried with
touch test.txt
iconv -f UTF-8 -t UTF-8 test.txt
or
iconv -f latin1 -t UTF-8 test.txt (8 Replies)
Discussion started by: umen
8 Replies
9. UNIX for Advanced & Expert Users
we have a CSV which i need to convert to XML using Perl or Unix shell scripting.
I was able to build this XML in oracle database. However, SQL/XML query is running for long time. Hence, I'm considering to write a Perl or shell script to generate this XML file. Basically need to build this XML... (3 Replies)
Discussion started by: laknar
3 Replies
10. Shell Programming and Scripting
I have input data looks like this which is a part of a csv file
7,1265,76548,"0102:04"
8,1266,76545,"0112:04"
I need to make the output data should look like this and the output data will be part of text file:
7|1265000 |7654899 |A|
8|12660000 |76545999 |B|
The logic behind the... (6 Replies)
Discussion started by: RJG
6 Replies
LEARN ABOUT DEBIAN
piconv
PICONV(1) Perl Programmers Reference Guide PICONV(1)
NAME
piconv -- iconv(1), reinvented in perl
SYNOPSIS
piconv [-f from_encoding] [-t to_encoding] [-s string] [files...]
piconv -l
piconv [-C N|-c|-p]
piconv -S scheme ...
piconv -r encoding
piconv -D ...
piconv -h
DESCRIPTION
piconv is perl version of iconv, a character encoding converter widely available for various Unixen today. This script was primarily a
technology demonstrator for Perl 5.8.0, but you can use piconv in the place of iconv for virtually any case.
piconv converts the character encoding of either STDIN or files specified in the argument and prints out to STDOUT.
Here is the list of options. Each option can be in short format (-f) or long (--from).
-f,--from from_encoding
Specifies the encoding you are converting from. Unlike iconv, this option can be omitted. In such cases, the current locale is used.
-t,--to to_encoding
Specifies the encoding you are converting to. Unlike iconv, this option can be omitted. In such cases, the current locale is used.
Therefore, when both -f and -t are omitted, piconv just acts like cat.
-s,--string string
uses string instead of file for the source of text.
-l,--list
Lists all available encodings, one per line, in case-insensitive order. Note that only the canonical names are listed; many aliases
exist. For example, the names are case-insensitive, and many standard and common aliases work, such as "latin1" for "ISO-8859-1", or
"ibm850" instead of "cp850", or "winlatin1" for "cp1252". See Encode::Supported for a full discussion.
-C,--check N
Check the validity of the stream if N = 1. When N = -1, something interesting happens when it encounters an invalid character.
-c Same as "-C 1".
-p,--perlqq
--htmlcref
--xmlcref
Applies PERLQQ, HTMLCREF, XMLCREF, respectively. Try
piconv -f utf8 -t ascii --perlqq
To see what it does.
-h,--help
Show usage.
-D,--debug
Invokes debugging mode. Primarily for Encode hackers.
-S,--scheme scheme
Selects which scheme is to be used for conversion. Available schemes are as follows:
from_to
Uses Encode::from_to for conversion. This is the default.
decode_encode
Input strings are decode()d then encode()d. A straight two-step implementation.
perlio
The new perlIO layer is used. NI-S' favorite.
You should use this option if you are using UTF-16 and others which linefeed is not $/.
Like the -D option, this is also for Encode hackers.
SEE ALSO
iconv(1) locale(3) Encode Encode::Supported Encode::Alias PerlIO
perl v5.14.2 2014-09-30 PICONV(1)