01-04-2013
Well, utf-8 and unicode have a pattern in their encoding. The dd command has an ebcdic decoder I have used. Might it be from big blue land?
Googling around the subject, one suggests file -i, another mentions enca
http://linux.die.net/man/1/enca and for solaris, auto_ef. There is a 'chardet' python based tool.
Last edited by DGPickett; 01-04-2013 at 04:35 PM..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
1. I have a shell script which creates a file using cat command. How can i find what encoding the file follows (e.g. UTF8, ANSI)?
2. I want to convert that file to PC-ANSI format. How can i achieve that?
I am using HP-Unix. (6 Replies)
Discussion started by: ssmallya
6 Replies
2. Shell Programming and Scripting
Hello!
The system is AIX 5.3
Give please command or script to get the file encoding
Thanks (2 Replies)
Discussion started by: vinment
2 Replies
3. AIX
Hello!
The system is AIX 5.3
Give please command or script to get the file encoding (1 Reply)
Discussion started by: vinment
1 Replies
4. Shell Programming and Scripting
hi,
In my project i cannot determine the number of check list initially... I will know dynamically during execution... so How to specify the number of check list dynamically in zenity
Waiting for your precious Answer..... (1 Reply)
Discussion started by: shivarajM
1 Replies
5. Shell Programming and Scripting
Hi,
I have got a zip (binary) file transferred from MacOS (thus it has additional __MACOSX directory packed inside). On extracting this zip, there are few *.xml files available. When I opened this *.xml file in vim editor using Cygwin (on windows) the editor displayed in the bottom. I tried... (4 Replies)
Discussion started by: royalibrahim
4 Replies
6. HP-UX
how to find the character encoding of a file in hp_ux (1 Reply)
Discussion started by: alokjyotibal
1 Replies
7. Shell Programming and Scripting
Hi,
I am beginner to Unix.
My requirement is to validate the encoding used in the incoming file(csv,txt).If it is encoded with UTF-8 format,then the file should remain as such otherwise i need to chnage the encoding to UTF-8.
Please advice me how to proceed on this. (7 Replies)
Discussion started by: cnraja
7 Replies
8. HP-UX
Hi Experts,
Need your advise in determining the size of swap space in of the new HP-Ux server.
Server is having 32G of physical memory.
Ideally what amout of physical memory should be allocated as a swap space?
Following document from HP suggests to have minimum swap space... (2 Replies)
Discussion started by: sai_2507
2 Replies
9. Solaris
Hi all!!
I´m using command file -i myfile.xml to validate XML file encoding, but it is just saying regular file . I´m expecting / looking an output as UTF8 or ANSI / ASCII
Is there command to display the files encoding?
Thank you! (2 Replies)
Discussion started by: mrreds
2 Replies
10. Shell Programming and Scripting
how can i know what format a file is
* example:
UTF-8
ANSI
UCS2
i am in a... (8 Replies)
Discussion started by: tricampeon81
8 Replies
LEARN ABOUT PHP
sqlite_libencoding
SQLITE_LIBENCODING(3) SQLITE_LIBENCODING(3)
sqlite_libencoding - Returns the encoding of the linked SQLite library
SYNOPSIS
string sqlite_libencoding (void )
DESCRIPTION
The SQLite library may be compiled in either ISO-8859-1 or UTF-8 compatible modes. This function allows you to determine which encoding
scheme is used by your version of the library.
Warning
The default PHP distribution builds libsqlite in ISO-8859-1 encoding mode. However, this is a misnomer; rather than handling
ISO-8859-1, it operates according to your current locale settings for string comparisons and sort ordering. So, rather than
ISO-8859-1, you should think of it as being ' 8-bit' instead.
When compiled with UTF-8 support, sqlite handles encoding and decoding of UTF-8 multi-byte character sequences, but does not yet do a com-
plete job when working with the data (no normalization is performed for example), and some comparison operations may still not be carried
out correctly.
Warning
It is not recommended that you use PHP in a web-server configuration with a version of the SQLite library compiled with UTF-8 sup-
port, since libsqlite will abort the process if it detects a problem with the UTF-8 encoding.
RETURN VALUES
Returns the library encoding.
SEE ALSO
sqlite_lib_version(3).
PHP Documentation Group SQLITE_LIBENCODING(3)