|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Converting Unicode file to UTF8 format
Post 302347954 by blhote on Thursday 27th of August 2009 04:01:49 AM
08-27-2009
I found the command
enca
available on Linux
In my case, i installed on CentOS 4 the rpm
enca-1.9-4.el4.rf.i386.rpm
and the command gives following output
a) on a file supposed to be in UTF-8
[root@mini figari]# enca -L none ./fr/texte_titre.html
Universal transformation format 8 bits; UTF-8
b) on a file supposed to be in ISO8859-1
[root@mini figari]# enca -L none ./en/texte_accueil.html
7bit ASCII characters
(but ideally, enca should be configured with french language to help format recognition, unfortunately, french seems not to be included
)
my 2 cents
enca
available on Linux
In my case, i installed on CentOS 4 the rpm
enca-1.9-4.el4.rf.i386.rpm
and the command gives following output
a) on a file supposed to be in UTF-8
[root@mini figari]# enca -L none ./fr/texte_titre.html
Universal transformation format 8 bits; UTF-8
b) on a file supposed to be in ISO8859-1
[root@mini figari]# enca -L none ./en/texte_accueil.html
7bit ASCII characters
(but ideally, enca should be configured with french language to help format recognition, unfortunately, french seems not to be included
)my 2 cents
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I need to capture a file's creation/modification date and time and convert this to a different format, whilst I can easily get the existing format from a ls -l | awk ' { print $......}' or a cut command I do not know how to convert it to a desired format?
I should add that at present the ls -l... (1 Reply)
Discussion started by: barney_clough
1 Replies
2. Shell Programming and Scripting
How can I can convert a string in a shell script that looks something like: ]] to unicode equivalent?
thanks a lot,
webtekie (1 Reply)
Discussion started by: webtekie
1 Replies
3. UNIX for Advanced & Expert Users
:) Hi
i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error
Function i used it as
$ iconv -f UTF8 -t ANSI filename
Error iam getting is NOT Supported UTF8 to ANSI
please some help me out on this.........Let me... (1 Reply)
Discussion started by: rajreddy
1 Replies
4. UNIX for Dummies Questions & Answers
:confused: Hi
i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error
Function i used it as
$ iconv -f UTF8 -t ANSI filename
Error iam getting is NOT Supported UTF8 to ANSI
please some help me out on... (9 Replies)
Discussion started by: rajreddy
9 Replies
5. Shell Programming and Scripting
Hello,
For 2 days now i've been searching for a solution to this. I am now beginning to doubt this is even possible. It's even harder when you don't know how to search for it. (which keywords generate enough relevancy etc..)
I need to parse a config file to generate a CSV file in return.
It... (7 Replies)
Discussion started by: zer0dvide
7 Replies
6. Shell Programming and Scripting
My input file is Pipe delimited with 10 fields, I am trying to create a tab delimited output file with 6 fields from the provided input file.
Below is sample data
Input file
abc||2|PIN|num||||www.123.com|abc@123.com|
bcd||2|PIN|num|||||abc@123.com|... (3 Replies)
Discussion started by: pasupuleti81
3 Replies
7. Shell Programming and Scripting
Hi,
I am having couple of files which i used to copy from windows to Linux, so now in case of text files (CTRL^M) appears at end of line. I know i can convert this windows format file to unix format file by running dos2unix.
My requirement here is that i want to do it automatically using a... (5 Replies)
Discussion started by: sarbjit
5 Replies
8. Shell Programming and Scripting
How can I get an error when converting 3rd line, since it has invalid characters
abcde
a®cdée
a�cd�
Unicode for
® = ®
é = é
I used "iconv -f UTF-8 -t ISO-8859-15 in.txt > out.txt" (2 Replies)
Discussion started by: arunbs
2 Replies
9. Shell Programming and Scripting
Hi All,
I need help in converting the mentioned file format into desired output format using awk. Could anyone help me in this?
Below is the input..
Date Account Campaign AdGroup Keyword Conversion Revenue Var1 Var2 Var3 Var4 Var5 10 20 30 ... (8 Replies)
Discussion started by: Ravi S M
8 Replies
10. UNIX for Dummies Questions & Answers
My file format:
--------------------------------------------------
Complete Consistency Check
Valid Area : VALID:VALID
Started by : esanwad
Started at : Thu Dec 11 16:04:46 2014
CNA version : R21H04_EC08
Check range : AREA VALID/VALID
... (4 Replies)
Discussion started by: Gautam Banerjee
4 Replies
LEARN ABOUT DEBIAN
verbiste
verbiste(3) verbiste(3) NAME
verbiste - french conjugation system SYNOPSIS
g++ prog.cpp `pkg-config --cflags --libs libxml-2.0` -lverbiste-0.1 DESCRIPTION
Verbiste is a library that can conjugate French verbs given in the infinitive form and analyze conjugated French verbs. It is also a GNOME Panel applet and a GNOME application. There are two commands, named french-conjugator(1) and french-deconjugator(1), which make the library's functionality available from the command line and from scripts. The GNOME application should be available under the GNOME Applications menu. It can also be run from the command line by typing verbiste. Verbiste can also be used as a GNOME Panel applet. EXAMPLES
The library's source archive comes with Perl and Java example programs that call the french-conjugator(1) and french-deconjugator(1) com- mands. There are also example programs that use the C application programming interface. The library and the commands use verb and conjugation knowledge bases that are represented as XML files that are installed with the library (typically in /usr/share/verbiste-0.1). LICENSE
This program is free software; you may redistribute it under the terms of the GNU General Public License. This program has absolutely no warranty. AUTHOR
Pierre Sarrazin See the verbiste Home Page: http://sarrazip.com/dev/verbiste.html Comments are welcome. SEE ALSO
french-conjugator(1), french-deconjugator(1). BUGS
The FrenchVerbDictionary object is not completely destroyed when its destructor is called, in order to avoid the excessively long clean up time of its internal trie. Only one instance of this class should be created and it should be destroyed when the program quits. Version 0.1.x is an unstable development version. The programming interface of the library and the command-line options of the accompany- ing commands are not necessarily fixed. The documentation is not complete. The verb list and the conjugation templates have not been verified in detail. April 28th, 2012 verbiste(3)