10-05-2007
iconv and xmllint
Here is my question,
volume of records processed : 5M ( approx )
Its basically very simple operation that am trying to do and I had achieved the output that am interested. What am looking for really is to improve the performance, an optimized way to do that.
with respect to iconv, am checking each of the records whether they can be converted from encoding format ' ef1 ' to another encoding format ' ef2 '.
For this, I take one record at a time and apply ' iconv ' command. With the return value ' $? ' its validated whether it could be converted to another encoding format or not
similarly with respect to xmllint, am creating a xml file and validating against the XSD's conformance.
As said earlier, these are simple operations and need your thoughts / input to improve the efficiency.
Is there a better way of doing these operations when the volume of records is really huge ( 5M ) ?
10 More Discussions You Might Find Interesting
1. Programming
I want to use iconv.h to convert some text to another charset.
The code is below:
#include <stdio.h>
#include <stdlib.h>
#include <iconv.h>
int main()
{
iconv_t cd;
char instr="汉字";
char *inbuf;
char *outbuf;
unsigned int insize=7;
... (4 Replies)
Discussion started by: yong
4 Replies
2. Shell Programming and Scripting
Hello All,
I have an XML file which has some errors in its tag definition according to an xsd. When i validate this xml file against an xsd, i wish to only take the errors in a file and not the complete xml. for eg.
Raman.xml has some errors induced in it.
RamanValidator.xsd holds the schema... (5 Replies)
Discussion started by: damansingh
5 Replies
3. Shell Programming and Scripting
Hi
i am baby to unix shell script. how do i validate xml agaist xsd and transforms xml using xslt.
Thanks
Mohan (2 Replies)
Discussion started by: mohan.cheepu
2 Replies
4. Shell Programming and Scripting
Hi ,
I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character.
But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (0 Replies)
Discussion started by: Shruthi8818
0 Replies
5. UNIX for Dummies Questions & Answers
Hi ,
I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character.
But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (2 Replies)
Discussion started by: Shruthi8818
2 Replies
6. UNIX for Dummies Questions & Answers
I have about 20 xml files I want to use xmllint to pretty print:
xmllint --format file01.xml > pretty_file01.xml
xmllint --format file02.xml > pretty_file02.xml
etc
Is there a way I can just use "xmllint --format" on all the current xml files so I don't have to run this command 20 times?? :( (5 Replies)
Discussion started by: pxalpine
5 Replies
7. Shell Programming and Scripting
Hi All,
Need help to parse the xml file in shell script using xmllint. Below is the sample xml file.
<CARS>
<AUDI>
<Speed="45"/>
<speed="55"/>
<speed="75"/>
<speed="95"/>
</AUDI>
<BMW>
<Speed="30"/>
<speed="75"/>
<speed="120"/>
<speed="135"/>
</BMW>... (6 Replies)
Discussion started by: prasanna2166
6 Replies
8. Shell Programming and Scripting
Have like 50 xml files in a folder. They all have a Node named <Number>.How to display the values of <Number> with the count and filename in the folder. I am using Mac . (7 Replies)
Discussion started by: Anethar
7 Replies
9. Shell Programming and Scripting
Hi,
I'm trying to get some values from an xmlfile and want be able to process them. I'm using xmllint(v20901 on debian jessie) and this program directly outputs all results concatenated right after each other. I did not find a solution in the man page to get a different format or some output... (2 Replies)
Discussion started by: stomp
2 Replies
10. Shell Programming and Scripting
Hi
I have an XML file which contains html urls in that node values. When i use xmllint to parse that, i am getting error (because of the sympols in the url). i have used --html option but it throws other tag errors.
Please guide me.
sample file.xml
<abc>
<bcd>
<cde>
<a>sometext</a>... (2 Replies)
Discussion started by: ananan
2 Replies
MANCONV(1) Manual pager utils MANCONV(1)
NAME
manconv - convert manual page from one encoding to another
SYNOPSIS
manconv -f from-code[:from-code...] -t to-code [-dq] [filename]
DESCRIPTION
manconv converts a manual page from one encoding to another, like iconv. Unlike iconv, it can try multiple possible input encodings in
sequence. This is useful for manual pages installed in directories without an explicit encoding declaration, since they may be in UTF-8 or
in a legacy character set.
If an encoding declaration is found on the first line of the manual page, that declaration overrides any input encodings specified on man-
conv's command line. Encoding declarations have the following form:
'" -*- coding: UTF-8 -*-
or (if manual page preprocessors are also to be declared):
'" t -*- coding: ISO-8859-1 -*-
OPTIONS
-f encodings, --from-code encodings
Try each of encodings (a colon-separated list) in sequence as the input encoding.
-t encoding, --to-code encoding
Convert the manual page to encoding.
-q, --quiet
Do not issue error messages when the page cannot be converted.
-d, --debug
Print debugging information.
-h, --help
Print a help message and exit.
-V, --version
Display version information.
SEE ALSO
man(1), iconv(1).
AUTHOR
Colin Watson (cjwatson@debian.org).
2.5.2 2008-05-05 MANCONV(1)