Sponsored Content
Full Discussion: iconv and xmllint
Top Forums UNIX for Advanced & Expert Users iconv and xmllint Post 302139354 by matrixmadhan on Friday 5th of October 2007 01:57:16 PM
Old 10-05-2007
iconv and xmllint

Here is my question,

volume of records processed : 5M ( approx )

Its basically very simple operation that am trying to do and I had achieved the output that am interested. What am looking for really is to improve the performance, an optimized way to do that.

with respect to iconv, am checking each of the records whether they can be converted from encoding format ' ef1 ' to another encoding format ' ef2 '.
For this, I take one record at a time and apply ' iconv ' command. With the return value ' $? ' its validated whether it could be converted to another encoding format or not

similarly with respect to xmllint, am creating a xml file and validating against the XSD's conformance.

As said earlier, these are simple operations and need your thoughts / input to improve the efficiency.

Is there a better way of doing these operations when the volume of records is really huge ( 5M ) ?
 

10 More Discussions You Might Find Interesting

1. Programming

about iconv

I want to use iconv.h to convert some text to another charset. The code is below: #include <stdio.h> #include <stdlib.h> #include <iconv.h> int main() { iconv_t cd; char instr="汉字"; char *inbuf; char *outbuf; unsigned int insize=7; ... (4 Replies)
Discussion started by: yong
4 Replies

2. Shell Programming and Scripting

xmllint output to a file

Hello All, I have an XML file which has some errors in its tag definition according to an xsd. When i validate this xml file against an xsd, i wish to only take the errors in a file and not the complete xml. for eg. Raman.xml has some errors induced in it. RamanValidator.xsd holds the schema... (5 Replies)
Discussion started by: damansingh
5 Replies

3. Shell Programming and Scripting

XMLLINT COMMAND IN UNIX TO VALIDATE XML AGAINST XSD

Hi i am baby to unix shell script. how do i validate xml agaist xsd and transforms xml using xslt. Thanks Mohan (2 Replies)
Discussion started by: mohan.cheepu
2 Replies

4. Shell Programming and Scripting

Help with iconv command

Hi , I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character. But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (0 Replies)
Discussion started by: Shruthi8818
0 Replies

5. UNIX for Dummies Questions & Answers

Help with iconv command

Hi , I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character. But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (2 Replies)
Discussion started by: Shruthi8818
2 Replies

6. UNIX for Dummies Questions & Answers

Xmllint pretty print, batch files

I have about 20 xml files I want to use xmllint to pretty print: xmllint --format file01.xml > pretty_file01.xml xmllint --format file02.xml > pretty_file02.xml etc Is there a way I can just use "xmllint --format" on all the current xml files so I don't have to run this command 20 times?? :( (5 Replies)
Discussion started by: pxalpine
5 Replies

7. Shell Programming and Scripting

Parse XML using xmllint

Hi All, Need help to parse the xml file in shell script using xmllint. Below is the sample xml file. <CARS> <AUDI> <Speed="45"/> <speed="55"/> <speed="75"/> <speed="95"/> </AUDI> <BMW> <Speed="30"/> <speed="75"/> <speed="120"/> <speed="135"/> </BMW>... (6 Replies)
Discussion started by: prasanna2166
6 Replies

8. Shell Programming and Scripting

Help with xmllint

Have like 50 xml files in a folder. They all have a Node named <Number>.How to display the values of <Number> with the count and filename in the folder. I am using Mac . (7 Replies)
Discussion started by: Anethar
7 Replies

9. Shell Programming and Scripting

Xmllint: get one result per line

Hi, I'm trying to get some values from an xmlfile and want be able to process them. I'm using xmllint(v20901 on debian jessie) and this program directly outputs all results concatenated right after each other. I did not find a solution in the man page to get a different format or some output... (2 Replies)
Discussion started by: stomp
2 Replies

10. Shell Programming and Scripting

Xmllint parser error : EntityRef: expecting ';'

Hi I have an XML file which contains html urls in that node values. When i use xmllint to parse that, i am getting error (because of the sympols in the url). i have used --html option but it throws other tag errors. Please guide me. sample file.xml <abc> <bcd> <cde> <a>sometext</a>... (2 Replies)
Discussion started by: ananan
2 Replies
MANCONV(1)							Manual pager utils							MANCONV(1)

NAME
manconv - convert manual page from one encoding to another SYNOPSIS
manconv -f from-code[:from-code...] -t to-code [-dq] [filename] DESCRIPTION
manconv converts a manual page from one encoding to another, like iconv. Unlike iconv, it can try multiple possible input encodings in sequence. This is useful for manual pages installed in directories without an explicit encoding declaration, since they may be in UTF-8 or in a legacy character set. If an encoding declaration is found on the first line of the manual page, that declaration overrides any input encodings specified on man- conv's command line. Encoding declarations have the following form: '" -*- coding: UTF-8 -*- or (if manual page preprocessors are also to be declared): '" t -*- coding: ISO-8859-1 -*- OPTIONS
-f encodings, --from-code encodings Try each of encodings (a colon-separated list) in sequence as the input encoding. -t encoding, --to-code encoding Convert the manual page to encoding. -q, --quiet Do not issue error messages when the page cannot be converted. -d, --debug Print debugging information. -h, --help Print a help message and exit. -V, --version Display version information. SEE ALSO
man(1), iconv(1). AUTHOR
Colin Watson (cjwatson@debian.org). 2.5.2 2008-05-05 MANCONV(1)
All times are GMT -4. The time now is 06:52 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy