Sponsored Content
Full Discussion: Best way to go about this?
Homework and Emergencies Emergency UNIX and Linux Support Best way to go about this? Post 302706909 by stevensw on Thursday 27th of September 2012 03:47:35 PM
Old 09-27-2012
Best way to go about this?

I am processing a very large file, which is a text csv report of a database.

I would like to parse this csv file into a bunch of XML files.

I am trying to decide the most efficient way to go about doing this.

Should I open all the XML files at the same time, and as I encounter data I write to whichever descriptor? This approach would only require iterating through the csv file once. But I would be maintaining a bunch of descriptors at the same time, is that efficient?

Should I open and close a descriptor each time I need to write a piece of information to one of the XML files? This approach would also only require iterating through the csv file once. But I would be constantly opening and closing descriptors.

Should I fill out each XML file one at a time, iterating through the whole csv file each time?

Help much appreciated.
 
XML2(1) 						      General Commands Manual							   XML2(1)

NAME
xml2 - convert xml documents in a flat format 2xml - convert flat format into xml html2 - convert html documents in a flat format 2html - convert flat format into html csv2 - convert csv files in a flat format 2csv - convert flat format into csv SYNOPSIS
<xml2|2xml|html2|2html|csv2|2csv> > outfile < infile DESCRIPTION
There are six tools. Except csv2 and and 2csv they don't take any command-line arguments. They are all simple filters which can be used to read files from standard input in one format and output it to standard output in another format. The flat format used by the tools is specific to these tools. It is a syntax for representing structured markup in a way that makes it easy to process with line-oriented tools. The same format is used for HTML and XML; in fact, you can think of html2 as converting HTML to XHTML and running xml2 on the result; likewise 2html and 2xml. (Of course, this isn't how the implementation works.) SEE ALSO
This program does normally not include any documentation in form of manpages. However it has a real excellent documentation online with a lot of example. In fact this manpage was based on this documentation. Please find it on: http://dan.egnor.name/xml2/ref Examples can be found here: http://dan.egnor.name/xml2/examples AUTHOR
xml2 was written by Dan Egnor. This manpage was written by Patrick Schoenfeld <schoenfeld@in-medias-res.com> for the Debian project, but may be used by others under the same terms as xml2 is distributed. BUGS
Bugs can be reported through the Debian Bug tracking system. 7h february 2008 XML2(1)
All times are GMT -4. The time now is 03:50 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy