Today (Saturday) We will make some minor tuning adjustments to MySQL.

You may experience 2 up to 10 seconds "glitch time" when we restart MySQL. We expect to make these adjustments around 1AM Eastern Daylight Saving Time (EDT) US.

"Split large xml into mutiple files and with header and footer in file"

Post #303030454 by Don Cragun on Sunday 10th of February 2019 11:42:47 PM

Quote:
Originally Posted by karthik
Iam using Linux OS and the file is .xml , And i need all the values of job_id as you mentioned not just 3.
OK. So does the code I suggested in post #23 produce the output you want if you change the name of the file in the script to match the name of your input file?
This User Gave Thanks to Don Cragun For This Post:
 
Related Linux and UNIX Technical Support
Split large file and add header and footer to each file
ashish4422
I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?... Shell Programming and Scripting
1
Shell Programming and Scripting
Split large file and add header and footer to each small files
ashish4422
I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?... Shell Programming and Scripting
7
Shell Programming and Scripting
Add header and footer with record count in footer
itsranjan
This is my file(Target.txt) name|age|locaction abc|23|del xyz|24|mum jkl|25|kol The file should be like this 1|03252012 1|name|age|location 2|abc|23|del 2|xyz|24|mum 2|jkl|25|kol 2|kkk|26|hyd 3|4 Column 1 is row indicator for row 1 and 2, column indicator is 1,for data rows...... Shell Programming and Scripting
1
Shell Programming and Scripting
Removing header or footer from file
sridhardwh
Hi Every one, what is the coomand to remove header or footer from a file. Please help me by providing command/syntax to remove header/footer from unix. Thanks in advance for all your support.... Shell Programming and Scripting
5
Shell Programming and Scripting
Is there a way to append both at header and footer of a file
jediwannabe
currently I've a file Insert into CD_CARD_TYPE (CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE) Values ('024', '024', 2, sysdate); Insert into CD_CARD_TYPE (CODE, DESCRIPTION, LAST_UPDATE_BY, LAST_UPDATE_DATE) Values ('032', '032', 2, sysdate); ........ is it...... Shell Programming and Scripting
3
Shell Programming and Scripting
XML_SPLIT(1p)						User Contributed Perl Documentation					     XML_SPLIT(1p)

NAME
xml_split - cut a big XML file into smaller chunks
DESCRIPTION
"xml_split" takes a (presumably big) XML file and split it in several smaller files. The memory used is the memory needed for the biggest chunk (ie memory is reused for each new chunk). It can split at a given level in the tree (the default, splits children of the root), or on a condition (using the subset of XPath understood by XML::Twig, so "section" or "/doc/section"). Each generated file is replaced by a processing instruction that will allow "xml_merge" to rebuild the original document. The processing instruction format is "<?merge subdocs=[01] :<filename> ?>" File names are <file>-<nb>.xml, with <file>-00.xml holding the main document.
OPTIONS
-l <level> level to cut at: 1 generates a file for each child of the root, 2 for each grand child defaults to 1 -c <condition> generate a file for each element that passes the condition xml_split -c <section> will put each "section" element in its own file (nested sections are handled too) Note that at the moment this option is a lot slower than using "-l" -s <size> generates files of (approximately) <size>. The content of each file is enclosed in a new element ("xml_split::root"), so it's well- formed XML. The size can be given in bytes, Kb, Mb or Gb. -g <nb> groups <nb> elements in a single file. The content of each file is enclosed in a new element ("xml_split::root"), so it's well-formed XML. -b <name> base name for the output, files will be named <base>-<nb><.ext> <nb> is a sequence number, see below "--nb_digits" <ext> is an extension, see below "--extension" defaults to the original file name (if available) or "out" (if input comes from the standard input) -n <nb> number of digits in the sequence number for each file if more digits than <nb> are needed, then they are used: if "--nb_digits 2" is used and 112 files are generated they will be named "<file>-01.xml" to "<file>-112.xml" defaults to 2 -e <ext> extension to use for generated files defaults to the original file extension or ".xml" -i use XInclude elements instead of Processing Instructions to mark where sub files need to be included -v verbose output Note that this option can slow down processing considerably (by an order of magnitude) when generating lots of small documents -V outputs version and exit -h short help -m man (requires pod2text to be in the path)
EXAMPLES
xml_split foo.xml # split at level 1 xml_split -l 2 foo.xml # split at level 2 xml_split -c section foo.xml # a file is generated for each section element # nested sections are split properly
SEE ALSO
XML::Twig, xml_merge
TODO
optimize the code any idea welcome! I have already implemented most of what I thought would improve performances. provide other methods that PIs to keep merge information XInclude is a good candidate (alpha support added in 0.04). using entities, which would seem the natural way to do it, doesn't work, as they make it impossible to have both the main document and the sub docs to be well-formed if the sub docs include sub-sub docs (you can't have entity declarations in an entity)
AUTHOR
Michel Rodriguez <mirod@cpan.org>
LICENSE
This tool is free software; you can redistribute it and/or modify it under the same terms as Perl itself. perl v5.12.4 2010-09-20 XML_SPLIT(1p)

Featured Tech Videos