Sponsored Content
Top Forums Shell Programming and Scripting Help with shell script to extract data from XML file Post 302232088 by fpmurphy on Wednesday 3rd of September 2008 09:50:34 PM
Old 09-03-2008
Rather than using grep, sed or awk to transform the XML into the required output, it is better to use an XSLT processor.

If you have (Gnome) libxsl/libxslt installed, it comes with xsltproc a command line interface to a XSLT v1.0 compliant processor.

Here is a stylesheet which performs the required transformation using xsltproc:
Code:
$ cat file.xsl
<?xml version="1.0"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">

<xsl:output method="text" omit-xml-declaration="yes" />

<xsl:template match="id">
    <xsl:value-of select="@v"/><xsl:text>&#xa;</xsl:text>
</xsl:template>

<xsl:template match="/">
  <xsl:apply-templates select="/wfregistry/completedworkflows/id" />
</xsl:template>

</xsl:stylesheet>

$ xsltproc file.xsl file.xml
3381
3399
3415
3431
3447
3463
3479
3495
3511
3527
3543
3559
3575
3591
3607
$

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies

2. Shell Programming and Scripting

Convert XML to Data File in Shell Script

Hi All, I will be getting a huge XML file with a lot of records in it. I need to convert it into multiple data files. SAMPLE XML FILE <ABSProductCatalog xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> - <ProductSalesHierachy> - <Portfolios> - <Portfolio productCode="P1"> ... (8 Replies)
Discussion started by: ragha81
8 Replies

3. Shell Programming and Scripting

need a shell script to extract data from a log file.

If I have a log like : Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi I will need an output like this : Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies

4. Shell Programming and Scripting

Shell script to extract data in repeating tags from xml

Hi, I am new to shell scripting. I need to extract data between repeating tags from an xml file and store the data in an array to process it further. <ns1:root xmlns:ns1="http://example.com/config"> <ns1:interface>in1</ns1:interface> <ns1:operation attribute1="true" attribute2="abd"... (2 Replies)
Discussion started by: sailendra
2 Replies

5. Shell Programming and Scripting

How to extract data from xml file using shell scripting?

Hi evry1, This is my 1st post in this forum.Pls help me I want to extract some data froma xml file which has 2000 lines using shell scripting. Actually my xml file has some "audio and video codes" which i need to arrange in a column wise format after extracting it using shell scripting.I... (4 Replies)
Discussion started by: arun_kohan
4 Replies

6. Shell Programming and Scripting

How to extract data from XML file using shell scripting?

Hi , I have input file as XML. following are input data #complex.xml Code: <?xml version="1.0" encoding="UTF-8"?><TEST_doc xmlns="http://www.w3.org/2001/XMLSchema-instance"> <ENTRY uid="123456"> <protein> <name>PROT001</name> <organism>Human</organism> ... (1 Reply)
Discussion started by: arun_kohan
1 Replies

7. UNIX for Dummies Questions & Answers

Shell script to extract data from csv file

Hi Guys, I am new to shell script.I need your help to write a shell script. I need to write a shell script to extract data from a .csv file where columns are ',' separated. The file has 7 columns having values say column 1,column 2.....column 7 as below along with their values. Name, Address,... (7 Replies)
Discussion started by: Vivekit82
7 Replies

8. Shell Programming and Scripting

Shell script to extract data from csv file

Hi everyone, I have a csv file which has data with different heading and column names as below. Static Data Ingested ,,,,,,,,,,,,Known Explained Rejections Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies

9. UNIX for Beginners Questions & Answers

Shell script to extract data in a file

I have this 5GB file, and i want to extract from the file particulars pattern. this is my script: // count=`grep -wc "MSISDN" file_name` k=1 >OUTPUT >OUTPUT_Final while do cat file_name | awk -F":" -v var="$k" '$1=="MSISDN" {m++}m==var{print; exit}' >> OUTPUT cat file_name |awk -F":"... (33 Replies)
Discussion started by: gillesi
33 Replies

10. Shell Programming and Scripting

Need get data from XML file through shell script..

hi all, here is the sample log file and these errors are repeated in log file.. i need all the repeated time stamp ,severity and message tags needs to print in output file.. through shell script <log-message> <timestamp>2019-03-13T04:52:49.648-05:00</timestamp> <severity>ERROR</severity>... (17 Replies)
Discussion started by: ravi
17 Replies
XSLT_PROCESS(3) 							 1							   XSLT_PROCESS(3)

xslt_process - Perform anXSLTtransformation

SYNOPSIS
mixed xslt_process (resource $xh, string $xmlcontainer, string $xslcontainer, [string $resultcontainer], [array $arguments], [array $parameters]) DESCRIPTION
The xslt_process(3) function is the crux of the XSLT extension. It allows you to perform an XSLT transformation using almost any type of input source - the containers. This is accomplished through the use of argument buffers -- a concept taken from the SablotronXSLT processor (currently the only XSLT processor this extension supports). The input containers default to a filename 'containing' the document to be processed. PARAMETERS
o $ xh -The XSLT processor link identifier, created with xslt_create(3). o $xmlcontainer - Path to XML file or placeholder for the XML argument. o $xslcontainer - Path to XSL file or placeholder for the XML argument. o $resultcontainer - The result container defaults to a filename for the transformed document. If the result container is not specified - i.e. NULL - than the result is returned. o $arguments - Instead of files as the XML and XSLT arguments to the xslt_process(3) function, you can specify "argument place holders" which are then substituted by values given in the $arguments array. o $parameters - An array for any top-level parameters that will be passed to the XSLT document. These parameters can then be accessed within your XSL files using the <xsl:param name="parameter_name"> instruction. The parameters must be UTF-8 encoded and their values will be interpreted as strings by the Sablotron processor. In other words - you cannot pass node-sets as parameters to the XSLT docu- ment. Containers can also be set via the $arguments array (see below). RETURN VALUES
Returns TRUE on success or FALSE on failure. If the result container is not specified - i.e. NULL - than the result is returned. CHANGELOG
+--------+---------------------------------------------------+ |Version | | | | | | | Description | | | | +--------+---------------------------------------------------+ | 4.0.6 | | | | | | | This function no longer takes XML strings in | | | $xmlcontainer or $xslcontainer. Passing a string | | | containing XML to either of these parameters will | | | result in a segmentation fault in Sablotron ver- | | | sions up to and including version 0.95. | | | | +--------+---------------------------------------------------+ EXAMPLES
The simplest type of transformation with the xslt_process(3) function is the transformation of an XML file with an XSLT file, placing the result in a third file containing the new XML (or HTML) document. Doing this with Sablotron is really quite easy... Example #1 Using the xslt_process(3) to transform an XML file and a XSL file to a new XML file <?php // Allocate a new XSLT processor $xh = xslt_create(); // Process the document if (xslt_process($xh, 'sample.xml', 'sample.xsl', 'result.xml')) { echo "SUCCESS, sample.xml was transformed by sample.xsl into result.xml"; echo ", result.xml has the following contents <br /> "; echo "<pre> "; readfile('result.xml'); echo "</pre> "; } else { echo "Sorry, sample.xml could not be transformed by sample.xsl into"; echo " result.xml the reason is that " . xslt_error($xh) . " and the "; echo "error code is " . xslt_errno($xh); } xslt_free($xh); ?> While this functionality is great, many times, especially in a web environment, you want to be able to print out your results directly. Therefore, if you omit the third argument to the xslt_process(3) function (or provide a NULL value for the argument), it will automatically return the value of the XSLT transformation, instead of writing it to a file... Example #2 Using the xslt_process(3) to transform an XML file and a XSL file to a variable containing the resulting XML data <?php // Allocate a new XSLT processor $xh = xslt_create(); // Process the document, returning the result into the $result variable $result = xslt_process($xh, 'sample.xml', 'sample.xsl'); if ($result) { echo "SUCCESS, sample.xml was transformed by sample.xsl into the $result"; echo " variable, the $result variable has the following contents <br /> "; echo "<pre> "; echo $result; echo "</pre> "; } else { echo "Sorry, sample.xml could not be transformed by sample.xsl into"; echo " the $result variable the reason is that " . xslt_error($xh); echo " and the error code is " . xslt_errno($xh); } xslt_free($xh); ?> The above two cases are the two simplest cases there are when it comes to XSLT transformation and I'd dare say that they are the most com- mon cases, however, sometimes you get your XML and XSLT code from external sources, such as a database or a socket. In these cases you'll have the XML and/or XSLT data in a variable -- and in production applications the overhead of dumping these to file may be too much. This is where XSLT's "argument" syntax, comes to the rescue. Instead of files as the XML and XSLT arguments to the xslt_process(3) function, you can specify "argument place holders" which are then substituted by values given in the arguments array (5th parameter to the xslt_process(3) function). The following is an example of processing XML and XSLT into a result variable without the use of files at all. Example #3 Using the xslt_process(3) to transform a variable containing XML data and a variable containing XSL data into a variable containing the resulting XML data <?php // $xml and $xsl contain the XML and XSL data $arguments = array( '/_xml' => $xml, '/_xsl' => $xsl ); // Allocate a new XSLT processor $xh = xslt_create(); // Process the document $result = xslt_process($xh, 'arg:/_xml', 'arg:/_xsl', NULL, $arguments); if ($result) { echo "SUCCESS, sample.xml was transformed by sample.xsl into the $result"; echo " variable, the $result variable has the following contents <br /> "; echo "<pre> "; echo $result; echo "</pre> "; } else { echo "Sorry, sample.xml could not be transformed by sample.xsl into"; echo " the $result variable the reason is that " . xslt_error($xh); echo " and the error code is " . xslt_errno($xh); } xslt_free($xh); ?> Example #4 Passing PHP variables to XSL files <?php // XML string $xml = '<?xml version="1.0"?> <para> change me </para>'; // XSL string $xsl = ' <xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"> <xsl:output method="html" encoding="ISO-8859-1" indent="no" omit-xml-declaration="yes" media-type="text/html"/> <xsl:param name="myvar"/> <xsl:param name="mynode"/> <xsl:template match="/"> My PHP variable : <xsl:value-of select="$myvar"/><br /> My node set : <xsl:value-of select="$mynode"/> </xsl:template> </xsl:stylesheet>'; $xh = xslt_create(); // the second parameter will be interpreted as a string $parameters = array ( 'myvar' => 'test', 'mynode' => '<foo>bar</foo>' ); $arguments = array ( '/_xml' => $xml, '/_xsl' => $xsl ); echo xslt_process($xh, 'arg:/_xml', 'arg:/_xsl', NULL, $arguments, $parameters); ?> The above example will output: My PHP variable : test<br> My node set : &lt;foo&gt;bar&lt;/foo&gt; NOTES
Note Please note that file:// is needed in front of the path when using Windows. PHP Documentation Group XSLT_PROCESS(3)
All times are GMT -4. The time now is 07:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy