Sponsored Content
Top Forums Shell Programming and Scripting Convert XML to Data File in Shell Script Post 302420079 by durden_tyler on Monday 10th of May 2010 01:41:45 PM
Old 05-10-2010
Quote:
Originally Posted by ragha81
...
I need the above XML file broken down to multiple data files. For eg) Portfolio tag elements should go into Portfolio.txt The text file should be as below

P1|Access|Active

Similarly Family Tag elements should go into Family.txt, same with Sub Family and Products as well.

Can you suggest a way to achieve my scenario.
...
A scripting language might make your task easier to accomplish.

Here's an idea that uses regular expressions in Perl -

Code:
$
$ ## check if the text files exist
$
$ ls portfolio.txt family.txt subfamily.txt
ls: cannot access portfolio.txt: No such file or directory
ls: cannot access family.txt: No such file or directory
ls: cannot access subfamily.txt: No such file or directory
$
$ ## check the contents of the xml file
$
$ cat -n test.xml
     1  <ABSProductCatalog xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
     2  <ProductSalesHierachy>
     3  <Portfolios>
     4  <Portfolio productCode="P1">
     5  <Attribute name="CatalogProductName" value="Access" />
     6  <Attribute name="Status" value="Active" />
     7  </Portfolio>
     8  <Portfolio productCode="P2">
     9  <Attribute name="CatalogProductName" value="Data" />
    10  <Attribute name="Status" value="Active" />
...
... <snipped a lot of XML content here>
...
   183  <DynamicAttribute dataType="String" name="ProductId">
   184  <AttrValue>123456</AttrValue>
   185  </DynamicAttribute>
   186  <DynamicAttribute dataType="String" name="modelSource">
   187  <AttrValue>product</AttrValue>
   188  </DynamicAttribute>
   189  </DynamicAttributes>
   190  </Product>
   191  </Products>
   192  <CatalogChanged>Y</CatalogChanged>
   193  </ABSProductCatalog>
$
$
$ ## run the Perl script
$
$ perl -lne 'BEGIN {undef $/}
>            while (/<(Portfolio|Family|SubFamily) productCode="(.*?)".*?value="(.*?)".*?value="(.*?)".*?<\/(Portfolio|Family|SubFamily)>/sg) {
>              if ($1 eq "Portfolio") {push @p, "$2|$3|$4"}
>              elsif ($1 eq "Family") {push @f, "$2|$3|$4"}
>              elsif ($1 eq "SubFamily") {push @sf, "$2|$3|$4"}
>            }
>           END {if (@p)  {open(F, ">portfolio.txt"); foreach(@p) {print F $_} close(F)}
>                if (@f)  {open(F, ">family.txt"); foreach(@f) {print F $_} close(F)}
>                if (@sf) {open(F, ">subfamily.txt"); foreach(@sf) {print F $_} close(F)}
>           }
>           ' test.xml
$
$
$ # check if the text files have been generated
$
$ ls -1 portfolio.txt family.txt subfamily.txt
family.txt
portfolio.txt
subfamily.txt
$
$ # they are there now... check their contents
$
$ cat portfolio.txt
P1|Access|Active
P2|Data|Active
P3|Voice|Active
P4|Wireless|Active
$
$ cat family.txt
F1|Internet Access Services|Active
F2|Local Access Services|Active
$
$ cat subfamily.txt
SF1|Business Internet service|Active
$
$

For more power and flexibility, there are Perl modules for XML available at CPAN.

HTH,
tyler_durden
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Plz Help To convert xml file to text file using bourn shell scripts

If someone out there could help me out with this problem. I would really appreciate it. I am trying to convert xml into text file(fixed length) using Unix Borne shell scripts. My xml file: <root> <header_rec recordtype="00"> <record_id>00</record_id> <country_code>AK></country_code>... (0 Replies)
Discussion started by: ram2s2001
0 Replies

2. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies

3. Shell Programming and Scripting

Sample Unix script file to convert .xml to .csv

Dear all, Can you send me a script file the changes .xml to .csv file. Thanks, Srinivasa (4 Replies)
Discussion started by: srinivasaphani
4 Replies

4. Shell Programming and Scripting

Help with shell script to extract data from XML file

Hello Scripting Gurus, I need help with extracting data from the XML file using shell script. The data is in a large XML and I need to extract the id values of all completedworkflows. Here is a sample of it. Input and output data is also in the attached text files. <wfregistry>... (5 Replies)
Discussion started by: yajaykumar
5 Replies

5. Shell Programming and Scripting

How to remove xml namespace from xml file using shell script?

I have an xml file: <AutoData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <Table1> <Data1 10 </Data1> <Data2 20 </Data2> <Data3 40 </Data3> <Table1> </AutoData> and I have to remove the portion xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" only. I tried using sed... (10 Replies)
Discussion started by: Gary1978
10 Replies

6. Shell Programming and Scripting

convert one form of xml data to other

I would like to convert one form of xml tag data to another <DescriptionList> <DescriptionExt language="en" shortDesc="ITALIAN SAUSAGE SUB" longDesc="" sizeDesc="" smallImage="Pictures\sub-italian-sausage.png" largeImage="" forceImageUpdate="yes" /> ... (1 Reply)
Discussion started by: saisus
1 Replies

7. UNIX for Advanced & Expert Users

Convert column data to row data using shell script

Hi, I want to convert a 3-column data to 3-row data using shell script. Any suggestion in this regard is highly appreciated. Thanks. (4 Replies)
Discussion started by: sktkpl
4 Replies

8. Shell Programming and Scripting

How to Parse the XML data along with the URL in Shell Script?

Hi, Can anybody help to solve this. I want to parse some xmldata along with the URL in the Shell. I'm calling the URL via the curl command Given below is my shell script file export... (7 Replies)
Discussion started by: Megala
7 Replies

9. Shell Programming and Scripting

Convert XML to CSV using awk or shell script

Hello, I am working on a part of code where I need a awk or shell script to convert the given XML file to CSV or TXT file. There are multiple xml files and of different structure, so a single script is required for converting data. I did find a lot of solutions in the forum but... (16 Replies)
Discussion started by: Rashmitha
16 Replies

10. Shell Programming and Scripting

Need get data from XML file through shell script..

hi all, here is the sample log file and these errors are repeated in log file.. i need all the repeated time stamp ,severity and message tags needs to print in output file.. through shell script <log-message> <timestamp>2019-03-13T04:52:49.648-05:00</timestamp> <severity>ERROR</severity>... (17 Replies)
Discussion started by: ravi
17 Replies
All times are GMT -4. The time now is 12:16 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy