How to convert xml to csv ?

Login or Register to Ask a Question and Join Our Community

How to convert xml to csv ?

Tags

perl, perl 5.6.1, shell scripts, xml parsing

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting How to convert xml to csv ?

11-16-2014

Registered User

10, 0

Join Date: Sep 2014

Last Activity: 16 November 2014, 3:48 AM EST

Posts: 10

Thanks Given: 4

Thanked 0 Times in 0 Posts

How to convert xml to csv ?

I am in need of converting billions of XML into csv file to load data to DB, i have found the below code in perl but not sure why it's not working properly.

CODE:

Code:

#!/usr/bin/perl

# Script to illustrate how to parse a simple XML file
# and pick out all the values for a specific element, in
# this case all the titles.

# use strict;
use XML::Simple;
use Data::Dumper;

# create object
$xml = new XML::Simple (KeyAttr=>[]);

# read XML file
$data = $xml->XMLin("test1.xml");


my $booklist = XMLin('test1.xml');    #booklist is the array 
# print Dumper($booklist);

foreach my $FreemanFees (@{$booklist->{FreemanFees}}) {


    print 
    $FreemanFees->{SdcLoanFacilityNumber} , "," , 
    $FreemanFees->{DealId} ,",", 
    $FreemanFees->{Tranche}->{SdcDealNumber} , "," , 
    $FreemanFees->{Tranche}->{ManagerFeeAndCredits}->{ManagerFeeAndCredit}->{FreemanFeesForManager}->{ManagerNumberForFreemanFee}, ",",
    $FreemanFees->{Tranche}->{ManagerFeeAndCredits}->{ManagerFeeAndCredit}->{FreemanFeesForManager}->{currencyId},",",
    $FreemanFees->{Tranche}->{ManagerFeeAndCredits}->{ManagerFeeAndCredit}->{FreemanFeesForManager}->{sdcCurrencyCode} , "," , 
    $FreemanFees->{Tranche}->{ManagerFeeAndCredits}->{ManagerFeeAndCredit}->{FreemanFeesForManager}->{scale}, ",",
    $FreemanFees->{Tranche}->{ManagerFeeAndCredits}->{ManagerFeeAndCredit}->{FreemanFeesForManager}->{content} , "," ,"\n" ;
    }

Input:

HTML Code:

<body>
    <FreemanFees>
        <SdcLoanFacilityNumber>133752115</SdcLoanFacilityNumber>
        <DealId>34390939283</DealId>
        <Tranche>
            <SdcDealNumber>133753116</SdcDealNumber>
            <ManagerFeeAndCredits>
                <ManagerFeeAndCredit>
                    <FreemanFeesForManager scale="6" currencyId="500110" sdcCurrencyCode="US">0</FreemanFeesForManager>
                    <ManagerNumberForFreemanFee>8320</ManagerNumberForFreemanFee>
                </ManagerFeeAndCredit>
            </ManagerFeeAndCredits>
        </Tranche>
    </FreemanFees>
    <FreemanFees>
        <SdcLoanFacilityNumber>133754115</SdcLoanFacilityNumber>
        <DealId>34390939284</DealId>
        <Tranche>
            <SdcDealNumber>133755116</SdcDealNumber>
            <ManagerFeeAndCredits>
                <ManagerFeeAndCredit>
                    <FreemanFeesForManager scale="6" currencyId="500110" sdcCurrencyCode="US">0</FreemanFeesForManager>
                    <ManagerNumberForFreemanFee>9678</ManagerNumberForFreemanFee>
                </ManagerFeeAndCredit>
                <ManagerFeeAndCredit>
                    <FreemanFeesForManager scale="6" currencyId="500110" sdcCurrencyCode="US">0</FreemanFeesForManager>
                    <ManagerNumberForFreemanFee>5390</ManagerNumberForFreemanFee>
                </ManagerFeeAndCredit>
            </ManagerFeeAndCredits>
        </Tranche>
    </FreemanFees>
</body>

The code is not printing the second Child tag.

Can any one help me ?

rspwilliam

View Public Profile for rspwilliam

Find all posts by rspwilliam

11-16-2014

Registered User

3,733, 1,154

Join Date: Apr 2009

Last Activity: 3 August 2016, 11:03 AM EDT

Posts: 3,733

Thanks Given: 7

Thanked 1,154 Times in 1,124 Posts

When you run your code it says pretty clearly why it can't print the details for the second child node:

Code:

Not a HASH reference at ...

Now, modify your code to print the contents of $FreemanFees using Data:

umper at the beginning of each loop run, then compare the output for the first child node and the second child node. Do you see the difference? (TIP: look at the line containing "ManagerFeeAndCredit" key).

PS: "use strict;" should always be enabled.

bartus11

View Public Profile for bartus11

Find all posts by bartus11

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Convert CSV file to nested XML file using UNIX/PERL?

we have a CSV which i need to convert to XML using Perl or Unix shell scripting. I was able to build this XML in oracle database. However, SQL/XML query is running for long time. Hence, I'm considering to write a Perl or shell script to generate this XML file. Basically need to build this XML...

2. Shell Programming and Scripting

Convert XML to CSV using awk or shell script

Hello, I am working on a part of code where I need a awk or shell script to convert the given XML file to CSV or TXT file. There are multiple xml files and of different structure, so a single script is required for converting data. I did find a lot of solutions in the forum but...

3. Shell Programming and Scripting

Convert XML file to CSV file

Hi Guys, I am new to Shell scripting and need to convert an XML files to a CSV file. My actual problem is that XML file loading is taking hours and I have decided to convert the XML structure to row based data in a CSV file. My XML file: Message846 can repeat within main loop and...

4. Shell Programming and Scripting

convert huge .xml file in .csv with specific column.

I have huge xml file in server and i want to convert it to .csv with specific column ... i have search in blog but i didn't get any usefully command. Thanks in advance

5. Shell Programming and Scripting

Convert xml to csv

I need to convert below xml code to csv. I searched other posts as well but this post (_https://www.unix.com/shell-programming-scripting/174417-extract-parse-xml-data-statistic-value-csv.html) gives "sed command garbled" error. As of now I have written a long script to do it, but can it be done with...

6. Shell Programming and Scripting

awk convert xml to csv

Hi, I have an xml file and I want to convert it with awk in to a csv file Test.xml <Worksheet ss:Name="Map1"> <Table ss:ExpandedColumnCount="2" ss:ExpandedRowCount="2" x:FullColumns="1" x:FullRows="1" ss:DefaultColumnWidth="60"> <Row> <Cell><Data...

7. UNIX for Dummies Questions & Answers

urgent help to convert xml to xsl or csv

Urgent help to transfer data from .xml to xl sheet where each attribute and value goes into seperate column.Please help me with the command.Please help Thanks Uma

8. Shell Programming and Scripting

Convert XML to CSV format

Can any one give the idea on this, please. I have the following XML file and wants to convert into CSV(comma separated value) format. <?xml version='1.0' encoding='UTF-8'?> <!DOCTYPE Waveset PUBLIC 'waveset.dtd' 'waveset.dtd'> <Waveset> <Object name='ra8736'> <Attribute name='ADDRESS'...

9. Shell Programming and Scripting

Help to convert XML to CSV

Apologies if this has already been covered in this site somewhere, I did try looking but without any success. I am new to the whole XML thing, very late starter, and have a requirement to convert an XML fiule to a CSV fomat. I am crrently working on a Solaris OS. Does anyone have any suggestions,...

10. Shell Programming and Scripting

Sample Unix script file to convert .xml to .csv

Dear all, Can you send me a script file the changes .xml to .csv file. Thanks, Srinivasa

Login or Register to Ask a Question