02-13-2016
If you have huge data and need lot of this kind of processing, thenlook Postgresql ex. newest 9.5.
It has builtin really fast JSON and XML input parser using "COPY" and very fast output from JSONtoXML and XMLtoJSON. PG include datatypes JSON, JSONB, XML, ...
PG is SQL DB, but it's also one the fastest noSQL environment to handle JSON, CSV, XML, ... files.
Small json set I use jq to convert/parse but bigger data set I parse using PG command psql.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I am trying to use a line of output in an XML file as input in another new XML file for processing purposes via a shell script. Since I am a newbie though, I'm not sure how to do this since the data is different everytime. I am using this technique with static data right now:
echo -n "Running... (5 Replies)
Discussion started by: corwin43
5 Replies
2. Shell Programming and Scripting
Hi All,
I have a xml file for example as described below
<xml>
<address>
<street><street>
<address/>
<isbn>426728783932020308393930303</isbn>
<book>
<name>
</name>
</book>
.
.
.
</xml>
My problem is to get the isbn number from the above described file using ksh script. Could... (6 Replies)
Discussion started by: vinna
6 Replies
3. Shell Programming and Scripting
Hi,
Am new to scripting. :)
Am trying to figure out whether can i use bash scripting to parse an xml file.
Parsing is not just pulling out information according to the pattern but its more of a generic parsing. I should identify the xml hierarchy and pull out information accordingly. It's not a... (2 Replies)
Discussion started by: karthikvela
2 Replies
4. Shell Programming and Scripting
Hi
Is it possible to parse a posted xml data from a remote server in unix shell script. if so how to do that? and i need to give this script path in the push url (in remote server) . how to do this?
I have tried this in asp but could not succeed....so am trying in shell scripting...the thread... (1 Reply)
Discussion started by: aemunathan
1 Replies
5. Shell Programming and Scripting
Hello,
I'm a starting shell scripter and no Perl knowledge. I've trying to do this for a while:
I want to parse an XML file and get certain data out of it and write that data into a CSV file, all this using Shell Scripting (in Bash). Or Perl without any XML Parser/Interpreter (if possible).
... (1 Reply)
Discussion started by: Kage Musha
1 Replies
6. Shell Programming and Scripting
Created a korn shell script, everything is is working except this section, the variable $SYSINFO is being set, but the NASIP & NASDEV are failing, it appears to be treating the config.xml file config directory and xml as the file. Need a second set of eyes to tell me where I am messing up.
#... (3 Replies)
Discussion started by: juanb25
3 Replies
7. Shell Programming and Scripting
Below is a XML I have...
<?xml version="1.0" encoding="UTF-8" ?>
<component
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="urn:XXXXX-www-Install-Manifest manifest.xsd"
xmlns="urn:qqqqq-Install-Manifest"
name="OM"
... (1 Reply)
Discussion started by: dashok.83
1 Replies
8. Shell Programming and Scripting
I have a xml file like this
<bul:collectionStrategy name="strategy1">
<bul:collectionTemplateGroup name="15min group"/>
<bul:collectionTemplateGroup name="hourly group"/>
</bul:collectionStrategy>
<bul:CollectionTemplateGroup name="hourly group" >
... (2 Replies)
Discussion started by: LavanyaP
2 Replies
9. Shell Programming and Scripting
Hi,
I have an XML file in Linux and it contains a long string of characters. The last part of the file is like
.......
.......
.......
CAD</MarketDescription></InvestorTransaction></AdvisorAccount></DivisionAdvisor></Division>... (3 Replies)
Discussion started by: naveed
3 Replies
10. Shell Programming and Scripting
Hi folks
I have a script I wrote that basically parses a bunch of config and xml files works out were to add in the new content then spits out the data into a new file.
It all works - apart from the xml and config file format in the new file
with XML files the original XML (that ends up in... (2 Replies)
Discussion started by: dfinch
2 Replies
LEARN ABOUT DEBIAN
jifty::json
Jifty::JSON(3pm) User Contributed Perl Documentation Jifty::JSON(3pm)
NAME
Jifty::JSON -- Wrapper around JSON
SYNOPSIS
use Jifty::JSON qw/decode_json encode_json/;
my $obj = decode_json(q! { "x": "1", "y": "2", "z": "3" } !);
my $json = encode_json($obj);
DESCRIPTION
Provides a thin wrapper around the JSON 2.xx library, which provides a frontend for JSON::XS and JSON::PP.
This module used to wrap JSON::Syck and JSON 1.xx with special-casing for outputting JSON with single quoted values. Single quotes make it
easy to simply plop JSON into HTML attributes but are in violation of the JSON spec which mandates only double quoted strings.
The old behavior is now unsupported and it is recommended that you simply HTML escape your entire blob of JSON if you are sticking it in an
HTML attribute. You can use Jifty->web->escape() to properly escape problematic characters for HTML.
FUNCTIONS
decode_json JSON, [ARGUMENT HASHREF]
encode_json JSON, [ARGUMENT HASHREF]
These functions are just like JSON's, except that you can pass options to them like you can with JSON's "from_json" and "to_json"
functions.
By default they encode/decode using UTF8 (like JSON's functions of the same name), but you can turn that off by passing "utf8 => 0" in the
options. The allow_nonref flag is also enabled for backwards compatibility with earlier versions of this module. It allows
encoding/decoding of values that are not references.
JSON is imported with the "-support_by_pp" flag in order to support all options that JSON::PP provides when using JSON::XS as the backend.
If you are concerned with speed, be careful what options you specify as it may cause the pure Perl backend to be used. Read "JSON::PP
SUPPORT METHODS" in JSON for more information.
DEPRECATED FUNCTIONS
jsonToObj JSON, [ARGUMENTS]
objToJson JSON, [ARGUMENTS]
These functions are deprecated and provided for backwards compatibility. They wrap the appropriate function above, but "croak" in Carp if
you try to set the "singlequote" option.
LICENSE
Jifty is Copyright 2005-2010 Best Practical Solutions, LLC. Jifty is distributed under the same terms as Perl itself.
perl v5.14.2 2010-12-08 Jifty::JSON(3pm)