02-13-2016
If you have huge data and need lot of this kind of processing, thenlook Postgresql ex. newest 9.5.
It has builtin really fast JSON and XML input parser using "COPY" and very fast output from JSONtoXML and XMLtoJSON. PG include datatypes JSON, JSONB, XML, ...
PG is SQL DB, but it's also one the fastest noSQL environment to handle JSON, CSV, XML, ... files.
Small json set I use jq to convert/parse but bigger data set I parse using PG command psql.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I am trying to use a line of output in an XML file as input in another new XML file for processing purposes via a shell script. Since I am a newbie though, I'm not sure how to do this since the data is different everytime. I am using this technique with static data right now:
echo -n "Running... (5 Replies)
Discussion started by: corwin43
5 Replies
2. Shell Programming and Scripting
Hi All,
I have a xml file for example as described below
<xml>
<address>
<street><street>
<address/>
<isbn>426728783932020308393930303</isbn>
<book>
<name>
</name>
</book>
.
.
.
</xml>
My problem is to get the isbn number from the above described file using ksh script. Could... (6 Replies)
Discussion started by: vinna
6 Replies
3. Shell Programming and Scripting
Hi,
Am new to scripting. :)
Am trying to figure out whether can i use bash scripting to parse an xml file.
Parsing is not just pulling out information according to the pattern but its more of a generic parsing. I should identify the xml hierarchy and pull out information accordingly. It's not a... (2 Replies)
Discussion started by: karthikvela
2 Replies
4. Shell Programming and Scripting
Hi
Is it possible to parse a posted xml data from a remote server in unix shell script. if so how to do that? and i need to give this script path in the push url (in remote server) . how to do this?
I have tried this in asp but could not succeed....so am trying in shell scripting...the thread... (1 Reply)
Discussion started by: aemunathan
1 Replies
5. Shell Programming and Scripting
Hello,
I'm a starting shell scripter and no Perl knowledge. I've trying to do this for a while:
I want to parse an XML file and get certain data out of it and write that data into a CSV file, all this using Shell Scripting (in Bash). Or Perl without any XML Parser/Interpreter (if possible).
... (1 Reply)
Discussion started by: Kage Musha
1 Replies
6. Shell Programming and Scripting
Created a korn shell script, everything is is working except this section, the variable $SYSINFO is being set, but the NASIP & NASDEV are failing, it appears to be treating the config.xml file config directory and xml as the file. Need a second set of eyes to tell me where I am messing up.
#... (3 Replies)
Discussion started by: juanb25
3 Replies
7. Shell Programming and Scripting
Below is a XML I have...
<?xml version="1.0" encoding="UTF-8" ?>
<component
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="urn:XXXXX-www-Install-Manifest manifest.xsd"
xmlns="urn:qqqqq-Install-Manifest"
name="OM"
... (1 Reply)
Discussion started by: dashok.83
1 Replies
8. Shell Programming and Scripting
I have a xml file like this
<bul:collectionStrategy name="strategy1">
<bul:collectionTemplateGroup name="15min group"/>
<bul:collectionTemplateGroup name="hourly group"/>
</bul:collectionStrategy>
<bul:CollectionTemplateGroup name="hourly group" >
... (2 Replies)
Discussion started by: LavanyaP
2 Replies
9. Shell Programming and Scripting
Hi,
I have an XML file in Linux and it contains a long string of characters. The last part of the file is like
.......
.......
.......
CAD</MarketDescription></InvestorTransaction></AdvisorAccount></DivisionAdvisor></Division>... (3 Replies)
Discussion started by: naveed
3 Replies
10. Shell Programming and Scripting
Hi folks
I have a script I wrote that basically parses a bunch of config and xml files works out were to add in the new content then spits out the data into a new file.
It all works - apart from the xml and config file format in the new file
with XML files the original XML (that ends up in... (2 Replies)
Discussion started by: dfinch
2 Replies
LEARN ABOUT DEBIAN
template::plugin::json::escape
Template::Plugin::JSON::Escape(3pm) User Contributed Perl Documentation Template::Plugin::JSON::Escape(3pm)
NAME
Template::Plugin::JSON::Escape - Adds a .json vmethod and a json filter.
SYNOPSIS
[% USE JSON.Escape( pretty => 1 ) %];
<script type="text/javascript">
var foo = [% foo.json %];
var bar = [% json_string | json %]
</script>
or read in JSON
[% USE JSON.Escape %]
[% data = JSON.Escape.json_decode(json) %]
[% data.thing %]
DESCRIPTION
This plugin allows you to embed JSON strings in HTML. In the output, special characters such as "<" and "&" are escaped as "uxxxx" to
prevent XSS attacks.
It also provides decoding function to keep compatibility with Template::Plugin::JSON.
FEATURES
USE JSON.Escape
Any options on the USE line are passed through to the JSON object, much like "to_json" in JSON.
json vmethod
A ".json" vmethod converts scalars, arrays and hashes into corresponding JSON strings.
[% json_stuct = { foo => 42, bar => [ 1, 2, 3 ] } %]
<script>
var json = [% json_struct.json %];
</script>
<span onclick="doSomething([% json_struct.json %]);">
json filter
A "json" filter escapes "<", ">", "&", "+", "U+2028" and "U+2029" as "uxxxx". In the attribute, you may just use an "html" filter.
[% json_string = '{ "foo": 42, "bar": [ 1, 2, 3 ] }' %]
<script>
var json = [% json_string | json %];
</script>
<span onclick="doSomething([% json_string | html %]);">
json_decode method
A "json_decode" method allow you to convert from a JSON string into a corresponding data structure.
[% SET json_struct = JSON.Escape.json_decode(json_string) %]
[% json_struct.foo | html %]
SEE ALSO
Template::Plugin::JSON, JSON, Template::Plugin
VERSION CONTROL
https://github.com/nanto/perl-Template-Plugin-JSON-Escape <https://github.com/nanto/perl-Template-Plugin-JSON-Escape>
AUTHOR
nanto_vi (TOYAMA Nao) <nanto@moon.email.ne.jp>
COPYRIGHT & LICENSE
Copyright (c) 2011 nanto_vi (TOYAMA Nao).
Copyright (c) 2006, 2008 Infinity Interactive, Yuval Kogman.
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to
the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
perl v5.14.2 2011-06-13 Template::Plugin::JSON::Escape(3pm)