Sponsored Content
Top Forums Shell Programming and Scripting Parsing custom data into xml in Shell Post 302966526 by kshji on Saturday 13th of February 2016 03:01:09 AM
Old 02-13-2016
If you have huge data and need lot of this kind of processing, thenlook Postgresql ex. newest 9.5.
It has builtin really fast JSON and XML input parser using "COPY" and very fast output from JSONtoXML and XMLtoJSON. PG include datatypes JSON, JSONB, XML, ...

PG is SQL DB, but it's also one the fastest noSQL environment to handle JSON, CSV, XML, ... files.

Small json set I use jq to convert/parse but bigger data set I parse using PG command psql.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Parsing XML dynamic data via awk?

I am trying to use a line of output in an XML file as input in another new XML file for processing purposes via a shell script. Since I am a newbie though, I'm not sure how to do this since the data is different everytime. I am using this technique with static data right now: echo -n "Running... (5 Replies)
Discussion started by: corwin43
5 Replies

2. Shell Programming and Scripting

Parsing and getting data from XML file using ksh script

Hi All, I have a xml file for example as described below <xml> <address> <street><street> <address/> <isbn>426728783932020308393930303</isbn> <book> <name> </name> </book> . . . </xml> My problem is to get the isbn number from the above described file using ksh script. Could... (6 Replies)
Discussion started by: vinna
6 Replies

3. Shell Programming and Scripting

XML parsing through shell scritps

Hi, Am new to scripting. :) Am trying to figure out whether can i use bash scripting to parse an xml file. Parsing is not just pulling out information according to the pattern but its more of a generic parsing. I should identify the xml hierarchy and pull out information accordingly. It's not a... (2 Replies)
Discussion started by: karthikvela
2 Replies

4. Shell Programming and Scripting

Parsing posted XML data from a remote server?

Hi Is it possible to parse a posted xml data from a remote server in unix shell script. if so how to do that? and i need to give this script path in the push url (in remote server) . how to do this? I have tried this in asp but could not succeed....so am trying in shell scripting...the thread... (1 Reply)
Discussion started by: aemunathan
1 Replies

5. Shell Programming and Scripting

Parsing XML using Shell Script

Hello, I'm a starting shell scripter and no Perl knowledge. I've trying to do this for a while: I want to parse an XML file and get certain data out of it and write that data into a CSV file, all this using Shell Scripting (in Bash). Or Perl without any XML Parser/Interpreter (if possible). ... (1 Reply)
Discussion started by: Kage Musha
1 Replies

6. Shell Programming and Scripting

parsing data from xml file is failing can't open variable

Created a korn shell script, everything is is working except this section, the variable $SYSINFO is being set, but the NASIP & NASDEV are failing, it appears to be treating the config.xml file config directory and xml as the file. Need a second set of eyes to tell me where I am messing up. #... (3 Replies)
Discussion started by: juanb25
3 Replies

7. Shell Programming and Scripting

XML parsing in a shell script.

Below is a XML I have... <?xml version="1.0" encoding="UTF-8" ?> <component xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:XXXXX-www-Install-Manifest manifest.xsd" xmlns="urn:qqqqq-Install-Manifest" name="OM" ... (1 Reply)
Discussion started by: dashok.83
1 Replies

8. Shell Programming and Scripting

XML parsing using shell script

I have a xml file like this <bul:collectionStrategy name="strategy1"> <bul:collectionTemplateGroup name="15min group"/> <bul:collectionTemplateGroup name="hourly group"/> </bul:collectionStrategy> <bul:CollectionTemplateGroup name="hourly group" > ... (2 Replies)
Discussion started by: LavanyaP
2 Replies

9. Shell Programming and Scripting

Help - Parsing data in XML in Linux

Hi, I have an XML file in Linux and it contains a long string of characters. The last part of the file is like ....... ....... ....... CAD</MarketDescription></InvestorTransaction></AdvisorAccount></DivisionAdvisor></Division>... (3 Replies)
Discussion started by: naveed
3 Replies

10. Shell Programming and Scripting

Parsing XML (and insert data) then output data (bash / Solaris)

Hi folks I have a script I wrote that basically parses a bunch of config and xml files works out were to add in the new content then spits out the data into a new file. It all works - apart from the xml and config file format in the new file with XML files the original XML (that ends up in... (2 Replies)
Discussion started by: dfinch
2 Replies
Template::Plugin::JSON::Escape(3pm)			User Contributed Perl Documentation		       Template::Plugin::JSON::Escape(3pm)

NAME
Template::Plugin::JSON::Escape - Adds a .json vmethod and a json filter. SYNOPSIS
[% USE JSON.Escape( pretty => 1 ) %]; <script type="text/javascript"> var foo = [% foo.json %]; var bar = [% json_string | json %] </script> or read in JSON [% USE JSON.Escape %] [% data = JSON.Escape.json_decode(json) %] [% data.thing %] DESCRIPTION
This plugin allows you to embed JSON strings in HTML. In the output, special characters such as "<" and "&" are escaped as "uxxxx" to prevent XSS attacks. It also provides decoding function to keep compatibility with Template::Plugin::JSON. FEATURES
USE JSON.Escape Any options on the USE line are passed through to the JSON object, much like "to_json" in JSON. json vmethod A ".json" vmethod converts scalars, arrays and hashes into corresponding JSON strings. [% json_stuct = { foo => 42, bar => [ 1, 2, 3 ] } %] <script> var json = [% json_struct.json %]; </script> <span onclick="doSomething([% json_struct.json %]);"> json filter A "json" filter escapes "<", ">", "&", "+", "U+2028" and "U+2029" as "uxxxx". In the attribute, you may just use an "html" filter. [% json_string = '{ "foo": 42, "bar": [ 1, 2, 3 ] }' %] <script> var json = [% json_string | json %]; </script> <span onclick="doSomething([% json_string | html %]);"> json_decode method A "json_decode" method allow you to convert from a JSON string into a corresponding data structure. [% SET json_struct = JSON.Escape.json_decode(json_string) %] [% json_struct.foo | html %] SEE ALSO
Template::Plugin::JSON, JSON, Template::Plugin VERSION CONTROL
https://github.com/nanto/perl-Template-Plugin-JSON-Escape <https://github.com/nanto/perl-Template-Plugin-JSON-Escape> AUTHOR
nanto_vi (TOYAMA Nao) <nanto@moon.email.ne.jp> COPYRIGHT &; LICENSE Copyright (c) 2011 nanto_vi (TOYAMA Nao). Copyright (c) 2006, 2008 Infinity Interactive, Yuval Kogman. Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. perl v5.14.2 2011-06-13 Template::Plugin::JSON::Escape(3pm)
All times are GMT -4. The time now is 08:28 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy