Sponsored Content
Top Forums Shell Programming and Scripting Large Variable content size caveats? Post 303032075 by Neo on Monday 11th of March 2019 12:53:50 AM
Old 03-11-2019
Quote:
Originally Posted by stomp

Since all of that data is JSON data which will get fed into jq for extraction, I do not see much potential trouble ahead.
If your data is JSON, why are you processing it with curl and shell scripts where there are tools better suited for processing JSON data?

I process a lot of JSON data on Linux and never use a shell script to process this JSON data. There are many other languages, libs and tools built to process JSON. Why use a tool suboptimal for JSON processing?

Just curious ...

As I said, I process reams of JSON data on Linux and do not use shell scripts to process any JSON objects.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

prevent file size is too large

We have EDP members will do some testing job in my system , but sometimes these process will generate some error to the system log or any file ( usually the members don't know the log is reached to this level ) , then make the system crashed , could suggest the way how can to prevent this problem ?... (2 Replies)
Discussion started by: ust
2 Replies

2. UNIX for Dummies Questions & Answers

Editing a large size file

I would like to edit a doc which is large file size. I can't use "vi" command due to out of memory. $ vi large.dat ex: 0602-101 Out of memory saving lines for undo. Please help. Thanks. (2 Replies)
Discussion started by: Rock
2 Replies

3. Shell Programming and Scripting

Split a large file with patterns and size

Hi, I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file. i.e. The file is like 1... 2... 2... 3... 1... 2... 3... 1... 2... 2... 2... 2... 2... 3... where 1 is the start of the block... (5 Replies)
Discussion started by: sudhamacs
5 Replies

4. Web Development

Content Management System for uploading large files

Hi everybody, I am currently trying to develop a simple content management system where I have an internal website for my users to upload large files onto the server. The site is password protected and my users won't be trying to hack into the system so security is a non-factor (as least for... (3 Replies)
Discussion started by: z1dane
3 Replies

5. Shell Programming and Scripting

Creating large number of files of specific size

Hi I am new to shell scripting.I want to create a batch file which creates a desired number of files with a specific size say 1MB each to consume space.How can i go about it using for loop /any other loop condition using shell script? Thanks (3 Replies)
Discussion started by: swatideswal
3 Replies

6. UNIX for Advanced & Expert Users

Need help with configuring large packet size on Solaris 7 / e6500

We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096 bytes. Linux has /etc/network/interfaces. Does ANYONE remember the equivalent in Unix? When I do ifconfig eth0 mtu 4000, I get the error... (0 Replies)
Discussion started by: sharique
0 Replies

7. Solaris

Need help with configuring large packet size on Solaris 7 / e6500

Greetings, I'm stuck in a time warp using ancient machines from the prehistoric era that should be rightfully displayed in the Smithsonian. We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096... (9 Replies)
Discussion started by: sharique
9 Replies

8. Red Hat

Empty directory, large size and performance

Hi, I've some directory that I used as working directory for a program. At the end of the procedure, the content is deleted. This directory, when I do a ls -l, appears to still take up some space. After a little research, I've seen on a another board of this forum that it's not really taking... (5 Replies)
Discussion started by: bdx
5 Replies

9. Shell Programming and Scripting

Help with Splitting a Large XML file based on size AND tags

Hi All, This is my first post here. Hoping to share and gain knowledge from this great forum !!!! I've scanned this forum before posting my problem here, but I'm afraid I couldn't find any thread that addresses this exact problem. I'm trying to split a large XML file (with multiple tag... (7 Replies)
Discussion started by: Aviktheory11
7 Replies

10. Programming

Best Method For Query Content In Large JSON Files

I wanted to know what is the best way to query json formatted files for content? Ex. Data https://usn.ubuntu.com/usn-db/database-all.json.bz2 When looking at keys as in: import json json_data = json.load(open('database-all.json')) for keys in json_data.iterkeys(): print 'Keys--> {}... (0 Replies)
Discussion started by: metallica1973
0 Replies
JSON::RPC::Client(3pm)					User Contributed Perl Documentation				    JSON::RPC::Client(3pm)

NAME
JSON::RPC::Client - Perl implementation of JSON-RPC client SYNOPSIS
use JSON::RPC::Client; my $client = new JSON::RPC::Client; my $url = 'http://www.example.com/jsonrpc/API'; my $callobj = { method => 'sum', params => [ 17, 25 ], # ex.) params => { a => 20, b => 10 } for JSON-RPC v1.1 }; my $res = $client->call($uri, $callobj); if($res) { if ($res->is_error) { print "Error : ", $res->error_message; } else { print $res->result; } } else { print $client->status_line; } # Easy access $client->prepare($uri, ['sum', 'echo']); print $client->sum(10, 23); DESCRIPTION
This is JSON-RPC Client. See <http://json-rpc.org/wd/JSON-RPC-1-1-WD-20060807.html>. Gets a perl object and convert to a JSON request data. Sends the request to a server. Gets a response returned by the server. Converts the JSON response data to the perl object. JSON
::RPC::Client METHODS $client = JSON::RPC::Client->new Creates new JSON::RPC::Client object. $response = $client->call($uri, $procedure_object) Calls to $uri with $procedure_object. The request method is usually "POST". If $uri has query string, method is "GET". About 'GET' method, see to <http://json-rpc.org/wd/JSON-RPC-1-1-WD-20060807.html#GetProcedureCall>. Return value is "JSON::RPC::ReturnObject". $client->prepare($uri, $arrayref_of_procedure) Allow to call methods in contents of $arrayref_of_procedure. Then you can call the prepared methods with an array reference or a list. The return value is a result part of JSON::RPC::ReturnObject. $client->prepare($uri, ['sum', 'echo']); $res = $client->echo('foobar'); # $res is 'foobar'. $res = $client->sum(10, 20); # sum up $res = $client->sum( [10, 20] ); # same as above If you call a method which is not prepared, it will "croak". Currently, can't call any method names as same as built-in methods. version Sets the JSON-RPC protocol version. 1.1 by default. id Sets a request identifier. In JSON-RPC 1.1, it is optoinal. If you set "version" 1.0 and don't set id, the module sets 'JSON::RPC::Client' to it. ua Setter/getter to LWP::UserAgent object. json Setter/getter to the JSON coder object. Default is JSON, likes this: $self->json( JSON->new->allow_nonref->utf8 ); $json = $self->json; This object serializes/deserializes JSON data. By default, returned JSON data assumes UTF-8 encoded. status_line Returns status code; After "call" a remote procedure, the status code is set. create_json_coder (Class method) Returns a JSON de/encoder in "new". You can override it to use your favorite JSON de/encoder. JSON
::RPC::ReturnObject "call" method or the methods set by "prepared" returns this object. (The returned JSON data is decoded by the JSON coder object which was passed by the client object.) METHODS is_success If the call is successful, returns a true, otherwise a false. is_error If the call is not successful, returns a true, otherwise a false. error_message If the response contains an error message, returns it. result Returns the result part of a data structure returned by the called server. content Returns the whole data structure returned by the called server. jsontext Returns the row JSON data. version Returns the version of this response data. JSON
::RPC::ServiceObject RESERVED PROCEDURE
When a client call a procedure (method) name 'system.foobar', JSON::RPC::Server look up MyApp::system::foobar. <http://json-rpc.org/wd/JSON-RPC-1-1-WD-20060807.html#ProcedureCall> <http://json-rpc.org/wd/JSON-RPC-1-1-WD-20060807.html#ServiceDescription> There is JSON::RPC::Server::system::describe for default response of 'system.describe'. SEE ALSO
<http://json-rpc.org/wd/JSON-RPC-1-1-WD-20060807.html> <http://json-rpc.org/wiki/specification> AUTHOR
Makamaka Hannyaharamitu, <makamaka[at]cpan.org> COPYRIGHT AND LICENSE
Copyright 2007-2008 by Makamaka Hannyaharamitu This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself. perl v5.10.1 2008-09-01 JSON::RPC::Client(3pm)
All times are GMT -4. The time now is 11:10 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy