03-11-2019
Quote:
Originally Posted by
stomp
basically it boils down to jq. Without it I never would have considered doing this task with bash. All JSON-Handling is done with jq. Bash is the code around it.
Thanks for explaining.
Maybe move away from
jq and use something more mainstream for processing JSON?
What are you planning to do with the JSON object after you download and process it?
Push it into a mysql db? Push it to Firebase? Save to a flat file on your box? Push it to another server?
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
We have EDP members will do some testing job in my system , but sometimes these process will generate some error to the system log or any file ( usually the members don't know the log is reached to this level ) , then make the system crashed , could suggest the way how can to prevent this problem ?... (2 Replies)
Discussion started by: ust
2 Replies
2. UNIX for Dummies Questions & Answers
I would like to edit a doc which is large file size. I can't use "vi" command due to out of memory.
$ vi large.dat
ex: 0602-101 Out of memory saving lines for undo.
Please help. Thanks. (2 Replies)
Discussion started by: Rock
2 Replies
3. Shell Programming and Scripting
Hi,
I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file.
i.e. The file is like
1...
2...
2...
3...
1...
2...
3...
1...
2...
2...
2...
2...
2...
3...
where 1 is the start of the block... (5 Replies)
Discussion started by: sudhamacs
5 Replies
4. Web Development
Hi everybody,
I am currently trying to develop a simple content management system where I have an internal website for my users to upload large files onto the server. The site is password protected and my users won't be trying to hack into the system so security is a non-factor (as least for... (3 Replies)
Discussion started by: z1dane
3 Replies
5. Shell Programming and Scripting
Hi
I am new to shell scripting.I want to create a batch file which creates a desired number of files with a specific size say 1MB each to consume space.How can i go about it using for loop /any other loop condition using shell script?
Thanks (3 Replies)
Discussion started by: swatideswal
3 Replies
6. UNIX for Advanced & Expert Users
We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096 bytes.
Linux has /etc/network/interfaces. Does ANYONE remember the equivalent in Unix? When I do ifconfig eth0 mtu 4000, I get the error... (0 Replies)
Discussion started by: sharique
0 Replies
7. Solaris
Greetings, I'm stuck in a time warp using ancient machines from the prehistoric era that should be rightfully displayed in the Smithsonian.
We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096... (9 Replies)
Discussion started by: sharique
9 Replies
8. Red Hat
Hi,
I've some directory that I used as working directory for a program. At the end of the procedure, the content is deleted. This directory, when I do a ls -l, appears to still take up some space. After a little research, I've seen on a another board of this forum that it's not really taking... (5 Replies)
Discussion started by: bdx
5 Replies
9. Shell Programming and Scripting
Hi All,
This is my first post here. Hoping to share and gain knowledge from this great forum !!!!
I've scanned this forum before posting my problem here, but I'm afraid I couldn't find any thread that addresses this exact problem.
I'm trying to split a large XML file (with multiple tag... (7 Replies)
Discussion started by: Aviktheory11
7 Replies
10. Programming
I wanted to know what is the best way to query json formatted files for content? Ex. Data
https://usn.ubuntu.com/usn-db/database-all.json.bz2
When looking at keys as in:
import json
json_data = json.load(open('database-all.json'))
for keys in json_data.iterkeys():
print 'Keys--> {}... (0 Replies)
Discussion started by: metallica1973
0 Replies
LEARN ABOUT DEBIAN
git-annex-shell
git-annex-shell(1) General Commands Manual git-annex-shell(1)
NAME
git-annex-shell - Restricted login shell for git-annex only SSH access
SYNOPSIS
git-annex-shell [-c] command [params ...]
DESCRIPTION
git-annex-shell is a restricted shell, similar to git-shell, which can be used as a login shell for SSH accounts.
Since its syntax is identical to git-shell's, it can be used as a drop-in replacement anywhere git-shell is used. For example it can be
used as a user's restricted login shell.
COMMANDS
Any command not listed below is passed through to git-shell.
Note that the directory parameter should be an absolute path, otherwise it is assumed to be relative to the user's home directory. Also the
first "/~/" or "/~user/" is expanded to the specified home directory.
configlist directory
This outputs a subset of the git configuration, in the same form as git config --list
inannex directory [key ...]
This checks if all specified keys are present in the annex, and exits zero if so.
dropkey directory [key ...]
This drops the annexed data for the specified keys.
recvkey directory key
This runs rsync in server mode to receive the content of a key, and stores the content in the annex.
sendkey directory key
This runs rsync in server mode to transfer out the content of a key.
commit directory
This commits any staged changes to the git-annex branch. It also runs the annex-content hook.
OPTIONS
Most options are the same as in git-annex. The ones specific to git-annex-shell are:
--uuid=UUID
git-annex uses this to specify the UUID of the repository it was expecting git-annex-shell to access, as a sanity check.
HOOK
After content is received or dropped from the repository by git-annex-shell, it runs a hook, .git/hooks/annex-content (or hooks/annex-con-
tent on a bare repository). The hook is not currently passed any information about what changed.
ENVIRONMENT
GIT_ANNEX_SHELL_READONLY
If set, disallows any command that could modify the repository.
GIT_ANNEX_SHELL_LIMITED
If set, disallows running git-shell to handle unknown commands.
SEE ALSO
git-annex(1)
git-shell(1)
AUTHOR
Joey Hess <joey@kitenet.net>
<http://git-annex.branchable.com/>
git-annex-shell(1)