I wrote a shell script, which let me manage dns records through an api.
The raw core-command looks like about this:
The output contains a list of all zones with all records and is about 800 Kilobytes JSON-Data.
I ran into a first issue when I used this(incorrect) try to remove leading 000 from the 800K-variable:
I think the correct term should be ${output#000}. Maybe this is an error when I typed something in without being completely aware, what I'm doing. The resulting regex caused the program did not finish this command. I assume the pattern required a huge amount of computing in that 800K-variable.
My question is:
Are there - in your experience - other general caveats, why one generally should refrain from using such big variable content sizes? As far as I read, there are no relevant size limits within linux regarding variables(for data sizes <100MB). Or would it be generally better, to use files for data at a certain limit?
We have EDP members will do some testing job in my system , but sometimes these process will generate some error to the system log or any file ( usually the members don't know the log is reached to this level ) , then make the system crashed , could suggest the way how can to prevent this problem ?... (2 Replies)
I would like to edit a doc which is large file size. I can't use "vi" command due to out of memory.
$ vi large.dat
ex: 0602-101 Out of memory saving lines for undo.
Please help. Thanks. (2 Replies)
Hi,
I have a large file with a repeating pattern in it. Now i want the file split into the block of patterns with a specified no. of lines in each file.
i.e. The file is like
1...
2...
2...
3...
1...
2...
3...
1...
2...
2...
2...
2...
2...
3...
where 1 is the start of the block... (5 Replies)
Hi everybody,
I am currently trying to develop a simple content management system where I have an internal website for my users to upload large files onto the server. The site is password protected and my users won't be trying to hack into the system so security is a non-factor (as least for... (3 Replies)
Hi
I am new to shell scripting.I want to create a batch file which creates a desired number of files with a specific size say 1MB each to consume space.How can i go about it using for loop /any other loop condition using shell script?
Thanks (3 Replies)
We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096 bytes.
Linux has /etc/network/interfaces. Does ANYONE remember the equivalent in Unix? When I do ifconfig eth0 mtu 4000, I get the error... (0 Replies)
Greetings, I'm stuck in a time warp using ancient machines from the prehistoric era that should be rightfully displayed in the Smithsonian.
We're running Solaris 7 on FDDI n/w on an E6500 host and wish to use MTU (packet size) > 1500, more like 3072 bytes to begin with and possibly up to 4096... (9 Replies)
Hi,
I've some directory that I used as working directory for a program. At the end of the procedure, the content is deleted. This directory, when I do a ls -l, appears to still take up some space. After a little research, I've seen on a another board of this forum that it's not really taking... (5 Replies)
Hi All,
This is my first post here. Hoping to share and gain knowledge from this great forum !!!!
I've scanned this forum before posting my problem here, but I'm afraid I couldn't find any thread that addresses this exact problem.
I'm trying to split a large XML file (with multiple tag... (7 Replies)
I wanted to know what is the best way to query json formatted files for content? Ex. Data
https://usn.ubuntu.com/usn-db/database-all.json.bz2
When looking at keys as in:
import json
json_data = json.load(open('database-all.json'))
for keys in json_data.iterkeys():
print 'Keys--> {}... (0 Replies)
Discussion started by: metallica1973
0 Replies
LEARN ABOUT DEBIAN
byteprefix
BYTEPREFIX(5) File Formats Manual BYTEPREFIX(5)NAME
byteprefix - Configuration for display of sizes
DESCRIPTION
There are two standard ways to use units in computing: base 10 (1 k = 10^3 = 1 000) and base 2 (1 K = 2^10 = 1 024). Historically, most
computer programs have used units in base 2, where 1 KB = 1 024 bytes, 1 MB = 1 048 576 bytes, etc. However, users are more likely to
expect and understand sizes in base 10, as this is the norm outside of computing.
This configuration file is a method for configuring programs (that use libkibi) to display sizes in the user's preferred style. It can be
configured through a configuration file or environment variable (which takes precedence).
When not using the "historic" style, IEC-style prefixes (KiB, MiB, etc.) are used for base 2 units, to disambiguate them from base 10 units
(kB, MB, etc.).
OPTIONS
There are three possible styles (Default: base10):
base2 Display all sizes in Base 2 with IEC prefixes.
1 KiB = 1 024 bytes.
1 MiB = 1 024 KiB = 1 048 576 bytes.
1 GiB = 1 024 MiB = 1 048 576 KiB = 1 073 741 824 bytes.
base10 Display all sizes in Base 10, except for sizes of RAM, which use base 2 with IEC prefixes.
Everything except RAM:
1 kB = 1 000 bytes.
1 MB = 1 000 kB = 1 000 000 bytes.
1 GB = 1 000 MB = 1 000 000 kB = 1 000 000 000 bytes.
RAM:
1 KiB = 1 024 bytes.
1 MiB = 1 024 KiB = 1 048 576 bytes.
1 GiB = 1 024 MiB = 1 048 576 KiB = 1 073 741 824 bytes.
historic
Display all sizes in Base 2, without IEC prefixes.
1 KB = 1 024 bytes.
1 MB = 1 024 KB = 1 048 576 bytes.
1 GB = 1 024 MB = 1 048 576 KB = 1 073 741 824 bytes.
Not recommended. This style uses base units 2 with prefixes usually associated with base 10 units. While it uses KB rather than the
SI (base 10) kB, there is no such distinction beyond the kilobyte range, and the units are ambiguous.
ENVIRONMENT
BYTEPREFIX
This environment variable will override the configured or default style. It should just contain one of the style names, listed in
OPTIONS above.
XDG_CONFIG_HOME
The location of the user's configuration files. If not set, it will be assumed to be ~/.config.
FILES
The preferred style can be set in a system-wide configuration file and/or in user's own configuration file (which will take precedence).
If no configuration file exists, the default style is base10.
/etc/byteprefix or XDG_CONFIG_HOME/byteprefix
This file should contain a single line: format=style. Lines beginning with # are treated as comments.
EXAMPLE
A user wanting base 2 display can set the following in ~/.config/byteprefix:
format=base2
SEE ALSO units(7)libkibi January 2011 BYTEPREFIX(5)