Sponsored Content
Special Forums Hardware DD command using block device as input Post 302666117 by nytty on Tuesday 3rd of July 2012 06:03:41 PM
Old 07-03-2012
At the application level page size is an important concept, it's the unit of interaction with the disk. Imagine a database system requesting a record A, it'd be completely inefficient to only read this record (couple of bytes), instead we collocate a bunch of records in a page and we bet on spatial/temporal locality ...
It's a tradeof, if you set the page size to too big, you risk over reading stuff you dont need. Too small, and you risk to get multiple requests for otherwise contiguous records. A bit what the os does with 4096b pages.
I am trying to study that, using a buffered read of different sizes and calculate the throughtput ... I know only basics about disks, but i am certain that the metric i am studying is not uniform, thus doing the math is just meaningless.
I should cope with all parameters(cache,vm,readahead..ect) and have something like:
bs=512b 0.01sec 50kb/s
bs=16kb 0.0004sec 164mb/s
bs=2M 0.01sec 200mb/s
Then i will decide that 16kb is the best time vs throughtput trade off and this will be my page size.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

what is the command for listing the device specs in solaris

Im looking to get the statistics on a machine memory, cpu speed drive size etc thanks in advance (3 Replies)
Discussion started by: simplimarvelous
3 Replies

2. Solaris

block device problem

Hi ...... I have file system problem when i try to mount get the following message : mount: /dev/rdsk/c1t4d0s7 not a block device .... I run fsck it's ok ,,,, after run newfs -N /dev/dsk/c1t4d0s7 and fsck -o b=535952 /dev/dsk/c1t4d0s7 .............it's ok ........ At the and when i try... (2 Replies)
Discussion started by: tt155
2 Replies

3. UNIX for Dummies Questions & Answers

problem with output of find command being input to basename command...

Hi, I am triying to make sure that there exists only one file with the pattern abc* in path /path/. This directory is having many huge files. If there is only one file then I have to take its complete name only to use furter in my script. I am planning to do like this: if ; then... (2 Replies)
Discussion started by: new_learner
2 Replies

4. Linux

shrinking root partition and using free space to create a block device

We are intending to protect a set of user specified files using LVM mirroring where the protected space on which the user files are stored is mirrored on an LV on a different disk. Our problem is that for a user with a custom layout has installed linux with 2 partitons for swap and / and there is... (0 Replies)
Discussion started by: kickdgrass
0 Replies

5. Red Hat

How to Block the USB device

Hi friends, I wanna know how to block USB devices in my RedHat flavor Operating system. regards, Prakash (3 Replies)
Discussion started by: prakashkumar41
3 Replies

6. Shell Programming and Scripting

Block device fs vs normal directory

I talked with this guy who seems to think loop mounting a fs ext3 image on a directory, as opposed to just using the underlying filesystem, will work better as far as IO conflicts. I have no idea why this would be better? I haven't been able to contact him. Basically we have a daemon that... (0 Replies)
Discussion started by: stevenswj
0 Replies

7. Linux

Block device fs vs normal directory

I use CentOS I talked with this guy who seems to think loop mounting a fs ext3 image on a directory, as opposed to just using the underlying filesystem, will work better as far as IO conflicts. I have no idea why this would be better? I haven't been able to contact him. Basically we have a... (1 Reply)
Discussion started by: stevenswj
1 Replies

8. Shell Programming and Scripting

tcgetattr: Inappropriate ioctl for device after ssh command

Hello everyone I am finishing a script allowing me to purge logs on multiple servers, i have one last pb with the ssh command.........it is throwing me the following error : tcgetattr: Inappropriate ioctl for device (full screen in attached file 1, full script in attached file 2) It... (15 Replies)
Discussion started by: jimmy75_13
15 Replies

9. UNIX for Advanced & Expert Users

Command to see the logical volume path, device mapper path and its corresponding dm device path

Currently I am using this laborious command lvdisplay | awk '/LV Path/ {p=$3} /LV Name/ {n=$3} /VG Name/ {v=$3} /Block device/ {d=$3; sub(".*:", "/dev/dm-", d); printf "%s\t%s\t%s\n", p, "/dev/mapper/"v"-"n, d}' Would like to know if there is any shorter method to get this mapping of... (2 Replies)
Discussion started by: royalibrahim
2 Replies

10. OS X (Apple)

Change Name of Bluetooth Device from Command Line in macOS

Mac Version 10.15.2 (macOS Catalina) Does anyone know how to change the name of a connected bluetooth device from the command line on macOS? I am having trouble with various bluetooth devices which I cannot get the "rename" option in the GUI to "save" properly and so I cannot rename a few... (0 Replies)
Discussion started by: Neo
0 Replies
vps_ceiling(5)							File Formats Manual						    vps_ceiling(5)

NAME
vps_ceiling - maximum (in kilobytes) of system-selectable page size VALUES
Default Allowed values DESCRIPTION
The Translation Look-aside Buffer (TLB) is a microprocessor feature for virtual memory, where the most recent physical to virtual address translations are cached, in the expectation that these translations are likely to be needed again soon. This is based on the principles of spatial and temporal locality of address references in programs. Historically, the TLB was entirely managed within hardware to achieve speed optimizations while sacrificing the flexibility of software implementations. For example, easily changed algorithms or table imple- mentations. In recent years, the flexibility of a software implementation of the TLB has regained importance over pure hardware speed. Specifically, the idea of logical grouping of physical frames (whose size is fixed in hardware) into 'superpages' or 'large pages', that can be repre- sented in software TLB algorithms using a single base address translation for many physical frames, significantly reduces the lost cycles due to page faults (assuming reasonable spatial and temporal locality). For example, consider a scientific application working on an array where each element requires 1 KB of memory. Using the usual 4 KB physical frame size and referencing the array sequentially causes a page fault that requires the page be read into memory from disk or swap, and loads the TLB with the frame base address translation at every fifth element. If a user application does not use the command to specify a page size for the program text and data segments, the kernel automatically selects a page size based on system configuration and object size. This selected size is then compared to the maximum page size defined by the tunable, and if the selected size is larger, the value of is used instead. Then, the value is compared against the minimum page size as set by and the larger of the two values is used. Who is Expected to Change This Tunable? Anyone. Restrictions on Changing Changes to this tunable take effect for any subsequent physical memory allocations. It does not affect any physical memory that has already been allocated. When Should the Value of This Tunable Be Raised? This tunable can be raised when processes on the system access their text and data in a regular fashion, and over a range of data larger than the current value. For example, if this tunable is set to 16 KB, but almost every process on the system repeatedly works with a four or five distinct 256 KB data sets, then raising the tunable to 256 would reduce the page faulting for these processes because 16 of the previously 16 KB pages are now addressed by a single 256 KB translation. Average system behavior is not likely to display uniformity of memory access and the optimal value is not easy to determine, so this tun- able only represents the upper value for the kernel heuristic and may not change the actual system behavior. What Are the Side Effects of Raising the Value? Memory allocations will require larger groups of contiguous pages, if either is also raised or the kernel heuristic chooses a larger value. This can lead to undesired behavior. For example, when a program is reading in the last 4 KB of code from disk with the default value, this means 16 KB of contiguous physical memory must be found and set up with the appropriate virtual translation, even though, only 4 KB of data will actually be on it. Consider the maximum, where 64 megabytes of contiguous physical memory is allocated for every new virtual page the program uses, even if, only 4 KB of that is actually used. Besides the wasted physical memory here, there is also an issue of delays due to fragmentation that many contiguous frames of physical memory may not be available and a process may be stalled waiting on the allocation when the amount of memory it actually needs is available. Therefore, it is best to only raise this tunable if you know precisely the memory usage of the system. In general, increasing the variable page size on a per application basis for known applications, such as, databases which scan large amounts of data with only one page fault, is a much better practice. Modern architectures support very large pages (up to 4 GB for Itanium and up to 1 GB for PA-RISC). Setting to very large sizes (greater than 64 KB) should be done with extreme caution since it can cause excessive memory consumption and quickly deplete the amount of free mem- ory available on the machine. When Should the Value of This Tunable Be Lowered? The tunable should be lowered if physical memory fragmentation is preventing small memory processes from running due to waiting on contigu- ous chunks of memory, or if the overall system usage of memory displays poor spatial locality (virtual accesses are not close to each other) producing wasted physical frames. What Are the Side Effects of Lowering the Value? Applications such as databases will suffer more page faults to get their working set into memory, but this can be handled by using with the appropriate application. What Other Tunables Should Be Changed at the Same Time? should be considered, being the minimum bound on the kernel heuristic range. WARNINGS
All HP-UX kernel tunable parameters are release specific. This parameter may be removed or have its meaning changed in future releases of HP-UX. Installation of optional kernel software, from HP or other vendors, may cause changes to tunable parameter values. After installation, some tunable parameters may no longer be at the default or recommended values. For information about the effects of installation on tun- able values, consult the documentation for the kernel software being installed. For information about optional kernel software that was factory installed on your system, see at AUTHOR
was developed by HP. SEE ALSO
vps_pagesize(5). Tunable Kernel Parameters vps_ceiling(5)
All times are GMT -4. The time now is 02:04 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy