Sponsored Content
Full Discussion: help with data type sizes
Top Forums Programming help with data type sizes Post 302488775 by DGPickett on Tuesday 18th of January 2011 11:14:59 AM
Old 01-18-2011
Yes, people love to argue with the term "heap". Yackety yack, but it does not improve functional understanding.

Everything but the stack comes out of the address space at the bottom, starting with code load, initial dynamic library load (which is mmap()), globals, statics; all as the sections they are in are encountered, and then dynamic additions: ld() calls laying down dynamically linked (again via mmap()), malloc/calloc/realloc(), explicit mmap(), object new, etc. If you mmap(), the files under this VM are not the swap, but the mmap()'d file's area. Everyone executes the same RAM pages of /lib/libc.so, for instance, but possibly at different local VM offsets.

The stack grows down from the top of the address space, with subroutine parameters, automatic variables, allloca() calls (deprecated but deliciously cheap since return does an implicit free()). While automatic arrays are stored here, automatic pointers are here but initialization objects they point to are mostly not here. Space is allocated with calls and automatic declarations and freed with return, and the return value overwrites/redefines the 'top' of the stack. The language metaphors of the stack like tops are "heap-esque", since it is a metaphor for a stack of sheets of paper, but it was handy to allocate it down from the top. Most systems have CPU binary info on the same stack, to restore state on return. Sometimes registers are pushed on call and restored on return. This way, each lower level subroutine gets the free use of registers it needs without first saving and finally restoring the content, when the content might be worthless. Compilers can assign call/return parameters to registers for the call of the bottom level subroutines, saving RAM activity on the stack in the inner parts of loops.

Sometimes the CPU hardware stack is not friendly to programmer data, and the stack is realloc()'d on the heap, and so grows upward.

A system might have an odd allocation scheme where the VM is subdivided into pieces that can all grow independently from the bottom without the restriction of items being allocated in the way. Some systems use segmentation, where the virtual memory is divided into N separate spaces. The problem is, usually these spaces are not big enough, or too few, and the schemes usually shrink the segment space when they devote address bits to the segment number. The x86 segmentation, as I recall, can have 16384 segments, half nominally for the system, and they span a million either bytes or 4KB pages, but in the latter case length is enforced only to the page. In unsegmented space, a really bad offset on a pointer to the stack can look into a legally readable part of the heap. UNIX generally always uses unsegmented space.

Yes, comparing addresses of items not in the same array is nonsense, except as research, for instance if you desire to do some raw binary i/o. Even then, it is nicer to make a struct or object for such purposes, using #pragma pack if you dislike the amount of padding/alignment. Beware of the other-endian systems!
 

10 More Discussions You Might Find Interesting

1. Programming

FILE data type

Hi all, Can anyone tell me a little about the datatype FILE, which represents stream. What does its structure look like, and in which header file is it defined and so on... Ex : FILE *fp ; fp = fopen("filename", "w") ; (6 Replies)
Discussion started by: milhan
6 Replies

2. Programming

time_t data type-- what does start +1 mean?

Hi, I am trying to understand an very old C program. .... time_t start, end; ptr = localtime(&start); ... fprintf(out, "%-35s 01 %5s %2s %10d 1 5 /tty/M%d/%02d %24s", buffer3, job, ver, start, mach_num,atoi(buffer), asctime(ptr)); fprintf(out, "%-35s 03 %5s %2s %10d 1 5... (9 Replies)
Discussion started by: whatisthis
9 Replies

3. Programming

data type limitation

I am writing some code to do analysis on the file system (HP-UX 11.11). I am using stat(..) to get file information. My problem is that the file-size may exceed the data types defined in 'sys/stat.h' & 'sys/types.h' respectively. Thus file-sizes in the Giga-byte range are not read correctly.... (2 Replies)
Discussion started by: ALTRUNVRSOFLN
2 Replies

4. AIX

Value too large to be stored in data type???

Hello, I get this message : "Value too large to be stored in data type" when I try to open a 3Gb file. Can someone helps me to resolve the problem. Thank you very much (5 Replies)
Discussion started by: limame
5 Replies

5. UNIX for Dummies Questions & Answers

Directorie listing in Human form for data sizes

I have seen it done at my job before, there is a command that will make a notepad and show the directorie path, subfolders, and size of the subfolders? But i dont want it to go lower than 2 levels for example: folder_01 10 GB subfolder_02 10 GB subfolder_03 10 GB... (4 Replies)
Discussion started by: JUSSAN007
4 Replies

6. Shell Programming and Scripting

Perl data type checking

I am using perl 5.8.0. I need to check some values to see it they are floats. Our system does not have Data::Types so I can't use is_float. Is there something else that I can use? The only thing in Data is Dump.pm. I am not allowed to download anything to our system so I have to use what I have.... (3 Replies)
Discussion started by: ajgwin
3 Replies

7. UNIX for Advanced & Expert Users

Memory allocation for float data type

Dear All, How internally memory allocated when we declare the float data type. how many bytes allocated for decimal and how many bytes for fraction. kindly help me in this regards. (2 Replies)
Discussion started by: rajamohan
2 Replies

8. Shell Programming and Scripting

Can I split a 10GB file into 1 GB sizes using my repeating data pattern

I'm not a unix guy so excuses my ignorance... I'm the database ETL guy. I'm trying to be proactive and devise a plan B for a ETL process where I expect a file 10X larger than what I process daily for a recast job. The ETL may handle it but I just don't know. This file may need to be split... (3 Replies)
Discussion started by: john091
3 Replies

9. Web Development

Data type to use for prices with commas

Hi everybody, I`m very new with PHP and Databases and I having the follow issue with prices data.. The original information is in CSV files. The prices have formatted with commas and dots as follow: 12,300.99 -->(thousands separated by commas) 3,500.25 -->(thousands separated... (10 Replies)
Discussion started by: cgkmal
10 Replies

10. Programming

Incompatible data type fpos_t in C

This is from a program I wrote over in 1998 that I am trying to compile on a linux machine: void write_line (FILE *fp, int rec_no, line_rec *arec) { fpos_t woffset; woffset = (rec_no - 1) * sizeof(line_rec); fsetpos(fp,&woffset); fwrite(arec,sizeof(line_rec),1,fp); }On the line... (2 Replies)
Discussion started by: wbport
2 Replies
GIT-RERERE(1)							    Git Manual							     GIT-RERERE(1)

NAME
git-rerere - Reuse recorded resolution of conflicted merges SYNOPSIS
git rerere [clear|diff|status|gc] DESCRIPTION
In a workflow employing relatively long lived topic branches, the developer sometimes needs to resolve the same conflicts over and over again until the topic branches are done (either merged to the "release" branch, or sent out and accepted upstream). This command assists the developer in this process by recording conflicted automerge results and corresponding hand resolve results on the initial manual merge, and applying previously recorded hand resolutions to their corresponding automerge results. Note You need to set the configuration variable rerere.enabled in order to enable this command. COMMANDS
Normally, git rerere is run without arguments or user-intervention. However, it has several commands that allow it to interact with its working state. clear This resets the metadata used by rerere if a merge resolution is to be aborted. Calling git am [--skip|--abort] or git rebase [--skip|--abort] will automatically invoke this command. diff This displays diffs for the current state of the resolution. It is useful for tracking what has changed while the user is resolving conflicts. Additional arguments are passed directly to the system diff command installed in PATH. status Like diff, but this only prints the filenames that will be tracked for resolutions. gc This prunes records of conflicted merges that occurred a long time ago. By default, unresolved conflicts older than 15 days and resolved conflicts older than 60 days are pruned. These defaults are controlled via the gc.rerereunresolved and gc.rerereresolved configuration variables respectively. DISCUSSION
When your topic branch modifies an overlapping area that your master branch (or upstream) touched since your topic branch forked from it, you may want to test it with the latest master, even before your topic branch is ready to be pushed upstream: .ft C o---*---o topic / o---o---o---*---o---o master .ft For such a test, you need to merge master and topic somehow. One way to do it is to pull master into the topic branch: .ft C $ git checkout topic $ git merge master o---*---o---+ topic / / o---o---o---*---o---o master .ft The commits marked with * touch the same area in the same file; you need to resolve the conflicts when creating the commit marked with {plus}. Then you can test the result to make sure your work-in-progress still works with what is in the latest master. After this test merge, there are two ways to continue your work on the topic. The easiest is to build on top of the test merge commit {plus}, and when your work in the topic branch is finally ready, pull the topic branch into master, and/or ask the upstream to pull from you. By that time, however, the master or the upstream might have been advanced since the test merge {plus}, in which case the final commit graph would look like this: .ft C $ git checkout topic $ git merge master $ ... work on both topic and master branches $ git checkout master $ git merge topic o---*---o---+---o---o topic / / o---o---o---*---o---o---o---o---+ master .ft When your topic branch is long-lived, however, your topic branch would end up having many such "Merge from master" commits on it, which would unnecessarily clutter the development history. Readers of the Linux kernel mailing list may remember that Linus complained about such too frequent test merges when a subsystem maintainer asked to pull from a branch full of "useless merges". As an alternative, to keep the topic branch clean of test merges, you could blow away the test merge, and keep building on top of the tip before the test merge: .ft C $ git checkout topic $ git merge master $ git reset --hard HEAD^ ;# rewind the test merge $ ... work on both topic and master branches $ git checkout master $ git merge topic o---*---o-------o---o topic / o---o---o---*---o---o---o---o---+ master .ft This would leave only one merge commit when your topic branch is finally ready and merged into the master branch. This merge would require you to resolve the conflict, introduced by the commits marked with *. However, this conflict is often the same conflict you resolved when you created the test merge you blew away. git rerere helps you resolve this final conflicted merge using the information from your earlier hand resolve. Running the git rerere command immediately after a conflicted automerge records the conflicted working tree files, with the usual conflict markers <<<<<<<, =======, and >>>>>>> in them. Later, after you are done resolving the conflicts, running git rerere again will record the resolved state of these files. Suppose you did this when you created the test merge of master into the topic branch. Next time, after seeing the same conflicted automerge, running git rerere will perform a three-way merge between the earlier conflicted automerge, the earlier manual resolution, and the current conflicted automerge. If this three-way merge resolves cleanly, the result is written out to your working tree file, so you do not have to manually resolve it. Note that git rerere leaves the index file alone, so you still need to do the final sanity checks with git diff (or git diff -c) and git add when you are satisfied. As a convenience measure, git merge automatically invokes git rerere upon exiting with a failed automerge and git rerere records the hand resolve when it is a new conflict, or reuses the earlier hand resolve when it is not. git commit also invokes git rerere when committing a merge result. What this means is that you do not have to do anything special yourself (besides enabling the rerere.enabled config variable). In our example, when you do the test merge, the manual resolution is recorded, and it will be reused when you do the actual merge later with the updated master and topic branch, as long as the recorded resolution is still applicable. The information git rerere records is also used when running git rebase. After blowing away the test merge and continuing development on the topic branch: .ft C o---*---o-------o---o topic / o---o---o---*---o---o---o---o master $ git rebase master topic o---*---o-------o---o topic / o---o---o---*---o---o---o---o master .ft you could run git rebase master topic, to bring yourself up-to-date before your topic is ready to be sent upstream. This would result in falling back to a three-way merge, and it would conflict the same way as the test merge you resolved earlier. git rerere will be run by git rebase to help you resolve this conflict. AUTHOR
Written by Junio C Hamano <gitster@pobox.com[1]> GIT
Part of the git(1) suite NOTES
1. gitster@pobox.com mailto:gitster@pobox.com Git 1.7.1 07/05/2010 GIT-RERERE(1)
All times are GMT -4. The time now is 08:24 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy