Gawk: error memory allocation in HP-UX Post: 302916110

Sponsored Content

Top Forums Shell Programming and Scripting Gawk: error memory allocation in HP-UX Post 302916110 by disedorgue on Sunday 7th of September 2014 06:04:56 AM

09-07-2014

Registered User

Hi,
Another method, but more slow because it use tmp file:

Code:

gawk 'BEGIN{FS=",";FILEO="outfile";MODULO=100;FILET="outtmp"}
{
	if (substr($1,3,1)=="-"){
		array[$5","$1","$5","$6","substr($1,1,2)","$2","$7","$4]++;
	}
	else{
		arraytmp[$5","$1","$5","$6","$1","$2","$7","$4]++;
	}
	if (NR%MODULO==0){
		while((getline line <FILEO)>0){
			split(line,a,",");
			b=a[1]","a[2]","a[3]","a[4]","a[5]","a[6]","a[7]","a[8];
			if(array[b]){
				line=b","array[b]+a[9];
				array[b]=0;
			}
			else{
				if(arraytmp[b]){
					line=b","arraytmp[b]+a[9];
					arraytmp[b]=0;
				}
			}
			print line >FILET;
		}
		for (counter in array){
			if(array[counter]>0){
				print counter","array[counter] >FILET;
			}
		}
		for (counter in arraytmp){
			if(arraytmp[counter]>0){
				print counter","arraytmp[counter] >FILET;
			}
		}
		delete array;
		delete arraytmp;
		close(FILET);
		close(FILEO);
		system("mv "FILET" "FILEO);
	}
}
END{
		while((getline line <FILEO)>0){
			split(line,a,",");
			b=a[1]","a[2]","a[3]","a[4]","a[5]","a[6]","a[7]","a[8];
			if(array[b]){
				line=b","array[b]+a[9];
				array[b]=0;
			}
			else{
				if(arraytmp[b]){
					line=b","arraytmp[b]+a[9];
					arraytmp[b]=0;
				}
			}
			print line >FILET;
		}
		for (counter in array){
			if(array[counter]>0){
				print counter","array[counter] >FILET;
			}
		}
		for (counter in arraytmp){
			if(arraytmp[counter]>0){
				print counter","arraytmp[counter] >FILET;
			}
		}
		delete array;
		delete arraytmp;
		close(FILET);
		close(FILEO);
		system("mv "FILET" "FILEO);
}
' infile

Here, MODULO value is 100, but you should change with a biggest value as 8000000.

Regards.

disedorgue

View Public Profile for disedorgue

Find all posts by disedorgue

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

memory allocation

I would like to know how I could allocate some more memory to a process. Please note that I am not the root user.

2. UNIX for Advanced & Expert Users

Hello! First of all, forgive me for bad English. When I starts new thread (pthread_create), system allocates some memory for it (for example, for thread's stack). I wonder when does it deallocate this memory? The problem is that I have a program which sometimes creates new threads and sometimes...

3. HP-UX

HP-UX memory usage allocation

Hi all, I have a HP-UX Server with 4 gigabytes of physical RAM. When I use the 'Glance' utility to see what my memory utilization is, my memory usage shows up maxed out at 99%. I shut off all the known processes that I'm running on that box and the memory utilization is still at 78% (with Swap...

4. Programming

Memory allocation problem

I have a program that will fetch some particular lines and store it in a buffer for further operations.The code which is given below works but with some errors.I couldn't trace out the error.Can anybody help on this plz?? #include <stdio.h> #include <stdlib.h> #include<string.h> #define...

5. Programming

Is there a problem with the memory allocation???

I have a scenario like the client has to search for the active server.There will be many servers.But not all server are active.And at a time not more than one server will be active. The client will be in active state always i.e, it should always search for an active server until it gets one.I...

6. Programming

Memory allocation in C

Hi Experts I need some help in static memory allocation in C. I have a program in which I declared 2 variables, one char array and one integer. I was little surprised to see the addresses of the variables. First: int x; char a; printf("%u %u\n', &x, a); I got the addresses displayed...

7. Programming

Memory Allocation Query

When we dynamically allocate the memory say 100 integers say int *x = new int(1000); then does entire chunk of memory gets allocated at once after the completion of the statement? I mean will the the concept of page fault come into picture over here?

8. Shell Programming and Scripting

memory allocation to a variable

hello all.. i'm a beginner in shell scripting. I need to know what is really happening when we are creating a variable in shell scripting? how memory is allocated for that variable?

9. Programming

memory allocation for string in C

hi in the following code, how the memory is allocated for a1 which holds the values of a2 after cpy function call. #include <stdio.h> #include <string.h> void cpy(char* d, const char* s){ while(*d++=*s++); } main(){ char* a1; char* a2="done"; cpy(a1,a2); ...

10. Programming

C++/ROOT Memory Allocation?

Hello, I am new to C++ programming, so I'm still getting a feel for things. I recently wrote a simple C++ program (to be used as a ROOT Macro) to conduct a statistical analysis of a varied version of the Monty Hall problem (code below). Basically, the programs runs a few simple calculations to...

LEARN ABOUT DEBIAN

igawk

IGAWK(1)							 Utility Commands							  IGAWK(1)

NAME

       igawk - gawk with include files

SYNOPSIS

       igawk [ all gawk options ] -f program-file [ -- ] file ...
       igawk [ all gawk options ] [ -- ] program-text file ...

DESCRIPTION

       Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).

       AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like

	      @include getopt.awk

       in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.

OPTIONS

       See gawk(1) for a full description of the AWK language and the options that gawk supports.

EXAMPLES

       cat << EOF > test.awk
       @include getopt.awk

       BEGIN {
	    while (getopt(ARGC, ARGV, "am:q") != -1)
		 ...
       }
       EOF

       igawk -f test.awk

SEE ALSO

       gawk(1)

       Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.

AUTHOR

       Arnold Robbins (arnold@skeeve.com).

Free Software Foundation					    Nov 3 1999								  IGAWK(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

memory allocation

Discussion started by: sagar

2. UNIX for Advanced & Expert Users

threads and memory allocation

Discussion started by: prankster