Your system has absolutely all available memory (including swap) exhausted. Which process is the culprit is everybodies guess. I suppose you have some memory-leak there.
The only option is: if you can, shut down Oracle, which will free some memory and then try to immediately power-cycle the system. If this is not possible your only option is to power-cycle it the hard way. AIX fileystems can usually cope with this and if you do it at a time where DB activity is minimal the risk for the database is small. A bit of redo-log gymnastics is usually all it takes to recover.
I remember having had such a problem once, which was a version incompatibility between some Oracle component and the AIX version (5.2 ML1, IIRC). After updating to a fitting set of versions the problem was gone never to come back.
/tmp if swap is full. If you keep adding processes or they keep mallocing vm, swao gets exhausted. It can be hard to pinpoint or cure. You can see vm size on 'ps-el'.
Location: on the road for work; home is private time
Posts: 456
Thanks Given: 10
Thanked 108 Times in 100 Posts
You could try also - but mail fail due to lack of paging space - to increase the size of hd6 with
chps -s 4 hd6 (to add 4 logical partitions to paging space).
The tuneables to look at - to get warnings ahead of time - are:
In particular, the npswarn parameter can be used to take corrective action before you get into the situation that you have less than npskill pages (4k Pages!, so <4MByte by default) of paging space.
Note: since your probable memory is running as root (nokilluid == 0), it does not get killed automatically - even though the system is in npskill level.
What I used to have was a process running in the background that would wait to be woken by SIGDANGER and would activate a predefined, but inactive paging space - and start doing analysis while it was still possible.
In situations like this a command such as
can give some insight into what program/group of programs are having memory leak issues.
Location: on the road for work; home is private time
Posts: 456
Thanks Given: 10
Thanked 108 Times in 100 Posts
no, vm or avm is only addressable virtual memory. To really see paging space used you must use svmon. There is a column Pgsp
Further, ps counts everything as if it is unique - but many segments, especially shared memory code and data, as well as kernel.
In sample below see, amng others, that segments b000b and 20002 are everywhere. ps counts, i.e. reports them everytime as if they were only in their process.
Further, ps counts everything as if it is unique - but many segments, especially shared memory code and data, as well as kernel.
True. This is why it is a good idea to use ipcs to complement the output of ps and list all shared memory segments. It will take a while to rummage through my archive, but i used to have a script for that somewhere.... i will post it if i can find it.
Basically you can do a
to list PID (pid) and memory consumption (vsz) of each process ("args"=commandline, for reference) and crosscheck this with a ipcs -Sp.
Hello for all,
I am testing the behavior of a 32 bit application running on Solaris 5.10 (SPARC), and realize it reaches 4GB of memory and then crashes.
It doesn't matter the amount of used memory as application is intended to perform many transactions; rather, what I want to achieve is to... (2 Replies)
Hi all.
I wrote a program with the Motif Widget Toolkit. It has a
button and a scrollbar. When the user hits the button the
callback creates a new fork() thread. The new thread sleeps
for a while and then changes the position of the scrollbar.
It does this in an endless loop.
I need the... (2 Replies)
As we are facing issue with this server connection. The error is:
The system function gethostbyname() failed to find the client's host name.
how can i check if the server "server1" is able to resolve the client hostname (hosts / dns)?
i can ping the client from server.
any... (1 Reply)
Dear experts,
I have done a re-installation of sco unix openserver 5.0.5 and managed to create users. The problem am facing is that of one user logging in more than 5 times. How can i overcome this problem. the system give the error below.
-sh: fork failed - too many processes in sco unix... (5 Replies)
I have one 4GB, dual port HBA. Is each port rated for 4GB, or is it the whole HBA rated for 4GB?
Also, how do I determine which is port0 / port1 with "lscfg -vl fcs0" command. Thanks. (0 Replies)
I have log file whose size is 4 GB , i would like to split it to 1 gb each ,Can any one tell me the syntax of csplit comand for that.
I am using Sun0S 5.8 (3 Replies)
Hi,
It's my first time I will use a 4BG fiber with two ports on one card. I used only one port 2GB before.
What will be the drivers I need to install on my AIX5.3? Is the two ports going to be just one line? Or I can use the other ports on another connection.
Thanks in advance,
itik (1 Reply)
hi everyone,
have this little piece of code in order to help you understand my question
#include<stdio.h>
#include<unistd.h>
int main()
{
int i, pid;
pid = fork();
if(pid<0)
{
fprintf(stderr, "fork failed\n");
_exit(1);
}
if(pid==0)
{
printf("in Child\n");... (4 Replies)
I need a quick script that will serve as a sort of "real time monitor" for watching some log files. I am using Bourne shell in HP-UX 10.20. I have basically created a script that never ends, unless of course I manually terminate it. Here's the script (it's called qhistory):
clear
echo "REAL... (3 Replies)
Hello,
I need to make a gateway from Ethernet to RS-485. I am using stream socket, and I am programming in windows nt. I would like to know how could I use some functions from unix in windows nt. I would like to use the function fork(). Which library it uses and how can I get it? Can I... (1 Reply)