Runaway process. Opinions needed


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Runaway process. Opinions needed
# 1  
Old 07-08-2003
Runaway process. Opinions needed

not too long ago, i wrote a very short script that will bring up 4 customized xterms. The script went completely abnormal simply because of an error I had made in a while loop. This script took control of the system and rendered everything useless. The system admin team which i was part of tried every command we could think of to kill this damn script but nothing worked. We tried fuser -k, pkill etc. Fuser -k could have worked but this script had spawn way too many pids for fuser to handle. As fuser was killing them, hundreds more were being born. the output from the uptime command was mind blowing (over 240)

now, from reading countless numbers of books, i knew there was a way I could have killed the person who started this script, which was me but I couldn't remember what command it was. To make a long story short, we had to reboot the server inorder for it to work properly

My question is, could there have been any other way we could have killed this process besides having to reboot it? I hate to fall in this same status quo again.
# 2  
Old 07-08-2003
The first thing to do if you could not find the correct pid to kill was to remove the option to start another process.

If the process was running a certain program or script, change the permissions on it so it can't be executed. Then you at least won't have more and more processes being created while you are trying to find the one process you need to kill.

You simple have to keep a level head - ask yourself
How were all these processes created? How can I stop more processes? How do I find the single process that will stop all of this?

You don't give enough info on your situation - I would think you could have found anyone of the processes and seen the parent pid to kill off. Sometimes that is difficult with the system getting slower and slower because of new processes being created.

Another quick way that may or may not work in your situation is to touch /etc/nologin.

Give more details.
# 3  
Old 07-08-2003
RTM, this sounds like a "while(1) fork();" situation. Every single process is trying to make more copies of itself.

You can su to the user in question. Then you can do: "kill -9 -1" which will kill every process owned by that user. That is the trick that I think you are looking for.

But: "kill -STOP -1" is more subtle. All of the user's processes will suddenly stop running. Then you can "kill -9" the bad guys. After the bad guys are gone, you can "kill -CONT" any good processes that you don't want to lose.

If your shell does not have kill as a built-in, there is a problem... you probably can't start another process to run the kill command. If that happens, use: "exec /usr/bin/kill -9 -1" or whatever.
# 4  
Old 07-08-2003
To tell you guys the truth, i panicked when this happened to me because i have never been a deadly situation like this before. I use to be that cautious admin that did only what he had to until i got lazier and decided to write more and more and more scripts.

anyway, the system was SunOS 5.8. and since i loved the bash shell and this particular script was being run in the bash shell, i issued the command "fuser -k /bin/bash" which seemed to work but the consistent rebirth of this never-dieing processes rendered this command ineffective

mind you, if it wasn't for the fact that the system was getting slower and slower, i probably would have done something smarter but i had to think quicker than the rest of the admins in my team. am the one that messed up here.


i think changing the ownership of the script that started this would have been the best way but "kill -9 -1" wouldn't have hurt to try out.

by the way, how do i use that command?

is it kill -9 -1 (the username) or what?
# 5  
Old 07-09-2003
It is just:
kill -9 -1
nothing after the -1 except carriage return.

And make sure that you su to the user first! If you run that kill command as root, you will kill everything.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. AIX

Runaway Processes (I think)

Folks I suck a lot of things and performance issue is one of them. After upgrading from 5300-06-03 to 5300-12-04 we started seeing an issue with some runaway processes. It varies as some of these processes have a TTY accociated with them and some do not. If you could give me any idea of what... (4 Replies)
Discussion started by: juredd1
4 Replies

2. Shell Programming and Scripting

Runaway String Problem

Database.txt John:30:40 echo -n "New Title Please :" read NewTitle awk -F":" 'OFS = ":"{ $1 = "'$NewTitle'" ; print $0 } ' Database.txt> Database2.txt mv Database2.txt Database.txt what this does, is that when i input something into $NewTitle, it will update $1 which is "John" into... (3 Replies)
Discussion started by: gregarion
3 Replies

3. Shell Programming and Scripting

Help needed in killing a process

I'm trying to kill a process which is in sleep mode and the parent PID is 1 but I can't kill it with "kill -9" command. Is there a way to kill this process without rebooting? Any help will be appreciated. Steve (10 Replies)
Discussion started by: stevefox
10 Replies

4. Shell Programming and Scripting

Opinions/Ideas/Suggestions needed

I'm currently developing a script to clean out certain directories based on age and name. Part of the assignment is to ensure that the cleaning of a directory is done under the user id of the owner (script is running as root). I have a few ideas on how to do this, but I'd like to hear your... (3 Replies)
Discussion started by: pludi
3 Replies

5. UNIX for Dummies Questions & Answers

Runaway process

Hello all, My hosting provider has contacted me in order to notify about a runaway process issue. Here it is: They have given me a list of those processes but I can neither analyze nor understand what I should do. DATE Fri Nov 21 21:32:29 GMT 2008 SINFO hostname:... (2 Replies)
Discussion started by: elwoodblues47
2 Replies

6. Shell Programming and Scripting

help needed to understand the process entry in ps -ef

Hi Guys, I am running a script which will refresh the views in my database. After running the script, when i ran ps -ef | grep "script_name" I found there are two entries for the same script process (actually 3 including the grep process). /bin/ksh path/scriptname sh -c... (4 Replies)
Discussion started by: mac4rfree
4 Replies

7. Windows & DOS: Issues & Discussions

Backing up virtual machines - opinions/suggestions needed.

Hi, I was required to do a backup of a virtual machine that runs on vmware. The guest operating system is windows, and the host is windows too. I have to backup the whole directory of the virtual machine (say in linux it'll be in /var/lib/vmware/virtual machines/) to a linux server. Initially... (0 Replies)
Discussion started by: 60doses
0 Replies

8. Programming

Runaway SIGALRM signal handler

I have written a program to demonstrate a problem I have encountered when using BSD style asynchronous input using the O_ASYNC flag in conjunction with a real time interval timer sending regular SIGALRM signals to the program. The SIGIO handler obeys all safe practices, using only an atomic update... (8 Replies)
Discussion started by: stewartw
8 Replies

9. UNIX for Advanced & Expert Users

process automation ...help needed

hi all i am working in a organisation where we are using Ab Initio tool for datawarehousing purpose.Ab initio is installed on a unix environment.after developing the code we migrate it to production using certain commands which gets executed in the unix box.there are specific number of predefined... (6 Replies)
Discussion started by: dr46014
6 Replies

10. UNIX for Dummies Questions & Answers

Runaway processes killed (Really need help)

I got about more than 300 emails from root with the subject "Runaway processes killed" saying that "13146 12737 97.7 6 bash" . So what should I do? Any help would be appreciate (2 Replies)
Discussion started by: Micz
2 Replies
Login or Register to Ask a Question