Opinion on auto-restart of failed apps/services Post: 302523365

Sponsored Content

Top Forums UNIX for Advanced & Expert Users Opinion on auto-restart of failed apps/services Post 302523365 by mglenney on Wednesday 18th of May 2011 04:45:43 PM

05-18-2011

Registered User

Opinion on auto-restart of failed apps/services

I'm becoming a dying breed where I work. More and more sys admins are advocating automatically restarting failed services such as tomcat, jboss, etc. I've always been against doing this except with buggy apps that can't be fixed or avoided.

My main argument is that I feel it's a trick used by lazy sys admins who don't want to troubleshoot their apps. Almost everything we have that is customer facing is behind a load balancer (we have a lot of customers). If the LB is properly configured, it will pull a node out of the rotation if it fails a health check. If the pool is sized properly it will have at least n+1 servers running and should be able to handle the load if one node dies or is removed. I feel we should let the app fail, alert on it, remove it from the pool, and troubleshoot it to find out why. Turn up a new node to take it's place if necessary. If the bad app is auto restarted and it is indeed bad, we will continue to route customers to it and it could negatively affect them.

They argue that "apps just fail" and that we should restart them asap to keep them up and servicing customers.

I'm starting to feel like the old geezer of the group and these damn kids won't get off my lawn. If you wouldn't mind, please let me know your take on this. I'm not looking for everyone to agree with me and I'm not against changing my views. They just haven't provided a good argument.

Thanks,

MG

mglenney

View Public Profile for mglenney

Find all posts by mglenney

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Auto Detection/Restart of Sybase Deadlocks

Does anyone have an example of a ksh script that executes a Sybase stored procedure, via the ISQL command, and can detect a deadlock and loop until the process completes successfully? I'm a little confused on where to start. Thanks in advance for any assistance you can provide.

2. Linux

file location for GNOME auto startup apps

I know how to add an apps to auto-start in GUI, but I'd like to know how to do it mannualy. So where is the file saved to by GUI ?

3. HP-UX

Script to auto restart a service

Hi All, May i please know if it is possible to write a script to check the log messages and automatically restart a service if it is failed or it is stopped. Appreciate your suggestions. Thanks in advance. regards, Eajaz

4. Shell Programming and Scripting

Auto restart script does not work

I have a service that are not 100% stable and stops from time to time. So I have a script that do restart the service if it does not run. This script works win on Ubuntu 9.04 but will not start the service in Ubuntu 10.10 If I run the part that do starts the service from CLI, it starts...

5. AIX

problem to restart services from /etc/inittab in AIX6.1

hello, i have an AIX6.1.7.2 machine that it was upgraded recently from AIX5.3.9.4. when i kill system services that should restart automatically like /usr/sbin/cron it doesnt start. i checked my /etc/inittab file and i confirmed that this service is in respawn status so when i kill this process...

6. Shell Programming and Scripting

Need script to restart the services

Hi Guys, I need bash script to restart the service. 1. Disable the service called SASM svcadm disable sasm 2. if service went to maintenance mode then it shuld clear it with below command svcadm clear sasm 3.or else it should restart the mysql service /etc/init.d/mysql stop...

7. Red Hat

Restart of services if port no is changed in /etc/services in RHEL

I had a doubt if any services need to be restarted if port no in /etc/services in an RHEL setup is changed. For eg, the port no of 443 for SSL may need to be changed. I hope my query is clear whether any services need to be restarted if port no in /etc/services is changed. Please revert with...

8. Shell Programming and Scripting

Script to auto restart java for 100 percent

I want the tomcat to restart when java goes 100% cpu utilize and remain on this , Get pid kill and start tomcat . top | grep java We can get pid and cpu utilize , But how can we do on run time. Please use code tags as required by forum rules!

9. Debian

How do i correct restart network-services in Debian?

Hello, I would like to do follow steps. Set a static IP-Adress on eth0 (For Testing) Set DHCP on eth0 All steps should be done without a single reboot. /etc/network/interfaces iface eth0 inet static address 192.0.2.7/24 gateway 192.0.2.254How do i perform...

LEARN ABOUT OPENDARWIN

consolemessage

ConsoleMessage(8)					    BSD System Manager's Manual 					 ConsoleMessage(8)

NAME

     ConsoleMessage -- Send a message to SystemStarter

SYNOPSIS

     ConsoleMessage [-v] message
     ConsoleMessage [-v] -S
     ConsoleMessage [-v] -F
     ConsoleMessage [-v] -s service
     ConsoleMessage [-v] -f service
     ConsoleMessage [-v] -q setting
     ConsoleMessage [-v] -b path
     ConsoleMessage [-v] -u

DESCRIPTION

     The ConsoleMessage utility may be used by startup item scripts to send messages to SystemStarter (see SystemStarter(8)).

     The default behavior is to send the specified message to SystemStarter to be displayed on the console.  SystemStarter will attempt to local-
     ize the string using the current startup item's localization dictionaries.

     ConsoleMessage may also be used to give feedback to SystemStarter indicating which services provided by the startup item have succeeded or
     failed.

OPTIONS

     -v       verbose mode (prints errors to stdout)

     -S       mark all services provided by this item as successful

     -F       mark all services provided by this item as failed

     -s       mark the service as successful

     -f       mark the service as failed

     -q       query SystemStarter for the value of the configuration variable setting (result will be printed to stdout).

     -b       Tell SystemStarter to load the display bundle at the specified path

     -u       Tell SystemStarter to unload the current display bundle

NOTES

     When a service name is not specified, ConsoleMessage assumes its parent process identification (see getppid(2)) is that of a startup item
     script, and uses that token to find the correct list of services provided by the current item. If the process calling ConsoleMessage is not a
     startup item script, it is necessary to explicitly provide service names.

SEE ALSO

     SystemStarter(8)

     http://www.opensource.apple.com/projects/documentation/howto/html/SystemStarter_HOWTO.html

HISTORY

     The ConsoleMessage utility appeared in Darwin 6.0

Darwin								  April 12, 2002							    Darwin