|
|
Sponsored Content
Operating Systems
Solaris
sc 3.2, load balanced apache offline on both nodes
Post 302335151 by upengan78 on Friday 17th of July 2009 11:41:00 AM
07-17-2009
clrg online apache-rg
clrg: (C748634) Resource group apache-rg failed to start on chosen node and might fail over to other node(s)
clrg: (C135343) No primary node could be found for resource group apache-rg; it remains offline
---------- Post updated at 10:41 AM ---------- Previous update was at 10:32 AM ----------
SOLVED
svcadm disable apache2 on both nodes
clrg online apache-rg
clrg status
clrg status
so now it is working fine. I am thinking that after httpd.conf issues, it was 'restarter' for svc:apache2 on the other node was causing issues. Again I had to disable apache2 using svcadm and then sun cluster could online apache-rg. Also now I remember I was trying to get SUNW.SMF_proxy_scalable to get working with apache2 but for some reason that did not work so I was trying load balancing with sunw.apache.
Thank you for helping me out dukenuke2. appreciate it.
clrg: (C748634) Resource group apache-rg failed to start on chosen node and might fail over to other node(s)
clrg: (C135343) No primary node could be found for resource group apache-rg; it remains offline
Quote:
Fri Jul 17 10:22:04 CDT 2009
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_MON_STARTING
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ON_STARTED
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_monitor_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.7>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)
Jul 17 10:21:23 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_MONITOR_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method MONITOR_START.
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_monitor_start (scalable svc)> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_ONLINE
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_ONLINE
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_JUST_STARTED
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE_UNMON
Jul 17 10:21:24 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE
Jul 17 10:21:24 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_ONLINE
Jul 17 10:21:25 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_probe]: [ID 670283 daemon.notice] Issuing a resource restart request because the application exited.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 494478 daemon.notice] resource apache-rs in resource group apache-rg has requested restart of the resource on tommy_sun.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_ON_PENDING_R_RESTART
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Service daemon not running.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_MON_STOPPING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_monitor_stop (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.8>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Service daemon not running.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_ON_PENDING_R_RESTART
Jul 17 10:21:25 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_MONITOR_STOP]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method MONITOR_STOP.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_monitor_stop (scalable svc)> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_ONLINE_UNMON
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE_UNMON
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:27 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:27 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:29 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:29 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun1> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 674214 daemon.notice] rebalance: no primary node is currently found for resource group <apache-rg>.
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:52 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:52 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:52 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:53 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2ES} =<1>, ...)
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun1> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 674214 daemon.notice] rebalance: no primary node is currently found for resource group <apache-rg>.
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_MON_STARTING
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ON_STARTED
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_monitor_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.7>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:23 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_MONITOR_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method MONITOR_START.
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_monitor_start (scalable svc)> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_ONLINE
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_ONLINE
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_JUST_STARTED
Jul 17 10:21:23 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE_UNMON
Jul 17 10:21:24 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE
Jul 17 10:21:24 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_ONLINE
Jul 17 10:21:25 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_probe]: [ID 670283 daemon.notice] Issuing a resource restart request because the application exited.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 494478 daemon.notice] resource apache-rs in resource group apache-rg has requested restart of the resource on tommy_sun.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_ON_PENDING_R_RESTART
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Service daemon not running.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_MON_STOPPING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_monitor_stop (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.8>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Service daemon not running.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_ON_PENDING_R_RESTART
Jul 17 10:21:25 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_MONITOR_STOP]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method MONITOR_STOP.
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_monitor_stop (scalable svc)> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_ONLINE_UNMON
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:25 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:25 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_ONLINE_UNMON
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:26 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:27 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:27 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:27 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:27 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:28 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:29 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:29 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:29 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:29 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:30 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun1> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:30 tommy_sun Cluster.RGM.global.rgmd: [ID 674214 daemon.notice] rebalance: no primary node is currently found for resource group <apache-rg>.
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_ONLINE
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_ONLINE
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING_DEPEND
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OK_TO_START
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STARTING
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_start (scalable svc)> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/sc/ssm_wrapper>:tag=<apache-rg.apache-rs.0>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING_DEPEND
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OK_TO_START
Jul 17 10:21:51 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STARTING
Jul 17 10:21:52 tommy_sun SC[SUNW.apache:4.1,apache-rg,apache-rs,SSM_START]: [ID 487022 daemon.notice] The networking components for scalable resource apache-rs have been configured successfully for method START.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 743923 daemon.notice] Starting server with command /usr/apache2/bin/apachectl start.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 187883 daemon.error] Apache service with startup script </usr/apache2/bin/apachectl> does not configure PIDFILE.
Jul 17 10:21:52 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 569559 daemon.notice] Start of /usr/apache2/bin/apachectl start completed successfully.
Jul 17 10:21:52 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_ONLINE
Jul 17 10:21:52 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Completed successfully.>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_ONLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Completed successfully.>
Jul 17 10:21:53 tommy_sun Cluster.PMF.pmfd: [ID 887656 daemon.notice] Process: tag="apache-rg,apache-rs,0.svc", cmd="/bin/sh -c /usr/apache2/bin/apachectl start", Failed to stay up.
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 423137 daemon.error] A resource restart attempt on resource apache-rs in resource group apache-rg has been blocked because the number of restarts within the past Retry_interval (620 seconds) would exceed Retry_count (2)
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_start]: [ID 819721 daemon.error] Failed to start Apache Web Server.
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 938318 daemon.error] Method <apache_svc_start (scalable svc)> failed on resource <apache-rs> in resource group <apache-rg> [exit code <1>, time used: 0% of timeout <300 seconds>]
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_FAULTED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_STOPPING
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_UNKNOWN
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Stopping>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 224900 daemon.notice] launching method <apache_svc_stop> for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, timeout <300> seconds
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 703477 daemon.notice] 38 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscapc/bin/apache_svc_stop>:tag=<apache-rg.apache-rs.1>: Calling security_clnt_connect(..., host=<tommy_sun>, sec_type {0:WEAK, 1:STRONG, 2
ES} =<1>, ...)Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_FAULTED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_PENDING_OFF_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_UNKNOWN
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Stopping>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_STOPPING
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 584207 daemon.notice] Stopping Apache Web Server.
Jul 17 10:21:53 tommy_sun SC[,SUNW.apache:4.1,apache-rg,apache-rs,apache_svc_stop]: [ID 401400 daemon.notice] Successfully stopped the application
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun change to R_FM_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 515159 daemon.notice] method <apache_svc_stop> completed successfully for resource <apache-rs>, resource group <apache-rg>, node <tommy_sun>, time used: 0% of timeout <300 seconds>
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun change to R_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE_START_FAILED
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun change to RG_OFFLINE
Jul 17 10:21:53 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 784560 daemon.notice] resource apache-rs status on node tommy_sun1 change to R_FM_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 922363 daemon.notice] resource apache-rs status msg on node tommy_sun1 change to <Successfully stopped Apache Web Server.>
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 443746 daemon.notice] resource apache-rs state on node tommy_sun1 change to R_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE_START_FAILED
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 529407 daemon.notice] resource group apache-rg state on node tommy_sun1 change to RG_OFFLINE
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun1> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 447451 daemon.notice] Not attempting to start resource group <apache-rg> on node <tommy_sun> because this resource group has already failed to start on this node 2 or more times in the past 3600 seconds
Jul 17 10:21:54 tommy_sun Cluster.RGM.global.rgmd: [ID 674214 daemon.notice] rebalance: no primary node is currently found for resource group <apache-rg>.
---------- Post updated at 10:41 AM ---------- Previous update was at 10:32 AM ----------
SOLVED
svcadm disable apache2 on both nodes
clrg online apache-rg
clrg status
clrg status
Quote:
=== Cluster Resource Groups ===
Group Name Node Name Suspended Status
---------- --------- --------- ------
apshared-rg tommy_sun1 No Online
tommy_sun No Offline
apache-rg tommy_sun1 No Online
tommy_sun No Online
Group Name Node Name Suspended Status
---------- --------- --------- ------
apshared-rg tommy_sun1 No Online
tommy_sun No Offline
apache-rg tommy_sun1 No Online
tommy_sun No Online
Thank you for helping me out dukenuke2. appreciate it.
|
|
10 More Discussions You Might Find Interesting
1. HP-UX
Hi There,
Does anyone knows what could be the problem if my apache server is running but unable to load JK2 module into the server. My HTTPS is running on Apache Server 2.0.49 with ssl enabled and compiled with Mod_ssl on HPUX-11.11i.
In fact we have try out the following parameter,
... (4 Replies)
Discussion started by: e_jeffhang
4 Replies
2. Shell Programming and Scripting
hi all
need your help.
I am wrting a script that will load data into the table.
then on another load will append the data into the existing table.
Regards
Ankit (1 Reply)
Discussion started by: ankitgupta
1 Replies
3. UNIX for Advanced & Expert Users
Hello !
I have a problem with an apache process that is causing huge load. It starts from time to time - I'm not sure what is making it start beacause there's nothing in cron, but it appears every few minutes - and when it starts is uses a lot of RAM (up to 1.3GB) and create a huge load on... (1 Reply)
Discussion started by: Sergiu-IT
1 Replies
4. UNIX for Advanced & Expert Users
Hi All,
I have a webpage loaded on server1 with authorization enabled by .htaccess, which can be accessed by http://ipofserver1/index.html. Now im planning a high availabilty load balancing in such a way that if the server1 is down due to some reason it should connect to another server. i have... (1 Reply)
Discussion started by: Tuxidow
1 Replies
5. Web Development
Hi All,
I have one webserver which has an application for a set of internal users can be accessed by _http://server1.com
I am planning to load balance this application. For that I have cloned this server and build a new one which can be accessed using _http://server2.com]Server2.com. Also i... (2 Replies)
Discussion started by: Tuxidow
2 Replies
6. Red Hat
Hi Techies,
Setup details -
1. H/W Load Balancer
2. Two Apache Servers with load balancing and rewrite rule
3. Two Application servers
Request will be travel 1 then 2 then 3
Queries -
1. When any session is established I can see that requests of that session is going to both... (0 Replies)
Discussion started by: ganesh_gore
0 Replies
7. Red Hat
Few doubts in apache load balancing - I want to clear my doubts about apache load balancing.i have configured apache load balancing for two application servers.
1. When we set load balancing for two application servers then for one connection to application server we will get one jsession id... (5 Replies)
Discussion started by: ganesh_gore
5 Replies
8. Red Hat
i have a Intel Quad Core Xeon X3440 (4 x 2.53GHz, 8MB Cache, Hyper Threaded) with 16gig and 1tb harddrive with a 1gb port and my apache is causing my cpu to go up to 100% on all four cores heres my http.config
<IfModule prefork.c>
StartServers 10
MinSpareServers 10
MaxSpareServers 15... (4 Replies)
Discussion started by: awww
4 Replies
9. Red Hat
Hi all.
May I get some expert advice on troubleshooting performance issues of a 1000 nodes Apache LB cluster. Users report slow loading/response of webpages. Different websites are hosted on this cluster for different clients. But all are reporting the same issue.
Could you please let me know... (1 Reply)
Discussion started by: admin_xor
1 Replies
10. UNIX for Dummies Questions & Answers
I need to form a matrix out of unbalanced set of records. First eliminate the sample that do not have at least 3 variables (col2). So, in the example, samples 4 and 5 get eliminated.
Then form a matrix of values (col3) from the samples using only variables that are present accross all samples.... (3 Replies)
Discussion started by: senhia83
3 Replies