Code:
Sep 10 14:32:21 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_postnet_stop>:tag=<oracle11-rg.global_oracle11-rs.11>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:32:21 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_postnet_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:40:39 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_fini> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <30> seconds
Sep 10 14:40:39 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_fini>:tag=<oracle11-rg.ora11g-ora.5>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:40:39 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_server_fini> completed successfully for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <30 seconds>
Sep 10 14:40:39 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<5>:cmd=<null>:tag=<>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:40:39 node1 Cluster.CCR: [ID 491081 daemon.notice] resource ora11g-ora removed.
Sep 10 14:41:05 node1 rmclomv: [ID 585172 kern.crit] VOLTAGE_SENSOR @ MB.BAT.V_BAT has exceeded low warning threshold.
Sep 10 14:41:35 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_validate> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <120> seconds
Sep 10 14:41:35 node1 Cluster.RGM.rgmd: [ID 285716 daemon.notice] 20 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_validate>:tag=<oracle11-rg.ora11g-ora.2>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:41:35 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_server_validate> completed successfully for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <120 seconds>
Sep 10 14:41:36 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_init> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <30> seconds
Sep 10 14:41:36 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_init>:tag=<oracle11-rg.ora11g-ora.4>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:41:36 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_server_init> completed successfully for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <30 seconds>
Sep 10 14:41:36 node1 Cluster.CCR: [ID 973933 daemon.notice] resource ora11g-ora added.
Sep 10 14:42:44 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_prenet_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:42:44 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_prenet_start>:tag=<oracle11-rg.oracleha-rs.10>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_prenet_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_prenet_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_prenet_start>:tag=<oracle11-rg.global_oracle11-rs.10>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_prenet_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <500> seconds
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_start>:tag=<oracle11-rg.oracleha-rs.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <500 seconds>
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_start>:tag=<oracle11-rg.global_oracle11-rs.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_monitor_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:42:45 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_monitor_start>:tag=<oracle11-rg.oracleha-rs.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_monitor_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <90 seconds>
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_start> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_start>:tag=<oracle11-rg.ora11g-lsr.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_monitor_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 686647 daemon.notice] 43 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_monitor_start>:tag=<oracle11-rg.global_oracle11-rs.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_start> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <600> seconds
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_start>:tag=<oracle11-rg.ora11g-ora.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:42:46 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_monitor_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <90 seconds>
Sep 10 14:42:56 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_start> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 3% of timeout <300 seconds>
Sep 10 14:42:56 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_monitor_start> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <180> seconds
Sep 10 14:42:56 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_monitor_start>:tag=<oracle11-rg.ora11g-lsr.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:00 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_monitor_start> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 1% of timeout <180 seconds>
Sep 10 14:43:41 node1 SC[SUNWscor.oracle_server.start]:oracle11-rg:ora11g-ora: [ID 412106 daemon.error] Internal Error. Unable to get fault monitor name
Sep 10 14:43:41 node1 SC[SUNWscor.oracle_server.start]:oracle11-rg:ora11g-ora: [ID 690463 daemon.error] Cannot bring server online on this node.
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 938318 daemon.error] Method <bin/oracle_server_start> failed on resource <ora11g-ora> in resource group <oracle11-rg> [exit code <255>, time used: 9% of timeout <600 seconds>]
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_stop> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <600> seconds
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_stop>:tag=<oracle11-rg.ora11g-ora.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_monitor_stop> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <120> seconds
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_monitor_stop>:tag=<oracle11-rg.ora11g-lsr.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_monitor_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 686647 daemon.notice] 43 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_monitor_stop>:tag=<oracle11-rg.global_oracle11-rs.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 652764 daemon.notice] libsecurity, door_call: Resource temporarily unavailable; will retry
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_monitor_stop> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_monitor_stop>:tag=<oracle11-rg.oracleha-rs.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:41 node1 Cluster.RGM.rgmd: [ID 652764 daemon.notice] libsecurity, door_call: Resource temporarily unavailable; will retry
Sep 10 14:43:43 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_monitor_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 1% of timeout <90 seconds>
Sep 10 14:43:43 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_monitor_stop> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:43:46 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_monitor_stop> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 4% of timeout <120 seconds>
Sep 10 14:43:46 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_stop> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:43:46 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_stop>:tag=<oracle11-rg.ora11g-lsr.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:43:57 node1 SC[SUNWscor.oracle_server.stop]:oracle11-rg:ora11g-ora: [ID 167253 daemon.notice] Server stopped successfully.
Sep 10 14:43:57 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_server_stop> completed successfully for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, time used: 2% of timeout <600 seconds>
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_stop> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 5% of timeout <300 seconds>
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_stop>:tag=<oracle11-rg.global_oracle11-rs.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_stop> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:44:01 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_stop>:tag=<oracle11-rg.oracleha-rs.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:44:02 node1 ip: [ID 678092 kern.notice] TCP_IOC_ABORT_CONN: local = 172.016.002.241:0, remote = 000.000.000.000:0, start = -2, end = 6
Sep 10 14:44:02 node1 ip: [ID 302654 kern.notice] TCP_IOC_ABORT_CONN: aborted 2 connections
Sep 10 14:44:02 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_stop> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:44:02 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_postnet_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:44:02 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_postnet_stop>:tag=<oracle11-rg.global_oracle11-rs.11>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:44:02 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_postnet_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:46:48 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_prenet_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:46:48 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_prenet_start>:tag=<oracle11-rg.oracleha-rs.10>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_prenet_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_prenet_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_prenet_start>:tag=<oracle11-rg.global_oracle11-rs.10>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_prenet_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <500> seconds
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_start>:tag=<oracle11-rg.oracleha-rs.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <500 seconds>
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_start>:tag=<oracle11-rg.global_oracle11-rs.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_monitor_start> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:46:50 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_monitor_start>:tag=<oracle11-rg.oracleha-rs.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <90 seconds>
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_start> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_start>:tag=<oracle11-rg.ora11g-lsr.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_monitor_start> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 686647 daemon.notice] 43 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_monitor_start>:tag=<oracle11-rg.global_oracle11-rs.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_start> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <600> seconds
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_start>:tag=<oracle11-rg.ora11g-ora.0>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_monitor_start> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:46:51 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_monitor_start> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <90 seconds>
Sep 10 14:46:59 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_start> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 2% of timeout <300 seconds>
Sep 10 14:46:59 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_monitor_start> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <180> seconds
Sep 10 14:46:59 node1 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_monitor_start>:tag=<oracle11-rg.ora11g-lsr.7>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:00 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_monitor_start> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <180 seconds>
Sep 10 14:47:41 node1 SC[SUNWscor.oracle_server.start]:oracle11-rg:ora11g-ora: [ID 412106 daemon.error] Internal Error. Unable to get fault monitor name
Sep 10 14:47:41 node1 SC[SUNWscor.oracle_server.start]:oracle11-rg:ora11g-ora: [ID 690463 daemon.error] Cannot bring server online on this node.
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 938318 daemon.error] Method <bin/oracle_server_start> failed on resource <ora11g-ora> in resource group <oracle11-rg> [exit code <255>, time used: 8% of timeout <600 seconds>]
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_server_stop> for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, timeout <600> seconds
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_server/bin/oracle_server_stop>:tag=<oracle11-rg.ora11g-ora.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_monitor_stop> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <120> seconds
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_monitor_stop>:tag=<oracle11-rg.ora11g-lsr.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_monitor_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <90> seconds
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 686647 daemon.notice] 43 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_monitor_stop>:tag=<oracle11-rg.global_oracle11-rs.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_monitor_stop> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 927765 daemon.notice] 44 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_monitor_stop>:tag=<oracle11-rg.oracleha-rs.8>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 652764 daemon.notice] libsecurity, door_call: Resource temporarily unavailable; will retry
Sep 10 14:47:42 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_monitor_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <90 seconds>
Sep 10 14:47:43 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_monitor_stop> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:47:43 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_monitor_stop> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 1% of timeout <120 seconds>
Sep 10 14:47:43 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <bin/oracle_listener_stop> for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:47:43 node1 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/SUNWscor/oracle_listener/bin/oracle_listener_stop>:tag=<oracle11-rg.ora11g-lsr.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_listener_stop> completed successfully for resource <ora11g-lsr>, resource group <oracle11-rg>, node <node1>, time used: 3% of timeout <300 seconds>
Sep 10 14:47:55 node1 SC[SUNWscor.oracle_server.stop]:oracle11-rg:ora11g-ora: [ID 167253 daemon.notice] Server stopped successfully.
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <bin/oracle_server_stop> completed successfully for resource <ora11g-ora>, resource group <oracle11-rg>, node <node1>, time used: 2% of timeout <600 seconds>
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_stop>:tag=<oracle11-rg.global_oracle11-rs.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_stop> for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, timeout <300> seconds
Sep 10 14:47:55 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_stop>:tag=<oracle11-rg.oracleha-rs.1>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:55 node1 ip: [ID 678092 kern.notice] TCP_IOC_ABORT_CONN: local = 172.016.002.241:0, remote = 000.000.000.000:0, start = -2, end = 6
Sep 10 14:47:56 node1 ip: [ID 302654 kern.notice] TCP_IOC_ABORT_CONN: aborted 2 connections
Sep 10 14:47:56 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_stop> completed successfully for resource <oracleha-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <300 seconds>
Sep 10 14:47:56 node1 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_postnet_stop> for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, timeout <1800> seconds
Sep 10 14:47:56 node1 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_postnet_stop>:tag=<oracle11-rg.global_oracle11-rs.11>: Calling security_clnt_connect(..., host=<node1>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Sep 10 14:47:56 node1 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_postnet_stop> completed successfully for resource <global_oracle11-rs>, resource group <oracle11-rg>, node <node1>, time used: 0% of timeout <1800 seconds>