Hi Listers, I am trying to test Linux-HA with DRBD. The active/passive test environment consists of:
- zVM 5.4 - SLES10-SP2 - 2 nodes/guests ( lnodbbt & lnodbct ) - Oracle 10.2.0.4 I have managed to setup drbd and to mount the database filesystem on lnodbbt ( active/master ). Now I want to bring up Oracle. I have created a resource ORADB and am using the ocf scripts to start oracle which doesn't work. However, I can manually run the ocf startup script and oracle comes up. My questions follow: 1. Should I be using the LSB startup scripts instead of the ocf script ? 2. How do I configure drbd so that lnodbbt is the master and lnodbct is the slave ? 3. Do I have to set up any constraints for the ORADB resource so that it only starts up on the guest that has the /dbms mounted and what would the constraints be ? Attached is my /etc/drbd.conf and etc/ha.d/ha.cf and ha-logs from lnodbbt ( the active/master ) guest. Any help or pointers would be much appreciated. TIA Bernie ________________________________ The information contained in this e-mail message is intended only for the personal and confidential use of the recipient(s) named above. This message may be an attorney-client communication and/or work product and as such is privileged and confidential. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail, and delete the original message.
drbd.conf
Description: drbd.conf
ha.cf
Description: ha.cf
pengine[28112]: 2009/09/09_09:03:37 notice: StartRsc: lnodbbt Start resource_ORADB cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: - </group> pengine[28112]: 2009/09/09_09:03:37 notice: RecurringOp: lnodbbt resource_ORADB_monitor_120000 cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: - </resources> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: - </configuration> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: - </cib> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <cib epoch="85" num_updates="1"> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <configuration> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <resources> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <group id="RG_A"> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <primitive id="resource_ORADB"> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <meta_attributes id="resource_ORADB_meta_attrs"> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <attributes> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + <nvpair value="started" id="resource_ORADB_metaattr_target_role"/> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </attributes> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </meta_attributes> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </primitive> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </group> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </resources> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </configuration> cib[28092]: 2009/09/09_09:03:37 info: log_data_element: cib:diff: + </cib> crmd[28096]: 2009/09/09_09:03:37 info: do_lrm_rsc_op: Performing op=resource_ORADB_start_0 key=11:3:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:03:37 info: rsc:resource_ORADB: start cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) pengine[28112]: 2009/09/09_09:03:37 info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-112.bz2 cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) cib[28686]: 2009/09/09_09:03:37 info: write_cib_contents: Wrote version 0.85.1 of the CIB to disk (digest: bffe9d21b2d7280aeb6c287f0d79ca88) cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[28686]: 2009/09/09_09:03:37 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) oracle[28687][28819]: 2009/09/09_09:03:58 ERROR: Oracle dssd can not mount. crmd[28096]: 2009/09/09_09:03:58 info: process_lrm_event: LRM operation resource_ORADB_start_0 (call=9, rc=1) complete tengine[28111]: 2009/09/09_09:03:58 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=1 tengine[28111]: 2009/09/09_09:03:58 WARN: status_from_rc: Action start on lnodbbt failed (target: <null> vs. rc: 1): Error tengine[28111]: 2009/09/09_09:03:58 WARN: update_failcount: Updating failcount for resource_ORADB on ea71aa52-137e-49b4-a9ab-30487b39157d after failed start: rc=1 tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort priority upgraded to 1 tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[28111]: 2009/09/09_09:03:58 info: match_graph_event: Action resource_ORADB_start_0 (11) confirmed on lnodbbt (rc=4) tengine[28111]: 2009/09/09_09:03:58 info: run_graph: ==================================================== tengine[28111]: 2009/09/09_09:03:58 notice: run_graph: Transition 3: (Complete=1, Pending=0, Fired=0, Skipped=2, Incomplete=0) tengine[28111]: 2009/09/09_09:03:58 WARN: notify_crmd: Delaying completion until all CIB updates complete crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:03:58 info: extract_event: Aborting on transient_attributes changes for ea71aa52-137e-49b4-a9ab-30487b39157d crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[28111]: 2009/09/09_09:03:58 info: update_abort_priority: 'Event failed' abort superceeded tengine[28111]: 2009/09/09_09:03:58 WARN: notify_crmd: Delaying completion until all CIB updates complete pengine[28112]: 2009/09/09_09:03:58 info: determine_online_status: Node lnodbbt is online pengine[28112]: 2009/09/09_09:03:58 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR pengine[28112]: 2009/09/09_09:03:58 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error pengine[28112]: 2009/09/09_09:03:58 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt pengine[28112]: 2009/09/09_09:03:58 info: determine_online_status: Node lnodbct is online pengine[28112]: 2009/09/09_09:03:58 notice: group_print: Resource Group: RG_A pengine[28112]: 2009/09/09_09:03:58 notice: native_print: resource_IP_A (ocf::heartbeat:IPaddr): Started lnodbbt pengine[28112]: 2009/09/09_09:03:58 notice: native_print: resource_DRBD_A (heartbeat:drbddisk): Started lnodbbt pengine[28112]: 2009/09/09_09:03:58 notice: native_print: resource_FS_A (ocf::heartbeat:Filesystem): Started lnodbbt pengine[28112]: 2009/09/09_09:03:58 notice: native_print: resource_ORADB (ocf::heartbeat:oracle): Started lnodbbt FAILED pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move resource resource_IP_A (lnodbbt -> lnodbct) pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc: lnodbbt Stop resource_IP_A pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc: lnodbct Start resource_IP_A pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move resource resource_DRBD_A (lnodbbt -> lnodbct) pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc: lnodbbt Stop resource_DRBD_A pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc: lnodbct Start resource_DRBD_A pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Move resource resource_FS_A (lnodbbt -> lnodbct) pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc: lnodbbt Stop resource_FS_A pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc: lnodbct Start resource_FS_A pengine[28112]: 2009/09/09_09:03:58 notice: NoRoleChange: Recover resource resource_ORADB (lnodbct) pengine[28112]: 2009/09/09_09:03:58 notice: StopRsc: lnodbbt Stop resource_ORADB pengine[28112]: 2009/09/09_09:03:58 notice: StartRsc: lnodbct Start resource_ORADB pengine[28112]: 2009/09/09_09:03:58 notice: RecurringOp: lnodbct resource_ORADB_monitor_120000 crmd[28096]: 2009/09/09_09:03:58 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:03:58 info: unpack_graph: Unpacked transition 4: 14 actions in 14 synapses tengine[28111]: 2009/09/09_09:03:58 info: te_pseudo_action: Pseudo action 16 fired and confirmed tengine[28111]: 2009/09/09_09:03:58 info: send_rsc_command: Initiating action 1: resource_ORADB_stop_0 on lnodbbt crmd[28096]: 2009/09/09_09:03:58 info: do_lrm_rsc_op: Performing op=resource_ORADB_stop_0 key=1:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:03:58 info: rsc:resource_ORADB: stop pengine[28112]: 2009/09/09_09:03:58 info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-113.bz2 mgmtd[28097]: 2009/09/09_09:03:58 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR oracle[28827][28942]: 2009/09/09_09:03:58 INFO: Oracle instance dssd stopped: ENV MSG: Server Express environment enabled alter system checkpoint * ERROR at line 1: ORA-01109: database not open ORACLE instance shut down. crmd[28096]: 2009/09/09_09:03:59 info: process_lrm_event: LRM operation resource_ORADB_stop_0 (call=10, rc=0) complete oracle[28827][28944]: 2009/09/09_09:03:59 INFO: Cleaning up for dssd tengine[28111]: 2009/09/09_09:03:59 info: match_graph_event: Action resource_ORADB_stop_0 (1) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:03:59 info: send_rsc_command: Initiating action 10: resource_FS_A_stop_0 on lnodbbt crmd[28096]: 2009/09/09_09:03:59 info: do_lrm_rsc_op: Performing op=resource_FS_A_stop_0 key=10:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:03:59 info: rsc:resource_FS_A: stop Filesystem[28949][28979]: 2009/09/09_09:03:59 INFO: Running stop for /dev/drbd0 on /dbms01 Filesystem[28949][28989]: 2009/09/09_09:03:59 INFO: Trying to unmount /dbms01 Filesystem[28949][28992]: 2009/09/09_09:03:59 INFO: unmounted /dbms01 successfully lrmd[28093]: 2009/09/09_09:03:59 info: rsc:resource_DRBD_A: stop crmd[28096]: 2009/09/09_09:03:59 info: process_lrm_event: LRM operation resource_FS_A_stop_0 (call=11, rc=0) complete tengine[28111]: 2009/09/09_09:03:59 info: match_graph_event: Action resource_FS_A_stop_0 (10) confirmed on lnodbbt (rc=0) crmd[28096]: 2009/09/09_09:03:59 info: do_lrm_rsc_op: Performing op=resource_DRBD_A_stop_0 key=8:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) tengine[28111]: 2009/09/09_09:03:59 info: send_rsc_command: Initiating action 8: resource_DRBD_A_stop_0 on lnodbbt crmd[28096]: 2009/09/09_09:04:00 info: process_lrm_event: LRM operation resource_DRBD_A_stop_0 (call=12, rc=0) complete tengine[28111]: 2009/09/09_09:04:00 info: match_graph_event: Action resource_DRBD_A_stop_0 (8) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:04:00 info: send_rsc_command: Initiating action 6: resource_IP_A_stop_0 on lnodbbt lrmd[28093]: 2009/09/09_09:04:00 info: rsc:resource_IP_A: stop crmd[28096]: 2009/09/09_09:04:00 info: do_lrm_rsc_op: Performing op=resource_IP_A_stop_0 key=6:4:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:04:00 info: RA output: (resource_IP_A:stop:stdout) In IP Stop lrmd[28093]: 2009/09/09_09:04:00 info: RA output: (resource_IP_A:stop:stderr) SIOCDELRT: No such process IPaddr[29000][29015]: 2009/09/09_09:04:00 INFO: ifconfig eth0:0 down crmd[28096]: 2009/09/09_09:04:00 info: process_lrm_event: LRM operation resource_IP_A_stop_0 (call=13, rc=0) complete tengine[28111]: 2009/09/09_09:04:00 info: match_graph_event: Action resource_IP_A_stop_0 (6) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 17 fired and confirmed tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 2 fired and confirmed tengine[28111]: 2009/09/09_09:04:00 info: te_pseudo_action: Pseudo action 14 fired and confirmed tengine[28111]: 2009/09/09_09:04:00 info: send_rsc_command: Initiating action 7: resource_IP_A_start_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:00 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR tengine[28111]: 2009/09/09_09:04:01 info: match_graph_event: Action resource_IP_A_start_0 (7) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:01 info: send_rsc_command: Initiating action 9: resource_DRBD_A_start_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:02 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR tengine[28111]: 2009/09/09_09:04:03 info: match_graph_event: Action resource_DRBD_A_start_0 (9) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:03 info: send_rsc_command: Initiating action 11: resource_FS_A_start_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR tengine[28111]: 2009/09/09_09:04:05 info: match_graph_event: Action resource_FS_A_start_0 (11) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:05 info: send_rsc_command: Initiating action 12: resource_ORADB_start_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:06 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR tengine[28111]: 2009/09/09_09:04:33 info: status_from_rc: Re-mapping op status to LRM_OP_ERROR for rc=1 tengine[28111]: 2009/09/09_09:04:33 WARN: status_from_rc: Action start on lnodbct failed (target: <null> vs. rc: 1): Error tengine[28111]: 2009/09/09_09:04:33 WARN: update_failcount: Updating failcount for resource_ORADB on 050d8990-ec19-4da5-9fd5-8dfb7490e2d1 after failed start: rc=1 crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort priority upgraded to 1 crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: All 2 cluster nodes are eligible to run resources. tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort action 0 superceeded by 2 tengine[28111]: 2009/09/09_09:04:33 info: match_graph_event: Action resource_ORADB_start_0 (12) confirmed on lnodbct (rc=4) tengine[28111]: 2009/09/09_09:04:33 info: run_graph: ==================================================== tengine[28111]: 2009/09/09_09:04:33 notice: run_graph: Transition 4: (Complete=12, Pending=0, Fired=0, Skipped=2, Incomplete=0) tengine[28111]: 2009/09/09_09:04:33 WARN: notify_crmd: Delaying completion until all CIB updates complete tengine[28111]: 2009/09/09_09:04:33 info: extract_event: Aborting on transient_attributes changes for 050d8990-ec19-4da5-9fd5-8dfb7490e2d1 tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[28111]: 2009/09/09_09:04:33 info: update_abort_priority: 'Event failed' abort superceeded tengine[28111]: 2009/09/09_09:04:33 WARN: notify_crmd: Delaying completion until all CIB updates complete crmd[28096]: 2009/09/09_09:04:33 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[28112]: 2009/09/09_09:04:33 info: determine_online_status: Node lnodbbt is online pengine[28112]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt pengine[28112]: 2009/09/09_09:04:33 info: determine_online_status: Node lnodbct is online pengine[28112]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbct: Error pengine[28112]: 2009/09/09_09:04:33 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbct pengine[28112]: 2009/09/09_09:04:33 notice: group_print: Resource Group: RG_A pengine[28112]: 2009/09/09_09:04:33 notice: native_print: resource_IP_A (ocf::heartbeat:IPaddr): Started lnodbct pengine[28112]: 2009/09/09_09:04:33 notice: native_print: resource_DRBD_A (heartbeat:drbddisk): Started lnodbct pengine[28112]: 2009/09/09_09:04:33 notice: native_print: resource_FS_A (ocf::heartbeat:Filesystem): Started lnodbct pengine[28112]: 2009/09/09_09:04:33 notice: native_print: resource_ORADB (ocf::heartbeat:oracle): Started lnodbct FAILED pengine[28112]: 2009/09/09_09:04:33 WARN: native_color: Resource resource_ORADB cannot run anywhere pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move resource resource_IP_A (lnodbct -> lnodbbt) pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc: lnodbct Stop resource_IP_A tengine[28111]: 2009/09/09_09:04:33 info: unpack_graph: Unpacked transition 5: 11 actions in 11 synapses pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc: lnodbbt Start resource_IP_A tengine[28111]: 2009/09/09_09:04:33 info: te_pseudo_action: Pseudo action 14 fired and confirmed pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move resource resource_DRBD_A (lnodbct -> lnodbbt) tengine[28111]: 2009/09/09_09:04:33 info: send_rsc_command: Initiating action 1: resource_ORADB_stop_0 on lnodbct pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc: lnodbct Stop resource_DRBD_A pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc: lnodbbt Start resource_DRBD_A pengine[28112]: 2009/09/09_09:04:33 notice: NoRoleChange: Move resource resource_FS_A (lnodbct -> lnodbbt) pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc: lnodbct Stop resource_FS_A pengine[28112]: 2009/09/09_09:04:33 notice: StartRsc: lnodbbt Start resource_FS_A pengine[28112]: 2009/09/09_09:04:33 notice: StopRsc: lnodbct Stop resource_ORADB pengine[28112]: 2009/09/09_09:04:33 WARN: process_pe_message: Transition 5: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-31.bz2 pengine[28112]: 2009/09/09_09:04:33 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. mgmtd[28097]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR mgmtd[28097]: 2009/09/09_09:04:33 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR tengine[28111]: 2009/09/09_09:04:36 info: match_graph_event: Action resource_ORADB_stop_0 (1) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:36 info: send_rsc_command: Initiating action 10: resource_FS_A_stop_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:36 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR mgmtd[28097]: 2009/09/09_09:04:36 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR tengine[28111]: 2009/09/09_09:04:37 info: match_graph_event: Action resource_FS_A_stop_0 (10) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:37 info: send_rsc_command: Initiating action 8: resource_DRBD_A_stop_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:37 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR mgmtd[28097]: 2009/09/09_09:04:37 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR tengine[28111]: 2009/09/09_09:04:38 info: match_graph_event: Action resource_DRBD_A_stop_0 (8) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:38 info: send_rsc_command: Initiating action 6: resource_IP_A_stop_0 on lnodbct mgmtd[28097]: 2009/09/09_09:04:38 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR mgmtd[28097]: 2009/09/09_09:04:38 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_IP_A_stop_0 (6) confirmed on lnodbct (rc=0) tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 15 fired and confirmed tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 2 fired and confirmed tengine[28111]: 2009/09/09_09:04:39 info: te_pseudo_action: Pseudo action 12 fired and confirmed tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 7: resource_IP_A_start_0 on lnodbbt crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_IP_A_start_0 key=7:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_IP_A: start lrmd[28093]: 2009/09/09_09:04:39 info: RA output: (resource_IP_A:start:stderr) Converted dotted-quad netmask to CIDR as: 24 IPaddr[29018][29073]: 2009/09/09_09:04:39 INFO: eval ifconfig eth0:0 172.31.100.60 netmask 255.255.255.0 broadcast 172.31.100.255 crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_IP_A_start_0 (call=14, rc=0) complete tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_IP_A_start_0 (7) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 9: resource_DRBD_A_start_0 on lnodbbt crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_DRBD_A_start_0 key=9:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_DRBD_A: start crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_DRBD_A_start_0 (call=15, rc=0) complete tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_DRBD_A_start_0 (9) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:04:39 info: send_rsc_command: Initiating action 11: resource_FS_A_start_0 on lnodbbt crmd[28096]: 2009/09/09_09:04:39 info: do_lrm_rsc_op: Performing op=resource_FS_A_start_0 key=11:5:182e4cd8-d5a8-4474-bd50-6186bdfb15d8) lrmd[28093]: 2009/09/09_09:04:39 info: rsc:resource_FS_A: start Filesystem[29095][29125]: 2009/09/09_09:04:39 INFO: Running start for /dev/drbd0 on /dbms01 crmd[28096]: 2009/09/09_09:04:39 info: process_lrm_event: LRM operation resource_FS_A_start_0 (call=16, rc=0) complete crmd[28096]: 2009/09/09_09:04:39 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:04:39 info: match_graph_event: Action resource_FS_A_start_0 (11) confirmed on lnodbbt (rc=0) tengine[28111]: 2009/09/09_09:04:39 info: run_graph: Transition 5: (Complete=11, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[28111]: 2009/09/09_09:04:39 info: notify_crmd: Transition 5 status: te_complete - <null> mgmtd[28097]: 2009/09/09_09:04:39 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR mgmtd[28097]: 2009/09/09_09:04:39 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR cib[28092]: 2009/09/09_09:12:14 info: cib_stats: Processed 36 operations (3611.00us average, 0% utilization) in the last 10min heartbeat[28079]: 2009/09/09_09:30:02 WARN: Gmain_timeout_dispatch: Dispatch function for send local status was delayed 720 ms (> 510 ms) before being called (GSource: 0x80131598) heartbeat[28079]: 2009/09/09_09:30:02 info: Gmain_timeout_dispatch: started at 4338635256 should have started at 4338635184 heartbeat[28079]: 2009/09/09_09:30:02 WARN: Gmain_timeout_dispatch: Dispatch function for check for signals was delayed 720 ms (> 510 ms) before being called (GSource: 0x80131cb8) heartbeat[28079]: 2009/09/09_09:30:02 info: Gmain_timeout_dispatch: started at 4338635256 should have started at 4338635184 mgmtd[28097]: 2009/09/09_09:47:04 info: (delete)xml:<nvpair id="resource_ORADB_instattr_target_role"> mgmtd[28097]: 2009/09/09_09:47:04 info: on_set_target_role:<group id="RG_A"><primitive id="resource_ORADB"><meta_attributes id="resource_ORADB_meta_attrs"><attributes><nvpair id="resource_ORADB_metaattr_target_role" name="target_role" value="stopped"/></attributes></meta_attributes></primitive></group> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <cib epoch="85" num_updates="20"> crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:47:04 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[28112]: 2009/09/09_09:47:04 info: determine_online_status: Node lnodbbt is online cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <configuration> crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: All 2 cluster nodes are eligible to run resources. pengine[28112]: 2009/09/09_09:47:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbbt to an ERROR cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <resources> pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbbt: Error cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <group id="RG_A"> pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbbt cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <primitive id="resource_ORADB"> pengine[28112]: 2009/09/09_09:47:04 info: determine_online_status: Node lnodbct is online cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <meta_attributes id="resource_ORADB_meta_attrs"> pengine[28112]: 2009/09/09_09:47:04 ERROR: unpack_rsc_op: Remapping resource_ORADB_start_0 (rc=1) on lnodbct to an ERROR cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <attributes> pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Processing failed op resource_ORADB_start_0 on lnodbct: Error cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - <nvpair value="started" id="resource_ORADB_metaattr_target_role"/> pengine[28112]: 2009/09/09_09:47:04 WARN: unpack_rsc_op: Compatability handling for failed op resource_ORADB_start_0 on lnodbct cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </attributes> pengine[28112]: 2009/09/09_09:47:04 notice: group_print: Resource Group: RG_A cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </meta_attributes> pengine[28112]: 2009/09/09_09:47:04 notice: native_print: resource_IP_A (ocf::heartbeat:IPaddr): Started lnodbbt cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </primitive> pengine[28112]: 2009/09/09_09:47:04 notice: native_print: resource_DRBD_A (heartbeat:drbddisk): Started lnodbbt cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </group> pengine[28112]: 2009/09/09_09:47:04 notice: native_print: resource_FS_A (ocf::heartbeat:Filesystem): Started lnodbbt cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </resources> pengine[28112]: 2009/09/09_09:47:04 notice: native_print: resource_ORADB (ocf::heartbeat:oracle): Stopped cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </configuration> pengine[28112]: 2009/09/09_09:47:04 WARN: native_color: Resource resource_ORADB cannot run anywhere cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: - </cib> pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_IP_A (lnodbbt) cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <cib epoch="86" num_updates="1"> pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_DRBD_A (lnodbbt) cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <configuration> pengine[28112]: 2009/09/09_09:47:04 notice: NoRoleChange: Leave resource resource_FS_A (lnodbbt) cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <resources> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <group id="RG_A"> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <primitive id="resource_ORADB"> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <meta_attributes id="resource_ORADB_meta_attrs"> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <attributes> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + <nvpair value="stopped" id="resource_ORADB_metaattr_target_role"/> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </attributes> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </meta_attributes> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </primitive> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </group> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </resources> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </configuration> cib[28092]: 2009/09/09_09:47:04 info: log_data_element: cib:diff: + </cib> crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[28111]: 2009/09/09_09:47:04 info: unpack_graph: Unpacked transition 6: 0 actions in 0 synapses tengine[28111]: 2009/09/09_09:47:04 info: run_graph: Transition 6: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[28111]: 2009/09/09_09:47:04 info: notify_crmd: Transition 6 status: te_complete - <null> crmd[28096]: 2009/09/09_09:47:04 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] cib[29265]: 2009/09/09_09:47:04 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
_______________________________________________ drbd-user mailing list [email protected] http://lists.linbit.com/mailman/listinfo/drbd-user
