May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: - <cib admin_epoch="1" epoch="117" num_updates="3" >
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -   <configuration >
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -     <nodes >
May 21 10:53:04 wimuds2 crmd: [4429]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -       <node id="e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -           <nvpair value="false" id="standby-e77e5b23-c3ae-4757-b801-8b0995fb3f86" />
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -         </instance_attributes>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -       </node>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -     </nodes>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -   </configuration>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: - </cib>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: + <cib admin_epoch="1" epoch="118" num_updates="1" >
May 21 10:53:04 wimuds2 crmd: [4429]: info: need_abort: Aborting on change to admin_epoch
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +   <configuration >
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +     <nodes >
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +       <node id="e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640989521s to complete
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640989521s to complete
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +           <nvpair value="true" id="standby-e77e5b23-c3ae-4757-b801-8b0995fb3f86" />
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640989521s to complete
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +         </instance_attributes>
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_pe_invoke: Query 189: Requesting the current CIB: S_POLICY_ENGINE
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +       </node>
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_PE_INVOKE took 640989521s to complete
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +     </nodes>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +   </configuration>
May 21 10:53:04 wimuds2 cib: [4425]: info: log_data_element: cib:diff: + </cib>
May 21 10:53:04 wimuds2 cib: [4425]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=wimuds1/crm_standby/4, version=1.118.1): ok (rc=0)
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1242924784-155, seq=10, quorate=1
May 21 10:53:04 wimuds2 pengine: [24743]: info: determine_online_status: Node wimuds2 is online
May 21 10:53:04 wimuds2 pengine: [24743]: info: unpack_status: Node wimuds1 is in standby-mode
May 21 10:53:04 wimuds2 pengine: [24743]: info: determine_online_status: Node wimuds1 is standby
May 21 10:53:04 wimuds2 pengine: [24743]: info: find_clone: Internally renamed CL_stonith_node01:0 on wimuds1 to CL_stonith_node01:1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: group_print: Resource Group: group_1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     IPaddr2_1	(ocf::heartbeat:IPaddr2):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     IPaddr2_2	(ocf::heartbeat:IPaddr2):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     drbddisk_2	(heartbeat:drbddisk):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     Filesystem_3	(ocf::heartbeat:Filesystem):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     httpd_4	(lsb:httpd):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     mysqld_5	(lsb:mysqld):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: native_print:     rc.primary_6	(lsb:rc.primary):	Started wimuds1
May 21 10:53:04 wimuds2 pengine: [24743]: notice: clone_print: Clone Set: CL_stonithset_node01
May 21 10:53:04 wimuds2 pengine: [24743]: notice: print_list: 	Started: [ wimuds2 ]
May 21 10:53:04 wimuds2 cib: [12946]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-25.raw
May 21 10:53:04 wimuds2 pengine: [24743]: notice: print_list: 	Stopped: [ CL_stonith_node01:1 ]
May 21 10:53:04 wimuds2 pengine: [24743]: notice: clone_print: Clone Set: CL_stonithset_node02
May 21 10:53:04 wimuds2 pengine: [24743]: notice: print_list: 	Started: [ wimuds1 ]
May 21 10:53:04 wimuds2 pengine: [24743]: notice: print_list: 	Stopped: [ CL_stonith_node02:1 ]
May 21 10:53:04 wimuds2 pengine: [24743]: info: native_merge_weights: CL_stonith_node01:1: Rolling back scores from CL_stonithset_node02
May 21 10:53:04 wimuds2 cib: [12946]: info: write_cib_contents: Wrote version 1.118.0 of the CIB to disk (digest: a6fb06aa8f7406f6124295d719ea2cb2)
May 21 10:53:04 wimuds2 pengine: [24743]: WARN: native_color: Resource CL_stonith_node01:1 cannot run anywhere
May 21 10:53:04 wimuds2 pengine: [24743]: WARN: native_color: Resource CL_stonith_node02:0 cannot run anywhere
May 21 10:53:04 wimuds2 cib: [12946]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.n1RjDj (digest: /var/lib/heartbeat/crm/cib.tqMCNU)
May 21 10:53:04 wimuds2 pengine: [24743]: WARN: native_color: Resource CL_stonith_node02:1 cannot run anywhere
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (5s) for IPaddr2_1 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (5s) for IPaddr2_2 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (120s) for drbddisk_2 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (120s) for Filesystem_3 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (120s) for httpd_4 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (180s) for mysqld_5 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (120s) for rc.primary_6 on wimuds2
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource IPaddr2_1	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource IPaddr2_2	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource drbddisk_2	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource Filesystem_3	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource httpd_4	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource mysqld_5	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Move resource rc.primary_6	(Started wimuds1 -> wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node01:0	(Started wimuds2)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node01:1	(Stopped)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Stop resource CL_stonith_node02:0	(wimuds1)
May 21 10:53:04 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node02:1	(Stopped)
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_LOG    took 640989511s to complete
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640989511s to complete
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640989511s to complete
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640989511s to complete
May 21 10:53:04 wimuds2 crmd: [4429]: info: unpack_graph: Unpacked transition 101: 29 actions in 29 synapses
May 21 10:53:04 wimuds2 crmd: [4429]: info: do_te_invoke: Processing graph 101 (ref=pe_calc-dc-1242924784-155) derived from /var/lib/pengine/pe-warn-117.bz2
May 21 10:53:04 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_TE_INVOKE took 640989511s to complete
May 21 10:53:04 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 37 fired and confirmed
May 21 10:53:04 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 32: stop rc.primary_6_stop_0 on wimuds1
May 21 10:53:04 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 48 fired and confirmed
May 21 10:53:04 wimuds2 pengine: [24743]: WARN: process_pe_message: Transition 101: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-117.bz2
May 21 10:53:04 wimuds2 pengine: [24743]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
May 21 10:53:05 wimuds2 crmd: [4429]: info: match_graph_event: Action rc.primary_6_stop_0 (32) confirmed on wimuds1 (rc=0)
May 21 10:53:05 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 29: stop mysqld_5_stop_0 on wimuds1
May 21 10:53:10 wimuds2 crmd: [4429]: info: match_graph_event: Action mysqld_5_stop_0 (29) confirmed on wimuds1 (rc=0)
May 21 10:53:10 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 26: stop httpd_4_stop_0 on wimuds1
May 21 10:53:12 wimuds2 crmd: [4429]: info: match_graph_event: Action httpd_4_stop_0 (26) confirmed on wimuds1 (rc=0)
May 21 10:53:12 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 23: stop Filesystem_3_stop_0 on wimuds1
May 21 10:53:18 wimuds2 crmd: [4429]: info: match_graph_event: Action Filesystem_3_stop_0 (23) confirmed on wimuds1 (rc=0)
May 21 10:53:18 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 20: stop drbddisk_2_stop_0 on wimuds1
May 21 10:53:19 wimuds2 kernel: drbd0: peer( Primary -> Secondary ) 
May 21 10:53:19 wimuds2 crmd: [4429]: info: match_graph_event: Action drbddisk_2_stop_0 (20) confirmed on wimuds1 (rc=0)
May 21 10:53:19 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 17: stop IPaddr2_2_stop_0 on wimuds1
May 21 10:53:21 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_2_stop_0 (17) confirmed on wimuds1 (rc=0)
May 21 10:53:21 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 14: stop IPaddr2_1_stop_0 on wimuds1
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_1_stop_0 (14) confirmed on wimuds1 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 38 fired and confirmed
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 10 fired and confirmed
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 35 fired and confirmed
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 15: start IPaddr2_1_start_0 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=15:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=IPaddr2_1_start_0 )
May 21 10:53:22 wimuds2 lrmd: [4426]: info: rsc:IPaddr2_1: start
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 45: stop CL_stonith_node02:0_stop_0 on wimuds1
May 21 10:53:22 wimuds2 avahi-daemon[6971]: Registering new address record for 165.115.204.215 on eth1.
May 21 10:53:22 wimuds2 kernel: nx_host_up[467]: eth1: Not NetXen card
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation IPaddr2_1_start_0 (call=37, rc=0, cib-update=190, confirmed=true) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_1_start_0 (15) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 16: monitor IPaddr2_1_monitor_5000 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=16:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=IPaddr2_1_monitor_5000 )
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 18: start IPaddr2_2_start_0 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=18:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=IPaddr2_2_start_0 )
May 21 10:53:22 wimuds2 lrmd: [4426]: info: rsc:IPaddr2_2: start
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation IPaddr2_1_monitor_5000 (call=38, rc=0, cib-update=191, confirmed=false) complete ok
May 21 10:53:22 wimuds2 avahi-daemon[6971]: Registering new address record for 192.168.73.18 on eth2.
May 21 10:53:22 wimuds2 kernel: nx_host_up[467]: eth2: Not NetXen card
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_1_monitor_5000 (16) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation IPaddr2_2_start_0 (call=39, rc=0, cib-update=192, confirmed=true) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_2_start_0 (18) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 19: monitor IPaddr2_2_monitor_5000 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=19:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=IPaddr2_2_monitor_5000 )
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 21: start drbddisk_2_start_0 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=21:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=drbddisk_2_start_0 )
May 21 10:53:22 wimuds2 lrmd: [4426]: info: rsc:drbddisk_2: start
May 21 10:53:22 wimuds2 kernel: drbd0: role( Secondary -> Primary ) 
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation drbddisk_2_start_0 (call=41, rc=0, cib-update=193, confirmed=true) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action drbddisk_2_start_0 (21) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 22: monitor drbddisk_2_monitor_120000 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=22:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=drbddisk_2_monitor_120000 )
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 24: start Filesystem_3_start_0 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=24:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=Filesystem_3_start_0 )
May 21 10:53:22 wimuds2 lrmd: [4426]: info: rsc:Filesystem_3: start
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation drbddisk_2_monitor_120000 (call=42, rc=0, cib-update=194, confirmed=false) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation IPaddr2_2_monitor_5000 (call=40, rc=0, cib-update=195, confirmed=false) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action drbddisk_2_monitor_120000 (22) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action IPaddr2_2_monitor_5000 (19) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 kernel: kjournald starting.  Commit interval 5 seconds
May 21 10:53:22 wimuds2 kernel: EXT3-fs warning: checktime reached, running e2fsck is recommended
May 21 10:53:22 wimuds2 kernel: EXT3 FS on drbd0, internal journal
May 21 10:53:22 wimuds2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation Filesystem_3_start_0 (call=43, rc=0, cib-update=196, confirmed=true) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action Filesystem_3_start_0 (24) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 25: monitor Filesystem_3_monitor_120000 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=25:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=Filesystem_3_monitor_120000 )
May 21 10:53:22 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 27: start httpd_4_start_0 on wimuds2 (local)
May 21 10:53:22 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=27:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=httpd_4_start_0 )
May 21 10:53:22 wimuds2 lrmd: [4426]: info: rsc:httpd_4: start
May 21 10:53:22 wimuds2 lrmd: [13771]: WARN: For LSB init script, no additional parameters are needed.
May 21 10:53:22 wimuds2 lrmd: [4426]: info: RA output: (httpd_4:start:stdout) Starting httpd: 
May 21 10:53:22 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation Filesystem_3_monitor_120000 (call=44, rc=0, cib-update=197, confirmed=false) complete ok
May 21 10:53:22 wimuds2 crmd: [4429]: info: match_graph_event: Action Filesystem_3_monitor_120000 (25) confirmed on wimuds2 (rc=0)
May 21 10:53:22 wimuds2 lrmd: [4426]: info: RA output: (httpd_4:start:stderr) httpd: Could not reliably determine the server's fully qualified domain name, using 192.168.36.130 for ServerName 
May 21 10:53:23 wimuds2 lrmd: [4426]: info: RA output: (httpd_4:start:stdout) [
May 21 10:53:23 wimuds2 lrmd: [4426]: info: RA output: (httpd_4:start:stdout)   OK  ]
May 21 10:53:23 wimuds2 lrmd: [4426]: info: RA output: (httpd_4:start:stdout)  
May 21 10:53:23 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation httpd_4_start_0 (call=45, rc=0, cib-update=198, confirmed=true) complete ok
May 21 10:53:23 wimuds2 crmd: [4429]: info: match_graph_event: Action httpd_4_start_0 (27) confirmed on wimuds2 (rc=0)
May 21 10:53:23 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 28: monitor httpd_4_monitor_120000 on wimuds2 (local)
May 21 10:53:23 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=28:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=httpd_4_monitor_120000 )
May 21 10:53:23 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 30: start mysqld_5_start_0 on wimuds2 (local)
May 21 10:53:23 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=30:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=mysqld_5_start_0 )
May 21 10:53:23 wimuds2 lrmd: [4426]: info: rsc:mysqld_5: start
May 21 10:53:23 wimuds2 lrmd: [13814]: WARN: For LSB init script, no additional parameters are needed.
May 21 10:53:23 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation httpd_4_monitor_120000 (call=46, rc=0, cib-update=199, confirmed=false) complete ok
May 21 10:53:23 wimuds2 crmd: [4429]: info: match_graph_event: Action httpd_4_monitor_120000 (28) confirmed on wimuds2 (rc=0)
May 21 10:53:23 wimuds2 crmd: [4429]: info: match_graph_event: Action CL_stonith_node02:0_stop_0 (45) confirmed on wimuds1 (rc=0)
May 21 10:53:23 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 49 fired and confirmed
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (mysqld_5:start:stdout) Starting MySQL:  
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (mysqld_5:start:stdout) [
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (mysqld_5:start:stdout)   OK  ]
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (mysqld_5:start:stdout)  
May 21 10:53:24 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation mysqld_5_start_0 (call=47, rc=0, cib-update=200, confirmed=true) complete ok
May 21 10:53:24 wimuds2 crmd: [4429]: info: match_graph_event: Action mysqld_5_start_0 (30) confirmed on wimuds2 (rc=0)
May 21 10:53:24 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 31: monitor mysqld_5_monitor_180000 on wimuds2 (local)
May 21 10:53:24 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=31:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=mysqld_5_monitor_180000 )
May 21 10:53:24 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 33: start rc.primary_6_start_0 on wimuds2 (local)
May 21 10:53:24 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=33:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=rc.primary_6_start_0 )
May 21 10:53:24 wimuds2 lrmd: [4426]: info: rsc:rc.primary_6: start
May 21 10:53:24 wimuds2 lrmd: [13937]: WARN: For LSB init script, no additional parameters are needed.
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (rc.primary_6:start:stdout) rc.primary: Switching to PRIMARY. 
May 21 10:53:24 wimuds2 logger: rc.primary: Switching to PRIMARY.
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (rc.primary_6:start:stdout) Starting rc.primary applications ... 
May 21 10:53:24 wimuds2 logger: Starting rc.primary applications ...
May 21 10:53:24 wimuds2 lrmd: [4426]: info: RA output: (rc.primary_6:start:stdout) Finished starting rc.primary applications. 
May 21 10:53:24 wimuds2 logger: Finished starting rc.primary applications.
May 21 10:53:24 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation rc.primary_6_start_0 (call=49, rc=0, cib-update=201, confirmed=true) complete ok
May 21 10:53:24 wimuds2 crmd: [4429]: info: match_graph_event: Action rc.primary_6_start_0 (33) confirmed on wimuds2 (rc=0)
May 21 10:53:24 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 36 fired and confirmed
May 21 10:53:24 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 34: monitor rc.primary_6_monitor_120000 on wimuds2 (local)
May 21 10:53:24 wimuds2 crmd: [4429]: info: do_lrm_rsc_op: Performing key=34:101:0:bab4f3f4-86e8-476e-a68d-35217001c11a op=rc.primary_6_monitor_120000 )
May 21 10:53:24 wimuds2 logger: rc.primary is running...
May 21 10:53:24 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation rc.primary_6_monitor_120000 (call=50, rc=0, cib-update=202, confirmed=false) complete ok
May 21 10:53:24 wimuds2 crmd: [4429]: info: match_graph_event: Action rc.primary_6_monitor_120000 (34) confirmed on wimuds2 (rc=0)
May 21 10:53:24 wimuds2 crmd: [4429]: info: process_lrm_event: LRM operation mysqld_5_monitor_180000 (call=48, rc=0, cib-update=203, confirmed=false) complete ok
May 21 10:53:24 wimuds2 crmd: [4429]: info: match_graph_event: Action mysqld_5_monitor_180000 (31) confirmed on wimuds2 (rc=0)
May 21 10:53:24 wimuds2 crmd: [4429]: info: run_graph: ====================================================
May 21 10:53:24 wimuds2 crmd: [4429]: notice: run_graph: Transition 101 (Complete=29, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-117.bz2): Complete
May 21 10:53:24 wimuds2 crmd: [4429]: info: te_graph_trigger: Transition 101 is now complete
May 21 10:53:24 wimuds2 crmd: [4429]: info: notify_crmd: Transition 101 status: done - <null>
May 21 10:53:24 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_LOG    took 640987549s to complete
May 21 10:53:24 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 21 10:53:24 wimuds2 crmd: [4429]: info: do_state_transition: Starting PEngine Recheck Timer
May 21 10:53:24 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640987549s to complete
May 21 10:53:24 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640987549s to complete
May 21 10:53:24 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640987549s to complete
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: - <cib admin_epoch="1" epoch="118" num_updates="23" >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -   <configuration >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -     <nodes >
May 21 10:54:36 wimuds2 crmd: [4429]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -       <node id="e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:54:36 wimuds2 crmd: [4429]: info: need_abort: Aborting on change to admin_epoch
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -         <instance_attributes id="nodes-e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -           <nvpair value="true" id="standby-e77e5b23-c3ae-4757-b801-8b0995fb3f86" />
May 21 10:54:36 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -         </instance_attributes>
May 21 10:54:36 wimuds2 crmd: [4429]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -       </node>
May 21 10:54:36 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640980360s to complete
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -     </nodes>
May 21 10:54:36 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640980360s to complete
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: -   </configuration>
May 21 10:54:36 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640980360s to complete
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: - </cib>
May 21 10:54:36 wimuds2 crmd: [4429]: info: do_pe_invoke: Query 204: Requesting the current CIB: S_POLICY_ENGINE
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: + <cib admin_epoch="1" epoch="119" num_updates="1" >
May 21 10:54:36 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_PE_INVOKE took 640980360s to complete
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +   <configuration >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +     <nodes >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +       <node id="e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +         <instance_attributes id="nodes-e77e5b23-c3ae-4757-b801-8b0995fb3f86" >
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +           <nvpair value="false" id="standby-e77e5b23-c3ae-4757-b801-8b0995fb3f86" />
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +         </instance_attributes>
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +       </node>
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +     </nodes>
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: +   </configuration>
May 21 10:54:36 wimuds2 cib: [4425]: info: log_data_element: cib:diff: + </cib>
May 21 10:54:36 wimuds2 cib: [4425]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=wimuds1/crm_standby/4, version=1.119.1): ok (rc=0)
May 21 10:54:36 wimuds2 crmd: [4429]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1242924876-178, seq=10, quorate=1
May 21 10:54:37 wimuds2 pengine: [24743]: info: determine_online_status: Node wimuds2 is online
May 21 10:54:37 wimuds2 pengine: [24743]: info: determine_online_status: Node wimuds1 is online
May 21 10:54:37 wimuds2 pengine: [24743]: info: find_clone: Internally renamed CL_stonith_node01:0 on wimuds1 to CL_stonith_node01:1
May 21 10:54:37 wimuds2 pengine: [24743]: notice: group_print: Resource Group: group_1
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     IPaddr2_1	(ocf::heartbeat:IPaddr2):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     IPaddr2_2	(ocf::heartbeat:IPaddr2):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     drbddisk_2	(heartbeat:drbddisk):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     Filesystem_3	(ocf::heartbeat:Filesystem):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     httpd_4	(lsb:httpd):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     mysqld_5	(lsb:mysqld):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: native_print:     rc.primary_6	(lsb:rc.primary):	Started wimuds2
May 21 10:54:37 wimuds2 pengine: [24743]: notice: clone_print: Clone Set: CL_stonithset_node01
May 21 10:54:37 wimuds2 pengine: [24743]: notice: print_list: 	Started: [ wimuds2 ]
May 21 10:54:37 wimuds2 pengine: [24743]: notice: print_list: 	Stopped: [ CL_stonith_node01:1 ]
May 21 10:54:37 wimuds2 pengine: [24743]: notice: clone_print: Clone Set: CL_stonithset_node02
May 21 10:54:37 wimuds2 pengine: [24743]: notice: print_list: 	Stopped: [ CL_stonith_node02:0 CL_stonith_node02:1 ]
May 21 10:54:37 wimuds2 pengine: [24743]: info: native_merge_weights: CL_stonith_node01:1: Rolling back scores from CL_stonithset_node02
May 21 10:54:37 wimuds2 pengine: [24743]: WARN: native_color: Resource CL_stonith_node01:1 cannot run anywhere
May 21 10:54:37 wimuds2 pengine: [24743]: WARN: native_color: Resource CL_stonith_node02:1 cannot run anywhere
May 21 10:54:37 wimuds2 pengine: [24743]: notice: RecurringOp:  Start recurring monitor (120s) for CL_stonith_node02:0 on wimuds1
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource IPaddr2_1	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource IPaddr2_2	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource drbddisk_2	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource Filesystem_3	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource httpd_4	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource mysqld_5	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource rc.primary_6	(Started wimuds2)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node01:0	(Started wimuds2)
May 21 10:54:37 wimuds2 cib: [18169]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-26.raw
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node01:1	(Stopped)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Start CL_stonith_node02:0	(wimuds1)
May 21 10:54:37 wimuds2 pengine: [24743]: notice: LogActions: Leave resource CL_stonith_node02:1	(Stopped)
May 21 10:54:37 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_LOG    took 640980355s to complete
May 21 10:54:37 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
May 21 10:54:37 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640980355s to complete
May 21 10:54:37 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640980355s to complete
May 21 10:54:37 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640980355s to complete
May 21 10:54:37 wimuds2 crmd: [4429]: info: unpack_graph: Unpacked transition 102: 4 actions in 4 synapses
May 21 10:54:37 wimuds2 crmd: [4429]: info: do_te_invoke: Processing graph 102 (ref=pe_calc-dc-1242924876-178) derived from /var/lib/pengine/pe-warn-118.bz2
May 21 10:54:37 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_TE_INVOKE took 640980355s to complete
May 21 10:54:37 wimuds2 cib: [18169]: info: write_cib_contents: Wrote version 1.119.0 of the CIB to disk (digest: edfda9493d8a1d922a82bfed6bf4fbbe)
May 21 10:54:37 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 39 fired and confirmed
May 21 10:54:37 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 37: start CL_stonith_node02:0_start_0 on wimuds1
May 21 10:54:37 wimuds2 cib: [18169]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.GVvO7W (digest: /var/lib/heartbeat/crm/cib.v7PGbI)
May 21 10:54:37 wimuds2 pengine: [24743]: WARN: process_pe_message: Transition 102: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/pengine/pe-warn-118.bz2
May 21 10:54:37 wimuds2 pengine: [24743]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
May 21 10:54:44 wimuds2 crmd: [4429]: info: match_graph_event: Action CL_stonith_node02:0_start_0 (37) confirmed on wimuds1 (rc=0)
May 21 10:54:44 wimuds2 crmd: [4429]: info: te_rsc_command: Initiating action 38: monitor CL_stonith_node02:0_monitor_120000 on wimuds1
May 21 10:54:44 wimuds2 crmd: [4429]: info: te_pseudo_action: Pseudo action 40 fired and confirmed
May 21 10:54:52 wimuds2 crmd: [4429]: info: match_graph_event: Action CL_stonith_node02:0_monitor_120000 (38) confirmed on wimuds1 (rc=0)
May 21 10:54:52 wimuds2 crmd: [4429]: info: run_graph: ====================================================
May 21 10:54:52 wimuds2 crmd: [4429]: notice: run_graph: Transition 102 (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-warn-118.bz2): Complete
May 21 10:54:52 wimuds2 crmd: [4429]: info: te_graph_trigger: Transition 102 is now complete
May 21 10:54:52 wimuds2 crmd: [4429]: info: notify_crmd: Transition 102 status: done - <null>
May 21 10:54:52 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_LOG    took 640978826s to complete
May 21 10:54:52 wimuds2 crmd: [4429]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
May 21 10:54:52 wimuds2 crmd: [4429]: info: do_state_transition: Starting PEngine Recheck Timer
May 21 10:54:52 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_DC_TIMER_STOP took 640978826s to complete
May 21 10:54:52 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_INTEGRATE_TIMER_STOP took 640978826s to complete
May 21 10:54:52 wimuds2 crmd: [4429]: ERROR: do_fsa_action: Action A_FINALIZE_TIMER_STOP took 640978826s to complete
May 21 10:55:24 wimuds2 logger: rc.primary is running...
May 21 10:55:52 wimuds2 crm_standby: [23324]: info: Invoked: crm_standby -G 
May 21 10:56:05 wimuds2 crm_standby: [23911]: info: Invoked: crm_standby -G 
May 21 10:56:36 wimuds2 cib: [4425]: info: cib_stats: Processed 40 operations (9500.00us average, 0% utilization) in the last 10min
May 21 10:57:24 wimuds2 logger: rc.primary is running...
May 21 10:59:24 wimuds2 logger: rc.primary is running...
May 21 11:00:31 wimuds2 crmadmin: [11402]: info: Invoked: crmadmin -D 
May 21 11:00:31 wimuds2 crmd: [4429]: info: handle_request: Current ping state: S_IDLE
May 21 11:00:32 wimuds2 cibadmin: [11411]: info: Invoked: cibadmin -Ql -o nodes 
May 21 11:00:33 wimuds2 root: Mark:HB_REPORT:1242925231
