Diff hostcache... OK
Diff ccm_tool.txt... Diff cib.xml...  <diff>
   <diff-removed admin_epoch="0" epoch="6" num_updates="7">
     <cib num_peers="2" ccm_transition="2" generated="true" dc_uuid="05e25c65-839e-48a8-9c3b-b94f63ea4b55" num_updates="7"/>
   </diff-removed>
   <diff-added admin_epoch="0" epoch="6" num_updates="1">
     <cib num_peers="0" generated="false" num_updates="1" ccm_transition="1"/>
   </diff-added>
 </diff>
varies
Diff crm_mon.txt... Diff ha.cf... OK
Diff logd.cf... OK
Diff sysinfo.txt... OK

Log patterns:
stonithd[11751]: 2008/06/17_10:41:33 ERROR: Failed to STONITH the node x3650a: optype=RESET, op_result=TIMEOUT
tengine[11910]: 2008/06/17_10:41:33 ERROR: tengine_stonith_callback: Stonith of x3650a failed (2)... aborting transition.
ccm[11748]: 2008/06/17_10:41:37 ERROR: Lost connection to heartbeat service. Need to bail out.
crmd[11753]: 2008/06/17_10:41:37 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1.
cib[11749]: 2008/06/17_10:41:37 ERROR: cib_ccm_dispatch: CCM connection appears to have failed: rc=-1.
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_TRANSITION_ENGINE)
cib[11749]: 2008/06/17_10:41:37 ERROR: cib_ccm_dispatch: Exiting to recover from CCM connection failure
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_TERMINATE from do_recover() received in state (S_RECOVERY)
attrd[11752]: 2008/06/17_10:41:37 ERROR: cib_native_msgready: Message pending on command channel [11749]
attrd[11752]: 2008/06/17_10:41:37 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========#
attrd[11752]: 2008/06/17_10:41:37 ERROR: MSG: No message to dump
attrd[11752]: 2008/06/17_10:41:37 CRIT: cib_native_dispatch: Lost connection to the CIB service [11749/callback].
attrd[11752]: 2008/06/17_10:41:37 ERROR: attrd_cib_connection_destroy: Connection to the CIB terminated...
tengine[11910]: 2008/06/17_10:41:37 ERROR: subsystem_msg_dispatch: The server 11753 has left us: Shutting down...NOW
crmd[11753]: 2008/06/17_10:41:37 ERROR: cib_native_msgready: Message pending on command channel [11749]
crmd[11753]: 2008/06/17_10:41:37 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========#
crmd[11753]: 2008/06/17_10:41:37 ERROR: MSG: No message to dump
crmd[11753]: 2008/06/17_10:41:37 CRIT: cib_native_dispatch: Lost connection to the CIB service [11749/callback].
crmd[11753]: 2008/06/17_10:41:37 ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated...
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_ERROR from crmd_cib_connection_destroy() received in state (S_TERMINATE)
crmd[11753]: 2008/06/17_10:41:37 ERROR: verify_stopped: 1 pending LRM operations at shutdown
crmd[11753]: 2008/06/17_10:41:37 ERROR: ghash_print_pending: Pending action: r_stonith-node01:10
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_exit: Performing A_EXIT_1 - forcefully exiting the CRMd
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_exit: Could not recover from internal error
stonithd[11751]: 2008/06/17_10:41:37 ERROR: Disconnected with heartbeat daemon
stonithd[11751]: 2008/06/17_10:41:33 ERROR: Failed to STONITH the node x3650a: optype=RESET, op_result=TIMEOUT
tengine[11910]: 2008/06/17_10:41:33 ERROR: tengine_stonith_callback: Stonith of x3650a failed (2)... aborting transition.
ccm[11748]: 2008/06/17_10:41:37 ERROR: Lost connection to heartbeat service. Need to bail out.
crmd[11753]: 2008/06/17_10:41:37 ERROR: ccm_dispatch: CCM connection appears to have failed: rc=-1.
cib[11749]: 2008/06/17_10:41:37 ERROR: cib_ccm_dispatch: CCM connection appears to have failed: rc=-1.
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_ERROR from ccm_dispatch() received in state (S_TRANSITION_ENGINE)
cib[11749]: 2008/06/17_10:41:37 ERROR: cib_ccm_dispatch: Exiting to recover from CCM connection failure
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_recover: Action A_RECOVER (0000000001000000) not supported
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_TERMINATE from do_recover() received in state (S_RECOVERY)
attrd[11752]: 2008/06/17_10:41:37 ERROR: cib_native_msgready: Message pending on command channel [11749]
attrd[11752]: 2008/06/17_10:41:37 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========#
attrd[11752]: 2008/06/17_10:41:37 ERROR: MSG: No message to dump
attrd[11752]: 2008/06/17_10:41:37 CRIT: cib_native_dispatch: Lost connection to the CIB service [11749/callback].
attrd[11752]: 2008/06/17_10:41:37 ERROR: attrd_cib_connection_destroy: Connection to the CIB terminated...
tengine[11910]: 2008/06/17_10:41:37 ERROR: subsystem_msg_dispatch: The server 11753 has left us: Shutting down...NOW
crmd[11753]: 2008/06/17_10:41:37 ERROR: cib_native_msgready: Message pending on command channel [11749]
crmd[11753]: 2008/06/17_10:41:37 ERROR: crm_log_message_adv: #========= cib:cmd message start ==========#
crmd[11753]: 2008/06/17_10:41:37 ERROR: MSG: No message to dump
crmd[11753]: 2008/06/17_10:41:37 CRIT: cib_native_dispatch: Lost connection to the CIB service [11749/callback].
crmd[11753]: 2008/06/17_10:41:37 ERROR: crmd_cib_connection_destroy: Connection to the CIB terminated...
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_log: [[FSA]] Input I_ERROR from crmd_cib_connection_destroy() received in state (S_TERMINATE)
crmd[11753]: 2008/06/17_10:41:37 ERROR: verify_stopped: 1 pending LRM operations at shutdown
crmd[11753]: 2008/06/17_10:41:37 ERROR: ghash_print_pending: Pending action: r_stonith-node01:10
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_exit: Performing A_EXIT_1 - forcefully exiting the CRMd
crmd[11753]: 2008/06/17_10:41:37 ERROR: do_exit: Could not recover from internal error
stonithd[11751]: 2008/06/17_10:41:37 ERROR: Disconnected with heartbeat daemon
