Hi,
Simple scenario, several floating IPs should be living on "front" nodes
only if there is working Nginx. There are several reasons against Nginx
being controlled by Pacemaker.
So, decided to colocate FIPs with unmanaged Nginx. This worked fine in
1.1.6 with some exceptions.
Later, on other cluster I decided to switch to 1.1.10 and corosync 2
because of performance improvements. Now also testing 1.1.12.
It seems I can't reliably colocate FIPs with unmanaged Nginx on 1.1.10
and 10.1.12.
Here are behaviors of different versions of pacemaker:
1.1.6, 1.1.10, 1.1.12:
- if Nginx has started on a node after initial probe for Nginx clone
then pacemaker will never see it running until cleanup or other probe
trigger
1.1.6:
- stopping nginx on a node makes the clone instance FAIL for that node,
FIP moves away from that node. This is as expected
- starting nginx removes FAIL state and FIP moves back. This is as
expected
1.1.10:
- stopping nginx on a node:
- usually makes the clone instance to FAIL for that node, but
FIP stays running on that node regardless of INF colocation
- sometime makes the clone instance to FAIL for that node and
immediately after that clone instance returns to STARTED state,
FIP stays running on that node
- sometimes makes the clone instance to be STOPPED for that node,
FIP moves away from that node. This is as expected
- starting nginx:
- if was FAIL: removes FAIL state: FIP remains running
- if was STARTED:
- usually nothing happens: FIP remains running
- sometimes makes clone instance to FAIL for that node, but
FIP stays running on that node regardless of INF colocation
- if was STOPPED: moves FIP back. This is as expected
1.1.12:
- stopping nginx on a node always makes the clone instance to FAIL for
that node, but FIP stays running on that node regardless of INF
colocation
- starting nginx removes FAIL state, FIP remains running
Please comment on this. And some questions:
- are unmanaged resources designed to be used in normal conditions for
other resources to be colocated with them? How to cook them right?
- is there a some kind of "recurring probe" to "see" unmanaged resources
that have started after initial probe?
Let me know if more logs needed, right now can't collect logs for all
cases, some attached.
Config for 1.1.10 (similar configs for 1.1.6 and 1.1.12):
node $id="..." pcmk10-1 \
attributes onhv="1" front="true"
node $id="..." pcmk10-2 \
attributes onhv="2" front="true"
node $id="..." pcmk10-3 \
attributes onhv="3" front="true"
primitive FIP_1 ocf:heartbeat:IPaddr2 \
op monitor interval="2s" \
params ip="10.1.1.1" cidr_netmask="16" \
meta migration-threshold="2" failure-timeout="60s"
primitive FIP_2 ocf:heartbeat:IPaddr2 \
op monitor interval="2s" \
params ip="10.1.2.1" cidr_netmask="16" \
meta migration-threshold="2" failure-timeout="60s"
primitive FIP_3 ocf:heartbeat:IPaddr2 \
op monitor interval="2s" \
params ip="10.1.3.1" cidr_netmask="16" \
meta migration-threshold="2" failure-timeout="60s"
primitive Nginx lsb:nginx \
op start interval="0" enabled="false" \
op stop interval="0" enabled="false" \
op monitor interval="2s"
clone cl_Nginx Nginx \
meta globally-unique="false" notify="false" is-managed="false"
location loc-cl_Nginx cl_Nginx \
rule $id="loc-cl_Nginx-r1" 500: front eq true
location loc-FIP_1 FIP_1 \
rule $id="loc-FIP_1-r1" 500: onhv eq 1 and front eq true \
rule $id="loc-FIP_1-r2" 200: defined onhv and onhv ne 1 and
front eq true
location loc-FIP_2 FIP_2 \
rule $id="loc-FIP_2-r1" 500: onhv eq 2 and front eq true \
rule $id="loc-FIP_2-r2" 200: defined onhv and onhv ne 2 and
front eq true
location loc-FIP_3 FIP_3 \
rule $id="loc-FIP_3-r1" 500: onhv eq 3 and front eq true \
rule $id="loc-FIP_3-r2" 200: defined onhv and onhv ne 3 and
front eq true
colocation coloc-FIP_1-cl_Nginx inf: FIP_1 cl_Nginx
colocation coloc-FIP_2-cl_Nginx inf: FIP_2 cl_Nginx
colocation coloc-FIP_3-cl_Nginx inf: FIP_3 cl_Nginx
property $id="cib-bootstrap-options" \
dc-version="1.1.10-42f2063" \
cluster-infrastructure="corosync" \
symmetric-cluster="false" \
stonith-enabled="false" \
no-quorum-policy="stop" \
cluster-recheck-interval="10s" \
maintenance-mode="false" \
last-lrm-refresh="1418998945"
rsc_defaults $id="rsc-options" \
resource-stickiness="30"
op_defaults $id="op_defaults-options" \
record-pending="false"
Dec 19 20:42:29 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:42:29 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 376: /var/lib/pacemaker/pengine/pe-input-577.bz2
Dec 19 20:42:29 pcmk11-1 crmd[10935]: notice: run_graph: Transition 376 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-577.bz2): Complete
Dec 19 20:42:29 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:39 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:42:40 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 377: /var/lib/pacemaker/pengine/pe-input-577.bz2
Dec 19 20:42:40 pcmk11-1 crmd[10935]: notice: run_graph: Transition 377 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-577.bz2): Complete
Dec 19 20:42:40 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:50 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:42:50 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 378: /var/lib/pacemaker/pengine/pe-input-577.bz2
Dec 19 20:42:50 pcmk11-1 crmd[10935]: notice: run_graph: Transition 378 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-577.bz2): Complete
Dec 19 20:42:50 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:53 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:42:53 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:53 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 379: /var/lib/pacemaker/pengine/pe-input-578.bz2
Dec 19 20:42:53 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:53 pcmk11-1 crmd[10935]: notice: run_graph: Transition 380 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-579.bz2): Complete
Dec 19 20:42:53 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:53 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 380: /var/lib/pacemaker/pengine/pe-input-579.bz2
Dec 19 20:42:53 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:42:53 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:53 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 381: /var/lib/pacemaker/pengine/pe-input-580.bz2
Dec 19 20:42:54 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:54 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 382: /var/lib/pacemaker/pengine/pe-input-581.bz2
Dec 19 20:42:54 pcmk11-1 crmd[10935]: notice: run_graph: Transition 382 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-581.bz2): Complete
Dec 19 20:42:54 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:54 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:42:54 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:54 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 383: /var/lib/pacemaker/pengine/pe-input-582.bz2
Dec 19 20:42:54 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:54 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 384: /var/lib/pacemaker/pengine/pe-input-583.bz2
Dec 19 20:42:54 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:54 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 385: /var/lib/pacemaker/pengine/pe-input-584.bz2
Dec 19 20:42:54 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:54 pcmk11-1 crmd[10935]: notice: run_graph: Transition 386 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-585.bz2): Complete
Dec 19 20:42:54 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:54 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 386: /var/lib/pacemaker/pengine/pe-input-585.bz2
Dec 19 20:42:55 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: LogActions: Move FIP_2#011(Started pcmk11-2 -> pcmk11-3)
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 387: /var/lib/pacemaker/pengine/pe-input-586.bz2
Dec 19 20:42:55 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 388: /var/lib/pacemaker/pengine/pe-input-587.bz2
Dec 19 20:42:55 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 389: /var/lib/pacemaker/pengine/pe-input-588.bz2
Dec 19 20:42:55 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 390: /var/lib/pacemaker/pengine/pe-input-589.bz2
Dec 19 20:42:55 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:42:55 pcmk11-1 crmd[10935]: notice: run_graph: Transition 391 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:42:55 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:42:55 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 391: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:05 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:05 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:05 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 392: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:05 pcmk11-1 crmd[10935]: notice: run_graph: Transition 392 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:05 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:15 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:15 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:15 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 393: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:15 pcmk11-1 crmd[10935]: notice: run_graph: Transition 393 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:15 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:25 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:25 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:25 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 394: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:25 pcmk11-1 crmd[10935]: notice: run_graph: Transition 394 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:25 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:35 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:36 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:36 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 395: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:36 pcmk11-1 crmd[10935]: notice: run_graph: Transition 395 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:36 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:46 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:46 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:46 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 396: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:43:46 pcmk11-1 crmd[10935]: notice: run_graph: Transition 396 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:46 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:56 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:43:56 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:43:56 pcmk11-1 crmd[10935]: notice: run_graph: Transition 397 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:43:56 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:43:56 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 397: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:44:06 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:44:06 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:06 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 398: /var/lib/pacemaker/pengine/pe-input-590.bz2
Dec 19 20:44:06 pcmk11-1 crmd[10935]: notice: run_graph: Transition 398 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-590.bz2): Complete
Dec 19 20:44:06 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:11 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: run_graph: Transition 399 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-591.bz2): Complete
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:11 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 399: /var/lib/pacemaker/pengine/pe-input-591.bz2
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:11 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:11 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 400: /var/lib/pacemaker/pengine/pe-input-592.bz2
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: run_graph: Transition 400 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-592.bz2): Complete
Dec 19 20:44:11 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:12 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: run_graph: Transition 401 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-593.bz2): Complete
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:12 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 401: /var/lib/pacemaker/pengine/pe-input-593.bz2
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:12 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: run_graph: Transition 402 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-594.bz2): Complete
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:12 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 402: /var/lib/pacemaker/pengine/pe-input-594.bz2
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:12 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:44:12 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 403: /var/lib/pacemaker/pengine/pe-input-595.bz2
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: run_graph: Transition 403 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-595.bz2): Complete
Dec 19 20:44:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:13 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:44:13 pcmk11-1 pengine[10934]: notice: LogActions: Move FIP_2#011(Started pcmk11-2 -> pcmk11-3)
Dec 19 20:44:13 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 404: /var/lib/pacemaker/pengine/pe-input-596.bz2
Dec 19 20:44:13 pcmk11-1 crmd[10935]: notice: run_graph: Transition 404 (Complete=2, Pending=0, Fired=0, Skipped=5, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-596.bz2): Stopped
Dec 19 20:44:13 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 405: /var/lib/pacemaker/pengine/pe-input-597.bz2
Dec 19 20:44:13 pcmk11-1 crmd[10935]: notice: run_graph: Transition 405 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-597.bz2): Complete
Dec 19 20:44:13 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:23 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:44:23 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 406: /var/lib/pacemaker/pengine/pe-input-597.bz2
Dec 19 20:44:23 pcmk11-1 crmd[10935]: notice: run_graph: Transition 406 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-597.bz2): Complete
Dec 19 20:44:23 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:33 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:44:33 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 407: /var/lib/pacemaker/pengine/pe-input-597.bz2
Dec 19 20:44:33 pcmk11-1 crmd[10935]: notice: run_graph: Transition 407 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-597.bz2): Complete
Dec 19 20:44:33 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:44:43 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:44:43 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 408: /var/lib/pacemaker/pengine/pe-input-597.bz2
Dec 19 20:44:43 pcmk11-1 crmd[10935]: notice: run_graph: Transition 408 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-597.bz2): Complete
Dec 19 20:44:43 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:37:39 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:37:40 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 298: /var/lib/pacemaker/pengine/pe-input-524.bz2
Dec 19 20:37:40 pcmk11-1 crmd[10935]: notice: run_graph: Transition 298 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-524.bz2): Complete
Dec 19 20:37:40 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:37:50 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:37:50 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 299: /var/lib/pacemaker/pengine/pe-input-524.bz2
Dec 19 20:37:50 pcmk11-1 crmd[10935]: notice: run_graph: Transition 299 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-524.bz2): Complete
Dec 19 20:37:50 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:37:50 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:37:50 pcmk11-1 pengine[10934]: notice: LogActions: Move FIP_2#011(Started pcmk11-2 -> pcmk11-3)
Dec 19 20:37:50 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 300: /var/lib/pacemaker/pengine/pe-input-525.bz2
Dec 19 20:37:50 pcmk11-1 pengine[10934]: notice: LogActions: Move FIP_2#011(Started pcmk11-2 -> pcmk11-3)
Dec 19 20:37:50 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 301: /var/lib/pacemaker/pengine/pe-input-526.bz2
Dec 19 20:37:51 pcmk11-1 crmd[10935]: notice: run_graph: Transition 301 (Complete=4, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-526.bz2): Stopped
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: LogActions: Start FIP_2#011(pcmk11-3)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 302: /var/lib/pacemaker/pengine/pe-input-527.bz2
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: LogActions: Start FIP_2#011(pcmk11-3)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 303: /var/lib/pacemaker/pengine/pe-input-528.bz2
Dec 19 20:37:51 pcmk11-1 crmd[10935]: notice: run_graph: Transition 303 (Complete=1, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-528.bz2): Stopped
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 304: /var/lib/pacemaker/pengine/pe-input-529.bz2
Dec 19 20:37:51 pcmk11-1 crmd[10935]: notice: run_graph: Transition 304 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-529.bz2): Complete
Dec 19 20:37:51 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:37:51 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 305: /var/lib/pacemaker/pengine/pe-input-530.bz2
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 306: /var/lib/pacemaker/pengine/pe-input-531.bz2
Dec 19 20:37:51 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:51 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 307: /var/lib/pacemaker/pengine/pe-input-532.bz2
Dec 19 20:37:52 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:37:52 pcmk11-1 crmd[10935]: notice: run_graph: Transition 308 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:37:52 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 308: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:37:52 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:02 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:38:02 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:38:02 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 309: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:38:02 pcmk11-1 crmd[10935]: notice: run_graph: Transition 309 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:38:02 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:38:12 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:38:12 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 310: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:38:12 pcmk11-1 crmd[10935]: notice: run_graph: Transition 310 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:38:12 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:22 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:38:22 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:38:22 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 311: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:38:22 pcmk11-1 crmd[10935]: notice: run_graph: Transition 311 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:38:22 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:32 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:38:32 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:38:32 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 312: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:38:32 pcmk11-1 crmd[10935]: notice: run_graph: Transition 312 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:38:32 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:42 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:38:42 pcmk11-1 pengine[10934]: warning: unpack_rsc_op: Processing failed op monitor for Nginx2:1 on pcmk11-2: not running (7)
Dec 19 20:38:42 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 313: /var/lib/pacemaker/pengine/pe-input-533.bz2
Dec 19 20:38:42 pcmk11-1 crmd[10935]: notice: run_graph: Transition 313 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-533.bz2): Complete
Dec 19 20:38:42 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:48 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:38:48 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 314: /var/lib/pacemaker/pengine/pe-input-534.bz2
Dec 19 20:38:48 pcmk11-1 crmd[10935]: notice: run_graph: Transition 314 (Complete=2, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-534.bz2): Stopped
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: LogActions: Move FIP_2#011(Started pcmk11-3 -> pcmk11-2)
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 315: /var/lib/pacemaker/pengine/pe-input-535.bz2
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: run_graph: Transition 315 (Complete=2, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-535.bz2): Stopped
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: LogActions: Start FIP_2#011(pcmk11-2)
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 316: /var/lib/pacemaker/pengine/pe-input-536.bz2
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: LogActions: Start FIP_2#011(pcmk11-2)
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 317: /var/lib/pacemaker/pengine/pe-input-537.bz2
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: run_graph: Transition 317 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-537.bz2): Complete
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 318: /var/lib/pacemaker/pengine/pe-input-538.bz2
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: run_graph: Transition 318 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-538.bz2): Complete
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 319: /var/lib/pacemaker/pengine/pe-input-539.bz2
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: run_graph: Transition 319 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-539.bz2): Complete
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ]
Dec 19 20:38:49 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 320: /var/lib/pacemaker/pengine/pe-input-540.bz2
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: run_graph: Transition 320 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-540.bz2): Complete
Dec 19 20:38:49 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:38:59 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:39:00 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 321: /var/lib/pacemaker/pengine/pe-input-540.bz2
Dec 19 20:39:00 pcmk11-1 crmd[10935]: notice: run_graph: Transition 321 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-540.bz2): Complete
Dec 19 20:39:00 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
Dec 19 20:39:10 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped ]
Dec 19 20:39:10 pcmk11-1 pengine[10934]: notice: process_pe_message: Calculated Transition 322: /var/lib/pacemaker/pengine/pe-input-540.bz2
Dec 19 20:39:10 pcmk11-1 crmd[10935]: notice: run_graph: Transition 322 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-540.bz2): Complete
Dec 19 20:39:10 pcmk11-1 crmd[10935]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ]
_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker
Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org
