Here is the config and output of few commands [root@sys11 ~]# pcs config Cluster Name: kpacemaker1.1 Corosync Nodes:
Pacemaker Nodes: sys11 sys12 Resources: Master: ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Meta Attrs: clone-max=2 globally-unique=false target-role=Started Resource: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 (class=ocf provider=heartbeat type=vgc-cm-agent.ocf) Attributes: cluster_uuid=de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Operations: monitor interval=30s role=Master timeout=100s (vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-monitor-interval-30s) monitor interval=31s role=Slave timeout=100s (vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-monitor-interval-31s) Stonith Devices: Fencing Levels: Location Constraints: Resource: ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Enabled on: sys11 (score:200) (id:location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200) Enabled on: sys12 (score:200) (id:location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200) Resource: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Enabled on: sys11 (score:200) (id:location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200) Enabled on: sys12 (score:200) (id:location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200) Ordering Constraints: Colocation Constraints: Cluster Properties: cluster-infrastructure: cman dc-version: 1.1.8-7.el6-394e906 no-quorum-policy: ignore stonith-enabled: false symmetric-cluster: false [root@sys11 ~]# pcs resource Master/Slave Set: ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 [vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8] Masters: [ sys11 ] Slaves: [ sys12 ] [root@sys11 ~]# pcs resource disable vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 [root@sys11 ~]# pcs resource Master/Slave Set: ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 [vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8] Stopped: [ vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0 vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1 ] [root@sys11 ~]# pcs resource delete vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Removing Constraint - location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200 Removing Constraint - location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200 Removing Constraint - location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200 Removing Constraint - location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200 Attempting to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8...Error: Unable to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 before deleting (re-run with --force to force deletion) [root@sys11 ~]# pcs resource delete vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 Attempting to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8...Error: Unable to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 before deleting (re-run with --force to force deletion) [root@sys11 ~]# pcs resource Master/Slave Set: ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 [vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8] Stopped: [ vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0 vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1 ] [root@sys11 ~]# pcs resource delete vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 --force Deleting Resource - vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 [root@sys11 ~]# pcs resource NO resources configured [root@sys11 ~]# On Wed, Feb 26, 2014 at 6:31 PM, K Mehta <kiranmehta1...@gmail.com> wrote: > With force option, resource gets deleted. But the question is, why should > the stop fail. > Setup has two systems and there is only one resource (multi state type). > Things work > fine with crm commands. With pcs command, delete command tries to stop but > fails. > > Looked at pcs resource.py script and after adding some prints, looks like > multistate resource has :0 or :1 > appended by pacemaker and that doesnt match with name of the resource that > is to be stopped. > > > Will send configuration file in some time > > > On Wed, Feb 26, 2014 at 4:57 PM, Frank Brendel > <frank.bren...@eurolog.com>wrote: > >> An overview of your setup/configuration would be nice. >> What was the cluster status before you tried to delete the resource? >> And did you try the --force option? >> >> >> Am 26.02.2014 11:46, schrieb K Mehta: >> >> Here is the log >> >> [root@sys11 ~]# pcs resource delete >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 >> Feb 26 02:28:16 sys11 cibadmin[5072]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //master[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"] >> Feb 26 02:28:16 sys11 cibadmin[5073]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //group[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"] >> Feb 26 02:28:16 sys11 cibadmin[5074]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //clone[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"] >> Feb 26 02:28:16 sys11 cibadmin[5075]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //group/primitive[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"]/.. >> Feb 26 02:28:16 sys11 cibadmin[5076]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //master/primitive[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"]/.. >> Feb 26 02:28:16 sys11 cibadmin[5077]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //clone/primitive[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"]/.. >> Feb 26 02:28:16 sys11 cibadmin[5078]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath >> //resources/descendant::primitive[@id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8"] >> Feb 26 02:28:16 sys11 cibadmin[5079]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -l -Q >> Feb 26 02:28:16 sys11 cibadmin[5080]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -l -Q >> Removing Constraint - >> location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200 >> Feb 26 02:28:16 sys11 cibadmin[5081]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath //constraints >> Feb 26 02:28:16 sys11 cibadmin[5082]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -c -R --xml-text <constraints>#012 <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200" >> node="sys11" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" >> score="200"/>#012 <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" >> score="200"/>#012 #012 <rsc_location >> id="location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc= >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: --- 0.10093.35 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: +++ 0.10094.1 >> 27f25363baeeec4878c2cea5e6222e23 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: -- >> <rsc_location >> id="location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200" >> node="sys11" rsc="ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" score="200" /> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: ++ <cib >> epoch="10094" num_updates="1" admin_epoch="0" validate-with="pacemaker-1.2" >> crm_feature_set="3.0.7" update-origin="sys11" update-client="cibadmin" >> cib-last-written="Wed Feb 26 02:27:31 2014" have-quorum="1" dc-uuid="sys11" >> /> >> Feb 26 02:28:16 sys11 crmd[4127]: notice: do_state_transition: State >> transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL >> origin=abort_transition_graph ] >> Feb 26 02:28:16 sys11 crmd[4127]: notice: do_state_transition: State >> transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC >> cause=C_FSA_INTERNAL origin=do_election_check ] >> Removing Constraint - >> location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200 >> Feb 26 02:28:16 sys11 cibadmin[5083]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath //constraints >> Feb 26 02:28:16 sys11 cibadmin[5085]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -c -R --xml-text <constraints>#012 <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200" >> node="sys11" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" >> score="200"/>#012 <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" >> score="200"/>#012 #012</constraints> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: --- 0.10094.14 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: +++ 0.10095.1 >> c48d530998d1a3e4621d73567df7def4 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: -- >> <rsc_location >> id="location-ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc="ms-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" score="200" /> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: ++ <cib >> epoch="10095" num_updates="1" admin_epoch="0" validate-with="pacemaker-1.2" >> crm_feature_set="3.0.7" update-origin="sys11" update-client="cibadmin" >> cib-last-written="Wed Feb 26 02:28:16 2014" have-quorum="1" dc-uuid="sys11" >> /> >> Removing Constraint - >> location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200 >> Feb 26 02:28:16 sys11 cibadmin[5090]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath //constraints >> Feb 26 02:28:16 sys11 cibadmin[5091]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -c -R --xml-text <constraints>#012 #012 <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" >> score="200"/>#012</constraints> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: --- 0.10095.4 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: +++ 0.10096.1 >> f2dda1c76e257f9f5049a4fea144aef3 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: -- >> <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys11-200" >> node="sys11" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" score="200" /> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: ++ <cib >> epoch="10096" num_updates="1" admin_epoch="0" validate-with="pacemaker-1.2" >> crm_feature_set="3.0.7" update-origin="sys11" update-client="cibadmin" >> cib-last-written="Wed Feb 26 02:28:16 2014" have-quorum="1" dc-uuid="sys11" >> /> >> Removing Constraint - >> location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200 >> Feb 26 02:28:16 sys11 cibadmin[5092]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -Q --xpath //constraints >> Feb 26 02:28:16 sys11 cibadmin[5093]: notice: crm_log_args: Invoked: >> /usr/sbin/cibadmin -c -R --xml-text <constraints>#012 #012</constraints> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: --- 0.10096.3 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: Diff: +++ 0.10097.1 >> fe7ac58f6c73ebda83d723bfc2d31241 >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: -- >> <rsc_location >> id="location-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-sys12-200" >> node="sys12" rsc="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8" score="200" /> >> Feb 26 02:28:16 sys11 cib[4122]: notice: cib:diff: ++ <cib >> epoch="10097" num_updates="1" admin_epoch="0" validate-with="pacemaker-1.2" >> crm_feature_set="3.0.7" update-origin="sys11" update-client="cibadmin" >> cib-last-written="Wed Feb 26 02:28:16 2014" have-quorum="1" dc-uuid="sys11" >> /> >> Feb 26 02:28:17 sys11 crmd[4127]: notice: do_state_transition: State >> transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC >> cause=C_FSA_INTERNAL origin=do_election_check ] >> Feb 26 02:28:17 sys11 attrd[4125]: notice: attrd_local_callback: >> Sending full refresh (origin=crmd) >> Feb 26 02:28:17 sys11 attrd[4125]: notice: attrd_trigger_update: >> Sending flush op to all hosts for: probe_complete (true) >> Feb 26 02:28:17 sys11 attrd[4125]: notice: attrd_trigger_update: >> Sending flush op to all hosts for: >> master-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 (4) >> Feb 26 02:28:17 sys11 corosync[3908]: [TOTEM ] Retransmit List: 48b >> Attempting to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8...Feb 26 >> 02:28:17 sys11 cib[4122]: notice: cib:diff: Diff: --- 0.10097.30 >> Feb 26 02:28:17 sys11 cib[4122]: notice: cib:diff: Diff: +++ 0.10098.1 >> f59db8d942683a1cdfed469909aadd3e >> Feb 26 02:28:17 sys11 cib[4122]: notice: cib:diff: -- <cib >> admin_epoch="0" epoch="10097" num_updates="30" /> >> Feb 26 02:28:17 sys11 cib[4122]: notice: cib:diff: ++ >> <meta_attributes >> id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-meta_attributes" > >> Feb 26 02:28:17 sys11 cib[4122]: notice: cib:diff: ++ >> <nvpair >> id="vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8-meta_attributes-target-role" >> name="target-role" value="Stopped" /> >> Feb 26 02:28:17 sys11 cib[4122]: notice: cib:diff: ++ >> </meta_attributes> >> Feb 26 02:28:18 sys11 pengine[4126]: notice: unpack_config: On loss of >> CCM Quorum: Ignore >> Feb 26 02:28:18 sys11 pengine[4126]: error: clone_color: >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0 is running on sys12 which isn't >> allowed >> Feb 26 02:28:18 sys11 pengine[4126]: error: clone_color: >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1 is running on sys11 which isn't >> allowed >> Feb 26 02:28:18 sys11 pengine[4126]: notice: LogActions: Demote >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0#011(Master -> Stopped sys12) >> Feb 26 02:28:18 sys11 pengine[4126]: notice: LogActions: Stop >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1#011(sys11) >> Feb 26 02:28:18 sys11 pengine[4126]: notice: process_pe_message: >> Calculated Transition 13: /var/lib/pacemaker/pengine/pe-input-2207.bz2 >> Feb 26 02:28:18 sys11 pengine[4126]: notice: unpack_config: On loss of >> CCM Quorum: Ignore >> Feb 26 02:28:18 sys11 pengine[4126]: error: clone_color: >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0 is running on sys12 which isn't >> allowed >> Feb 26 02:28:18 sys11 pengine[4126]: error: clone_color: >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1 is running on sys11 which isn't >> allowed >> Feb 26 02:28:18 sys11 pengine[4126]: notice: LogActions: Demote >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:0#011(Master -> Stopped sys12) >> Feb 26 02:28:18 sys11 pengine[4126]: notice: LogActions: Stop >> vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8:1#011(sys11) >> Feb 26 02:28:18 sys11 pengine[4126]: notice: process_pe_message: >> Calculated Transition 14: (null) >> Feb 26 02:28:18 sys11 kernel: VGC: [0000006711341b03:I] Stopped >> vHA/vShare instance /dev/vgca0_VHA >> Feb 26 02:28:19 sys11 attrd[4125]: notice: attrd_trigger_update: >> Sending flush op to all hosts for: >> master-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 (<null>) >> Feb 26 02:28:19 sys11 attrd[4125]: notice: attrd_perform_update: Sent >> delete 184: node=sys11, >> attr=master-vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8, id=<n/a>, set=(null), >> section=status >> Feb 26 02:28:19 sys11 crmd[4127]: notice: process_lrm_event: LRM >> operation vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8_stop_0 (call=27, rc=0, >> cib-update=303, confirmed=true) ok >> Feb 26 02:28:19 sys11 crmd[4127]: notice: run_graph: Transition 14 >> (Complete=7, Pending=0, Fired=0, Skipped=1, Incomplete=0, Source=unknown): >> Stopped >> Feb 26 02:28:19 sys11 pengine[4126]: notice: unpack_config: On loss of >> CCM Quorum: Ignore >> Feb 26 02:28:19 sys11 pengine[4126]: notice: process_pe_message: >> Calculated Transition 15: /var/lib/pacemaker/pengine/pe-input-2208.bz2 >> Feb 26 02:28:19 sys11 crmd[4127]: notice: run_graph: Transition 15 >> (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, >> Source=/var/lib/pacemaker/pengine/pe-input-2208.bz2): Complete >> Feb 26 02:28:19 sys11 crmd[4127]: notice: do_state_transition: State >> transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS >> cause=C_FSA_INTERNAL origin=notify_crmd ] >> Error: Unable to stop: vha-de5566b1-c2a3-4dc6-9712-c82bb43f19d8 before >> deleting (re-run with --force to force deletion) >> >> >> >> On Wed, Feb 26, 2014 at 1:10 PM, Frank Brendel <frank.bren...@eurolog.com >> > wrote: >> >>> No erros in syslog? >>> >>> >>> Am 25.02.2014 15:45, schrieb K Mehta: >>> >>> Frank, >>> Creation/Disabling/Deletion of non multi state resource worked fine. >>> When I try to delete a multi state resource, the resource goes into >>> stopped state and the following error is thrown >>> >>> Error: unable to stop: ..... >>> >>> Regards, >>> kiran >>> >>> >>> >>> _______________________________________________ >>> Pacemaker mailing list: Pacemaker@oss.clusterlabs.org >>> http://oss.clusterlabs.org/mailman/listinfo/pacemaker >>> >>> Project Home: http://www.clusterlabs.org >>> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf >>> Bugs: http://bugs.clusterlabs.org >>> >>> >> >> >> _______________________________________________ >> Pacemaker mailing list: >> Pacemaker@oss.clusterlabs.orghttp://oss.clusterlabs.org/mailman/listinfo/pacemaker >> >> Project Home: http://www.clusterlabs.org >> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf >> Bugs: http://bugs.clusterlabs.org >> >> >> >> >> _______________________________________________ >> Pacemaker mailing list: Pacemaker@oss.clusterlabs.org >> http://oss.clusterlabs.org/mailman/listinfo/pacemaker >> >> Project Home: http://www.clusterlabs.org >> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf >> Bugs: http://bugs.clusterlabs.org >> >> >
_______________________________________________ Pacemaker mailing list: Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://bugs.clusterlabs.org