On Fri, Oct 29, 2010 at 4:18 AM, Matthew F. Hymowitz <mhymow...@gmpnet.net> wrote: > I am building a two node active/passive cluster supporting > iSCSITarget,iSCSILogicalUnit and ocf:linbit:drbd. I can hard power down a > primary node (i.e. pull the power cord ) and all my resource migrate > correctly to the other node. However, if I try to migrate the resoruces, > put an active node in standby or shut a system down gracefully DRBD > compalains to the console that drbd0 is held open by someone (it is wanting > to switch to seocndary/secondary) .
A missing ordering constraint (that ensures something using the drbd device gets stopped) perhaps? > I followed the example here: > http://www.drbd.org/users-guide/s-pacemaker-crm.html and converted resources > from filesystem to iscsi. I can not figure out what is wrong with my order > or colocation statements. I tried every permutaition of ordering that I > could think of. Both systems are running debian/sid with corosync version > 1.2.1 and pacemaker version loaded from the debian repository. The kernel > is version 2.6.34 with liotarget support built in. Any help that any could > provide would be greatly appreciated. Thank you. Here is my config: > > node sedona \ > attributes standby="off" > node toltec \ > attributes standby="off" > primitive drbdWitnessDisk ocf:linbit:drbd \ > params drbd_resource="witnessdisk" \ > op monitor interval="59s" role="Master" timeout="30s" \ > op monitor interval="60s" role="Slave" timeout="30s" \ > op start interval="0s" timeout="240s" \ > op stop interval="0s" timeout="100" > primitive ip_iscsi ocf:heartbeat:IPaddr2 \ > params ip="192.168.7.5" nic="eth0" > primitive iscsiTarget ocf:heartbeat:iSCSITarget \ > params implementation="lio" > iqn="iqn.2003-01.org.linux-iscsi.sedona.x86:sn.e6c51b908732" > portals="192.168.7.5:3260" > allowed_initiators="iqn.1991-05.com.microsoft:black-bear.****.local" \ > op monitor interval="10s" timeout="10s" > primitive sedona-stonith stonith:external/ipmi \ > params hostname="sedona.********.com" ipaddr="192.168.7.10" > userid="admin" passwd="**********" interface="lan" \ > op start interval="0s" timeout="60s" \ > meta target-role="Started" > primitive toltec-stonith stonith:external/ssh \ > params hostlist="toltec" livedangerously="yes" \ > meta target-role="Started" \ > op start interval="0s" timeout="60s" > primitive witnessDiskLU ocf:heartbeat:iSCSILogicalUnit \ > params implementation="lio" > target_iqn="iqn.2003-01.org.linux-iscsi.sedona.x86:sn.e6c51b908732" lun="0" > path="/dev/drbd0" > group iscsi witnessDiskLU ip_iscsi iscsiTarget \ > meta target-role="Started" > ms ms-drbdWitnessDisk drbdWitnessDisk \ > meta clone-max="2" notify="true" globally-unique="false" > target-role="Started" > location cli-standby-iscsi iscsi \ > rule $id="cli-standby-rule-iscsi" -inf: #uname eq toltec > location ms-drbdWitnessDisk-master-on-sedona-1 ms-drbdWitnessDisk \ > rule $id="ms-drbdWitnessDisk-master-on-sedona-1-rule" $role="master" > 100: #uname eq sedona > location ms-drbdWitnessDisk-placement ms-drbdWitnessDisk \ > rule $id="ms-drbdWitnessDisk-placement-rule" -inf: #uname ne sedona > and #uname ne toltec > location sedona-stonith-on-toltec sedona-stonith \ > rule $id="sedona-stonith-on-toltec-rule" -INF: #uname eq sedona > location toltec-stonith-on-sedona toltec-stonith \ > rule $id="toltec-stonith-on-sedona-rule" -INF: #uname eq toltec > colocation iscsi-on-msdrbdwitnessDisk inf: iscsi ms-drbdWitnessDisk:Master > order iscsi_after_drbd inf: ms-drbdWitnessDisk:promote iscsi:start > symmetrical=true > property $id="cib-bootstrap-options" \ > dc-version="1.0.9-74392a28b7f31d7ddc86689598bd23114f58978b" \ > cluster-infrastructure="openais" \ > expected-quorum-votes="2" \ > no-quorum-policy="ignore" \ > last-lrm-refresh="1288316571" > > Matt Hymowitz > GMP Networks > 520 577-3891 x 11 > _______________________________________________ > Pacemaker mailing list: Pacemaker@oss.clusterlabs.org > http://oss.clusterlabs.org/mailman/listinfo/pacemaker > > Project Home: http://www.clusterlabs.org > Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf > Bugs: > http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker > > _______________________________________________ Pacemaker mailing list: Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://developerbugs.linux-foundation.org/enter_bug.cgi?product=Pacemaker