Hello,
In the last couple of days I'm trying to create a RHEL7 cluster using
pacemaker with 3 cluster resource (LVM, FS, IP). Now I'm having some big
problems with the first part as you can read bellow :(
Short story:
- I need to mirror two storage boxes from two different locations using LVM
mirror
- I also need to create a cluster and the LVM resource should be a LVM that
have LUNS from the two storage boxes
- I've created the cluster + resources but the problem is that when one of
the storage boxes is down and then get back online, LVM will not start to
sync so I need to stop the LVM cluster resource and then start it again
So please see the document attached for some debugging I've done and more
info regarding this
Thank you,
Ionut
-> I'm using multipath (I also see each LUNs from two different paths...so
multipath or alternative is needed but i guess this is obvious for everyone)
-> Here are some lines that maybe you will find usefull
pvcreate /dev/mapper/dc_cee3 /dev/mapper/dr_300b
vgcreate clust /dev/mapper/dc_cee3 /dev/mapper/dr_300b
lvcreate --nosync -m1 -l 100%FREE -n lvclust clust /dev/mapper/dc_cee3
/dev/mapper/dr_300b
mkfs.ext4 /dev/clust/lvclust
============================================================================================================
[root@cl01 ~]# pcs status
Cluster name: MyCluster
Last updated: Sat Oct 31 18:11:47 2015 Last change: Sat Oct 31
17:55:27 2015 by root via crm_resource on cl01hb
Stack: corosync
Current DC: cl01hb (version 1.1.13-a14efad) - partition with quorum
2 nodes and 5 resources configured
Online: [ cl01hb cl02hb ]
Full list of resources:
Resource Group: MyCluster
CL_LVM (ocf::heartbeat:LVM): Started cl01hb
CL_FS (ocf::heartbeat:Filesystem): Started cl01hb
CL_VIP (ocf::heartbeat:IPaddr2): Started cl01hb
PCSD Status:
cl01hb: Online
cl02hb: Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
[root@cl01 ~]# lvs -ao +devices clust
LV VG Attr LSize Pool Origin Data% Meta% Move Log
Cpy%Sync Convert Devices
lvclust clust Rwi-aor--- 1.99g
100.00 lvclust_rimage_0(0),lvclust_rimage_1(0)
[lvclust_rimage_0] clust iwi-aor--- 1.99g
/dev/mapper/dc_cee3(1)
[lvclust_rimage_1] clust iwi-aor--- 1.99g
/dev/mapper/dr_300b(1)
[lvclust_rmeta_0] clust ewi-aor--- 4.00m
/dev/mapper/dc_cee3(0)
[lvclust_rmeta_1] clust ewi-aor--- 4.00m
/dev/mapper/dr_300b(0)
----------- bellow you can see what actually happens when a box is not
presenting LUNs anymore ----
[root@cl01 clust]# lvs -ao +devices clust
/dev/mapper/dr_300b: read failed after 0 of 4096 at 0: Input/output error
/dev/mapper/dr_300b: read failed after 0 of 4096 at 2147418112: Input/output
error
/dev/mapper/dr_300b: read failed after 0 of 4096 at 2147475456: Input/output
error
/dev/mapper/dr_300b: read failed after 0 of 4096 at 4096: Input/output error
Couldn't find device with uuid BfwAbA-Nl9a-b8pQ-tou6-UJkj-ZXhr-VyfCCh.
LV VG Attr LSize Pool Origin Data% Meta% Move Log
Cpy%Sync Convert Devices
lvclust clust Rwi-aor-p- 1.99g
100.00 lvclust_rimage_0(0),lvclust_rimage_1(0)
[lvclust_rimage_0] clust iwi-aor--- 1.99g
/dev/mapper/dc_cee3(1)
[lvclust_rimage_1] clust iwi-aor-p- 1.99g
unknown device(1)
[lvclust_rmeta_0] clust ewi-aor--- 4.00m
/dev/mapper/dc_cee3(0)
[lvclust_rmeta_1] clust ewi-aor-p- 4.00m
unknown device(0)
[root@cl01 ~]# multipath -ll
dr_300b (3600140511c79ca23fe54c5aafbfa300b) dm-3 LIO-ORG ,dr1
size=2.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=enabled
|- 3:0:0:1 sde 8:64 failed faulty running
`- 4:0:0:1 sdd 8:48 failed faulty running
dc_cee3 (36001405c4506bc583474f19b70a3cee3) dm-2 LIO-ORG ,dc1
size=2.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 3:0:0:0 sdb 8:16 active ready running
`- 4:0:0:0 sdc 8:32 active ready running
------- and here is the output after the LUNs are again presented from DR box
and I stop/start the LVM resource ------
[root@cl01 clust]# pcs resource disable CL_LVM
[root@cl01 ~]# pcs resource enable CL_LVM
# pcs resource show
Resource Group: MyCluster
CL_LVM (ocf::heartbeat:LVM): Started cl01hb
CL_FS (ocf::heartbeat:Filesystem): Started cl01hb
CL_VIP (ocf::heartbeat:IPaddr2): Started cl01hb
[root@cl01 ~]# lvs -ao +devices clust
LV VG Attr LSize Pool Origin Data% Meta% Move Log
Cpy%Sync Convert Devices
lvclust clust Rwi-aor--- 1.99g
37.45 lvclust_rimage_0(0),lvclust_rimage_1(0)
[lvclust_rimage_0] clust iwi-aor--- 1.99g
/dev/mapper/dc_cee3(1)
[lvclust_rimage_1] clust Iwi-aor--- 1.99g
/dev/mapper/dr_300b(1)
[lvclust_rmeta_0] clust ewi-aor--- 4.00m
/dev/mapper/dc_cee3(0)
[lvclust_rmeta_1] clust ewi-aor--- 4.00m
/dev/mapper/dr_300b(0)
_______________________________________________
Tech mailing list
Tech@lists.lopsa.org
https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
http://lopsa.org/
