On 03/05/2014 06:52 AM, kenneth wrote:
We have a three-node ceph cluster.

Node#1
MDS#1 - primary
MON#1
3 OSDs
OS running from a USB stick

Node#2
MDS#2 - standby
MON#2
2 OSDs
OS running from a hard drive

Node#3
MDS#3 - standby
MON#3
2 OSDs
OS running from a hard drive

The USB stick of Node1 failed i.e. it became read-only probably due to
wear and tear from the OS.
We have some files stored in cephfs and several VMs in RBD.

Node#1 was powered down and brought back up.

We are now unable to access the cephfs and some RBD images are listed
(but unreadble

The cephfs error says MDS cluster is degraded, node1 is laggy or crashed.
As for the RBD images. Other are still accessible but while other have
the following error:
# rbd info -p one -i one-5
rbd: error opening image one-5: 2014-03-05 13:50:59.519163 7f5d22649780
-1 librbd::ImageCtx: error finding header: (2) No such file or
directory(2) No such file or directory
But when I issue rbd ls -p one, the image one-5 is showing.

How do we proceed to recover full cluster functionality?
--

Did the cluster recover? Are all pgs active+clean? I don't think so.

What does 'ceph -s' say?

Thanks
Thanks,

Kenneth



_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
Wido den Hollander
42on B.V.

Phone: +31 (0)20 700 9902
Skype: contact42on
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to