Re: [ceph-users] Ceph can't seem to forget

2014-08-07 Thread Craig Lewis
For your RDB volumes, you've lost random 4MiB chunks from your virtual disks. Think of it as unrecoverable bad sectors on the HDD. It was only a few unfound objects though (ceph status said 23 out of 5128982). You can probably recovery from that. I'd fsck all of the volumes, and perform any app

Re: [ceph-users] Ceph can't seem to forget

2014-08-07 Thread Craig Lewis
Have you re-formatted and re-added all of the lost OSDs? I've found that if you lose an OSD, you can tell Ceph the data is gone (ceph osd lost ), but it won't believe you until it can talk to that OSDID again. If you have OSDs that are offline, you can verify that Ceph is waiting on them with cep

[ceph-users] Ceph can't seem to forget

2014-08-07 Thread Sean Sullivan
I think I have a split issue or I can't seem to get rid of these objects. How can I tell ceph to forget the objects and revert? How this happened is that due to the python 2.7.8/ceph bug ( a whole rack of ceph went town (it had ubuntu 14.10 and that seemed to have 2.7.8 before 14.04). I didn't kno

[ceph-users] Ceph can't seem to forget.

2014-08-06 Thread Sean Sullivan
I forgot to register before posting so reposting. I think I have a split issue or I can't seem to get rid of these objects. How can I tell ceph to forget the objects and revert? How this happened is that due to the python 2.7.8/ceph bug ( a whole rack of ceph went town (it had ubuntu 14.10 and th