Re: [ceph-users] Negative amount of objects degraded

2014-10-31 Thread Luis Periquito
I've had the same issue before during a cluster rebalancing and after restarting one of the daemons (can't remember now if it was one of the OSDs or MONs) the values reset to a more sane value and the cluster eventually recovered when it reached 0 objects degraded. Additionally when you have a big

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread Mike Dawson
Erik, I reported a similar issue 22 months ago. I don't think any developer has ever really prioritized these issues. http://tracker.ceph.com/issues/3720 I was able to recover that cluster. The method I used is in the comments. I have no idea if my cluster was broken for the same reason as

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread Erik Logtenberg
Thanks for pointing that out. Unfortunately, those tickets contain only a description of the problem, but no solution or workaround. One was opened 8 months ago and the other more than a year ago. No love since. Is there any way I can get my cluster back in a healthy state? Thanks, Erik. On 10

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread John Spray
There are a couple of open tickets about bogus (negative) stats on PGs: http://tracker.ceph.com/issues/5884 http://tracker.ceph.com/issues/7737 Cheers, John On Thu, Oct 30, 2014 at 12:38 PM, Erik Logtenberg wrote: > Hi, > > Yesterday I removed two OSD's, to replace them with new disks. Ceph was

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread Erik Logtenberg
>> Yesterday I removed two OSD's, to replace them with new disks. Ceph was >> not able to completely reach all active+clean state, but some degraded >> objects remain. However, the amount of degraded objects is negative >> (-82), see below: >> > > So why didn't it reach that state? Well, I dunno,

Re: [ceph-users] Negative amount of objects degraded

2014-10-30 Thread Wido den Hollander
On 10/30/2014 01:38 PM, Erik Logtenberg wrote: > Hi, > > Yesterday I removed two OSD's, to replace them with new disks. Ceph was > not able to completely reach all active+clean state, but some degraded > objects remain. However, the amount of degraded objects is negative > (-82), see below: > So

[ceph-users] Negative amount of objects degraded

2014-10-30 Thread Erik Logtenberg
Hi, Yesterday I removed two OSD's, to replace them with new disks. Ceph was not able to completely reach all active+clean state, but some degraded objects remain. However, the amount of degraded objects is negative (-82), see below: 2014-10-30 13:31:32.862083 mon.0 [INF] pgmap v209175: 768 pgs: 7