Re: [ceph-users] pgs incomplete and inactive

2018-08-27 Thread Josef Zelenka
The fullratio was ignored, that's why that happenned most likely. I can't delete pgs, because it's only kb's worth of space - the osd is 40gb, 39.8 gb is taken up by omap - that's why i can't move/extract. Any clue on how to compress/move away the omap dir? On 27/08/18 12:34, Paul Emmerich w

Re: [ceph-users] pgs incomplete and inactive

2018-08-27 Thread Paul Emmerich
Don't ever let an OSD run 100% full, that's usually bad news. Two ways to salvage this: 1. You can try to extract the PGs with ceph-objectstore-tool and inject them into another OSD; Ceph will find them and recover 2. You seem to be using Filestore, so you should easily be able to just delete a wh

[ceph-users] pgs incomplete and inactive

2018-08-27 Thread Josef Zelenka
Hi, i've had a very ugly thing happen to me over the weekend. Some of my  OSDs in a root that handles metadata pools overflowed to 100% disk usage due to omap size(even though i had 97% full ratio, which is odd) and refused to start. There were some pgs on those OSDs that went away with them. I