Re: [ceph-users] Question about unfound objects

2017-03-30 Thread Nick Fisk
roll >back??? From: Steve Taylor [mailto:steve.tay...@storagecraft.com] Sent: 30 March 2017 20:07 To: n...@fisk.me.uk; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Question about unfound objects One other thing to note with this experience is that we do a LOT of RBD snap trimming, l

Re: [ceph-users] Question about unfound objects

2017-03-30 Thread Steve Taylor
One other thing to note with this experience is that we do a LOT of RBD snap trimming, like hundreds of millions of objects per day added to our snap_trimqs globally. All of the unfound objects in these cases were found on other OSDs in the cluster with identical contents, but associated with di

Re: [ceph-users] Question about unfound objects

2017-03-30 Thread Steve Taylor
Good suggestion, Nick. I actually did that at the time. The "ceph osd map" wasn't all that interesting because the OSDs had been outed and their PGs had been mapped to new OSDs. Everything appeared to be in order with the PGs being mapped to the right number of new OSDs. The PG mappings looked f

Re: [ceph-users] Question about unfound objects

2017-03-30 Thread Nick Fisk
Hi Steve, If you can recreate or if you can remember the object name, it might be worth trying to run "ceph osd map" on the objects and see where it thinks they map to. And/or maybe pg query might show something? Nick From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behal