Hello Greg, if i remove the files manually from the primary - it does not help either. The primary osd is than crashing that trim_object can't find the files.
Is there any chance that i manually correct the omap digest so that it just matches the files? Greets, Stefan Am 05.08.2017 um 21:43 schrieb Gregory Farnum: > is OSD 20 actually a member of the pg right now? It could be stray data > that is slowly getting cleaned up. > > Also, you've got "snapdir" listings there. Those indicate the object is > snapshotted but the "head" got deleted. So it may just be delayed > cleanup of snapshots. > > On Sat, Aug 5, 2017 at 12:34 PM Stefan Priebe - Profihost AG > <s.pri...@profihost.ag <mailto:s.pri...@profihost.ag>> wrote: > > Hello, > > today i deleted an rbd image which had the following > prefix: > > block_name_prefix: rbd_data.106dd406b8b4567 > > the rm command went fine. > > also the rados list command does not show any objects with that string: > # rados -p rbd ls | grep 106dd406b8b4567 > > But find on an osd still has them? > > osd.20]# find . -name "*106dd406b8b4567*" -exec ls -la "{}" \; > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:32 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__9d5e4_9E65861A__3 > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:36 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__9d84a_9E65861A__3 > -rw-r--r-- 1 ceph ceph 0 Aug 5 11:47 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__snapdir_9E65861A__3 > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:49 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d455_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 1400832 Aug 5 09:32 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d5e4_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 1400832 Aug 5 09:32 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d84a_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 0 Aug 5 11:47 > > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__snapdir_BCB2A61A__3 > > Greets, > Stefan > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com