Hi Eugen,

Thank you for your response.

Currently, some of my VMs are running, and for safety, I was planning to
take a snapshot of all volumes. However, I'm encountering an "rbd
read-only" error for some VM volumes, preventing me from taking their
snapshots. Interestingly, for these same VMs, I am still able to read and
write files from both the OpenStack console and via RDP.

I'm concerned about whether rebooting these VMs to attempt a snapshot would
cause any issues or data loss.

Thanks and Regards
Vishnu Bhaskar
Acceleron Labs Pvt Ltd
Bangalore, India


On Tue, Jul 15, 2025 at 3:34 PM Eugen Block <ebl...@nde.ag> wrote:

> Hi,
>
> we've been there a couple of months ago.
>
> Since my attempts of flushing the cache objects didn't complete, I
> experimented a bit. I gradually decreased the target bytes of the
> cache which then caused automatic flushing of most of the remaining
> data objects. But all the header objects were still in the cache (and
> the number of object_map objects increased). So at that point we shut
> down all VMs to safely remove the cache tier.
>
> By simply removing the cache without a proper flush, you're risking
> permanent data loss.
>
> Regards,
> Eugen
>
> Zitat von Vishnu Bhaskar <vishn...@acceleronlabs.com>:
>
> > Hi,
> > I was attempting to increase the cache pool's PG value. When I used the
> > command `ceph osd pool set volumes_cache 64`, I encountered the error
> > "Error EPERM: splits in cache pools must be followed by scrubs and leave
> > sufficient free space to avoid overfilling. use --yes-i-really-mean-it to
> > force."
> >
> > To address this, I decided to remove the cache from the volumes pool and
> > followed these steps:
> >
> > 1. Set the cache mode to `readproxy`:
> > `ceph osd tier cache-mode volumes_cache readproxy`
> >
> > 2. Started flushing dirty objects:
> > `rados -p volumes_cache cache-flush-evict-all`
> > I stopped this flush prematurely due to the large number of dirty
> objects.
> >
> > 3. Removed the overlay from the base pool:
> > `ceph osd tier remove-overlay volumes`
> >
> > 4. Resumed flushing the remaining objects in the cache pool:
> > `rados -p volumes_cache cache-flush-evict-all`
> >
> > Error occurred while flushing:
> >
> >       rbd_data.f2804088f4e54a.000000000001cb71
> > failed to flush /rbd_data.f2804088f4e54a.000000000001cb71: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b4
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b4: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000027
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000027: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000061
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000061: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede6
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004dd
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004dd: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ebd6
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ebd6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000000e7
> > failed to flush /rbd_data.f2804088f4e54a.00000000000000e7: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000436c
> > failed to flush /rbd_data.5f35353775dd58.000000000000436c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eace
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eace: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000003e7d
> > failed to flush /rbd_data.5f35353775dd58.0000000000003e7d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb6a
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000663
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000663: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000326
> > failed to flush /rbd_data.5f35353775dd58.0000000000000326: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000031d
> > failed to flush /rbd_data.5f35353775dd58.000000000000031d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000edd
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000edd: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ef09
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ef09: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eef1
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eef1: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000983
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000983: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001c05c
> > failed to flush /rbd_data.5f35353775dd58.000000000001c05c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec9f
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec9f: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000002
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000002: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000014726
> > failed to flush /rbd_data.f2804088f4e54a.0000000000014726: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000031e
> > failed to flush /rbd_data.f2804088f4e54a.000000000000031e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000007f4
> > failed to flush /rbd_data.f2804088f4e54a.00000000000007f4: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001a7c5
> > failed to flush /rbd_data.5f35353775dd58.000000000001a7c5: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000658
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000658: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000007f38
> > failed to flush /rbd_data.5f35353775dd58.0000000000007f38: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000081e
> > failed to flush /rbd_data.f2804088f4e54a.000000000000081e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000495
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000495: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000000
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000000: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000002159
> > failed to flush /rbd_data.5f35353775dd58.0000000000002159: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000fdb1
> > failed to flush /rbd_data.5f35353775dd58.000000000000fdb1: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000101
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000101: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000e6f4
> > failed to flush /rbd_data.5f35353775dd58.000000000000e6f4: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000fa6
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa6: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000bf6c
> > failed to flush /rbd_data.5f35353775dd58.000000000000bf6c: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000093cc
> > failed to flush /rbd_data.5f35353775dd58.00000000000093cc: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000021a0
> > failed to flush /rbd_data.5f35353775dd58.00000000000021a0: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb6c
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000125d6
> > failed to flush /rbd_data.f2804088f4e54a.00000000000125d6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000153
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000153: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001627a
> > failed to flush /rbd_data.5f35353775dd58.000000000001627a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000024
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000024: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000825
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000825: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000021dc
> > failed to flush /rbd_data.5f35353775dd58.00000000000021dc: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000000c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000000c: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000009454
> > failed to flush /rbd_data.5f35353775dd58.0000000000009454: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000314
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000314: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000f98
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f98: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000002fe
> > failed to flush /rbd_data.5f35353775dd58.00000000000002fe: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000002f
> > failed to flush /rbd_data.f2804088f4e54a.000000000000002f: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000030
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000030: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000c3d
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000c3d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000049
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000049: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ecdc
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecdc: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000032d
> > failed to flush /rbd_data.f2804088f4e54a.000000000000032d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000666
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000666: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000031
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000031: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000053
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000053: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000326
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000326: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000100
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000100: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001b3dd
> > failed to flush /rbd_data.f2804088f4e54a.000000000001b3dd: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000011395
> > failed to flush /rbd_data.5f35353775dd58.0000000000011395: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000002fd
> > failed to flush /rbd_data.5f35353775dd58.00000000000002fd: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b2
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b2: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000300
> > failed to flush /rbd_data.5f35353775dd58.0000000000000300: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000002ff
> > failed to flush /rbd_data.5f35353775dd58.00000000000002ff: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001ed9e
> > failed to flush /rbd_data.5f35353775dd58.000000000001ed9e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000878
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000878: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000316
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000316: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b3
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b3: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000308
> > failed to flush /rbd_data.5f35353775dd58.0000000000000308: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb70
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb70: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000086d
> > failed to flush /rbd_data.f2804088f4e54a.000000000000086d: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000013b1f
> > failed to flush /rbd_data.5f35353775dd58.0000000000013b1f: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000325
> > failed to flush /rbd_data.5f35353775dd58.0000000000000325: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb2f
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb2f: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001b413
> > failed to flush /rbd_data.f2804088f4e54a.000000000001b413: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000079b
> > failed to flush /rbd_data.f2804088f4e54a.000000000000079b: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000309
> > failed to flush /rbd_data.5f35353775dd58.0000000000000309: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001edc6
> > failed to flush /rbd_data.5f35353775dd58.000000000001edc6: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000104bd
> > failed to flush /rbd_data.5f35353775dd58.00000000000104bd: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb2a
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb2a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec77
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec77: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000001a
> > failed to flush /rbd_data.f2804088f4e54a.000000000000001a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e5d
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e5d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e56
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e56: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000000a7
> > failed to flush /rbd_data.5f35353775dd58.00000000000000a7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000d3e
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d3e: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000f5cb
> > failed to flush /rbd_data.5f35353775dd58.000000000000f5cb: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eda7
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eda7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000317
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000317: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb14
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb14: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000010c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000010c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000331
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000331: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000659
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000659: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000070
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000070: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000303
> > failed to flush /rbd_data.5f35353775dd58.0000000000000303: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000063
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000063: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000306
> > failed to flush /rbd_data.5f35353775dd58.0000000000000306: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ecdb
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecdb: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb34
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb34: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000063c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000063c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000876
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000876: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000009453
> > failed to flush /rbd_data.5f35353775dd58.0000000000009453: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008ad
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008ad: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000672
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000672: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede8
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede8: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000f5f8
> > failed to flush /rbd_data.5f35353775dd58.000000000000f5f8: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001efde
> > failed to flush /rbd_data.f2804088f4e54a.000000000001efde: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000edc
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000edc: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000bf45
> > failed to flush /rbd_data.5f35353775dd58.000000000000bf45: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000002fc
> > failed to flush /rbd_data.5f35353775dd58.00000000000002fc: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec9d
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec9d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec17
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec17: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000000b1
> > failed to flush /rbd_data.f2804088f4e54a.00000000000000b1: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000f21d
> > failed to flush /rbd_data.5f35353775dd58.000000000000f21d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004bc
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004bc: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000030a
> > failed to flush /rbd_data.5f35353775dd58.000000000000030a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ee03
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ee03: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000006110
> > failed to flush /rbd_data.5f35353775dd58.0000000000006110: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000074d3
> > failed to flush /rbd_data.5f35353775dd58.00000000000074d3: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000618f
> > failed to flush /rbd_data.5f35353775dd58.000000000000618f: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000013aef
> > failed to flush /rbd_data.5f35353775dd58.0000000000013aef: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000318
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000318: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000009db
> > failed to flush /rbd_data.f2804088f4e54a.00000000000009db: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000ede
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000ede: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000030b
> > failed to flush /rbd_data.5f35353775dd58.000000000000030b: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000011369
> > failed to flush /rbd_data.5f35353775dd58.0000000000011369: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000018044
> > failed to flush /rbd_data.5f35353775dd58.0000000000018044: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000330
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000330: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000110
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000110: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000492
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000492: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000307
> > failed to flush /rbd_data.5f35353775dd58.0000000000000307: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb6b
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000018c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000018c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb30
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb30: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ebd7
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ebd7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eca3
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eca3: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004e8
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004e8: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004c5
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004c5: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e5a
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e5a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000315
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000315: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004d9
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004d9: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000052c0
> > failed to flush /rbd_data.5f35353775dd58.00000000000052c0: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede7
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004c2
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004c2: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000a29
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000a29: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000494
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000494: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000013afe
> > failed to flush /rbd_data.5f35353775dd58.0000000000013afe: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001a50e
> > failed to flush /rbd_data.f2804088f4e54a.000000000001a50e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb31
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb31: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000009799
> > failed to flush /rbd_data.5f35353775dd58.0000000000009799: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000003043
> > failed to flush /rbd_data.5f35353775dd58.0000000000003043: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001eea2
> > failed to flush /rbd_data.5f35353775dd58.000000000001eea2: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b7
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec35
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec35: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000031e
> > failed to flush /rbd_data.5f35353775dd58.000000000000031e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000d24
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d24: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001bb7c
> > failed to flush /rbd_data.5f35353775dd58.000000000001bb7c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000006c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000006c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede0
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede0: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede5
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede5: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede3
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede3: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000002e
> > failed to flush /rbd_data.f2804088f4e54a.000000000000002e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e3c
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e3c: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000f108
> > failed to flush /rbd_data.5f35353775dd58.000000000000f108: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001a7a1
> > failed to flush /rbd_data.5f35353775dd58.000000000001a7a1: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b0
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b0: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004b6
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004b6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000005a9
> > failed to flush /rbd_data.f2804088f4e54a.00000000000005a9: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000032
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000032: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b6
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000013b
> > failed to flush /rbd_data.f2804088f4e54a.000000000000013b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000f90
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f90: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000320
> > failed to flush /rbd_data.5f35353775dd58.0000000000000320: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004bb
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004bb: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000813
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000813: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004b0
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004b0: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000783
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000783: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb33
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb33: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000009d
> > failed to flush /rbd_data.f2804088f4e54a.000000000000009d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000154
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000154: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000001e
> > failed to flush /rbd_data.f2804088f4e54a.000000000000001e: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000002f6
> > failed to flush /rbd_data.5f35353775dd58.00000000000002f6: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000fa1
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa1: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001e7df
> > failed to flush /rbd_data.5f35353775dd58.000000000001e7df: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000006
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000006: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb29
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb29: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000006b
> > failed to flush /rbd_data.f2804088f4e54a.000000000000006b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000005cd
> > failed to flush /rbd_data.f2804088f4e54a.00000000000005cd: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000319
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000319: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000302b
> > failed to flush /rbd_data.5f35353775dd58.000000000000302b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede2
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede2: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e0a
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e0a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000005cf
> > failed to flush /rbd_data.f2804088f4e54a.00000000000005cf: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000320
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000320: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e58
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e58: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001049a
> > failed to flush /rbd_data.5f35353775dd58.000000000001049a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eca7
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eca7: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000e22f
> > failed to flush /rbd_data.5f35353775dd58.000000000000e22f: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001801b
> > failed to flush /rbd_data.5f35353775dd58.000000000001801b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000812
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000812: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000031a
> > failed to flush /rbd_data.f2804088f4e54a.000000000000031a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000072
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000072: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000008
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000008: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001e80b
> > failed to flush /rbd_data.5f35353775dd58.000000000001e80b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000055
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000055: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000001aa
> > failed to flush /rbd_data.5f35353775dd58.00000000000001aa: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000e202
> > failed to flush /rbd_data.5f35353775dd58.000000000000e202: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000302
> > failed to flush /rbd_data.5f35353775dd58.0000000000000302: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede4
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede4: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000007f74
> > failed to flush /rbd_data.5f35353775dd58.0000000000007f74: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000152
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000152: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000019
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000019: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008af
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008af: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000004dc
> > failed to flush /rbd_data.f2804088f4e54a.00000000000004dc: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000030c
> > failed to flush /rbd_data.5f35353775dd58.000000000000030c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001a4f2
> > failed to flush /rbd_data.f2804088f4e54a.000000000001a4f2: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000086f
> > failed to flush /rbd_data.f2804088f4e54a.000000000000086f: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000305
> > failed to flush /rbd_data.5f35353775dd58.0000000000000305: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000301
> > failed to flush /rbd_data.5f35353775dd58.0000000000000301: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000028
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000028: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ede9
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede9: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000032c
> > failed to flush /rbd_data.f2804088f4e54a.000000000000032c: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ec4b
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec4b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000006f
> > failed to flush /rbd_data.f2804088f4e54a.000000000000006f: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000033
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000033: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e59
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e59: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000001228
> > failed to flush /rbd_data.f2804088f4e54a.0000000000001228: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000352
> > failed to flush /rbd_data.5f35353775dd58.0000000000000352: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008bd
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008bd: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000009433
> > failed to flush /rbd_data.5f35353775dd58.0000000000009433: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.00000000000008b5
> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b5: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000e6f1
> > failed to flush /rbd_data.5f35353775dd58.000000000000e6f1: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000782
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000782: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ed02
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ed02: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001eb6e
> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6e: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000003efa
> > failed to flush /rbd_data.5f35353775dd58.0000000000003efa: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000001315
> > failed to flush /rbd_data.f2804088f4e54a.0000000000001315: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ed8a
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ed8a: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000022
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000022: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000009308
> > failed to flush /rbd_data.5f35353775dd58.0000000000009308: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000fa2
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa2: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000031c
> > failed to flush /rbd_data.5f35353775dd58.000000000000031c: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000f238
> > failed to flush /rbd_data.5f35353775dd58.000000000000f238: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000313
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000313: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000d4f
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d4f: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000002abc
> > failed to flush /rbd_data.5f35353775dd58.0000000000002abc: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000f75
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f75: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.00000000000000a8
> > failed to flush /rbd_data.5f35353775dd58.00000000000000a8: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000000e721
> > failed to flush /rbd_data.5f35353775dd58.000000000000e721: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000085e
> > failed to flush /rbd_data.f2804088f4e54a.000000000000085e: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001e10d
> > failed to flush /rbd_data.f2804088f4e54a.000000000001e10d: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000103
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000103: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ecbb
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecbb: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000073
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000073: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.000000000001ef05
> > failed to flush /rbd_data.5f35353775dd58.000000000001ef05: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000007552
> > failed to flush /rbd_data.5f35353775dd58.0000000000007552: (2) No such
> > file or directory
> >       rbd_data.5f35353775dd58.0000000000000304
> > failed to flush /rbd_data.5f35353775dd58.0000000000000304: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000000031f
> > failed to flush /rbd_data.f2804088f4e54a.000000000000031f: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000e0b
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e0b: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.0000000000000fa7
> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa7: (2) No such
> > file or directory
> >       rbd_data.f2804088f4e54a.000000000001ef32
> > failed to flush /rbd_data.f2804088f4e54a.000000000001ef32: (2) No such
> > file or directory
> > cache-flush-evict-all finished with errors
> >
> >
> > Is there any way we can resolve this issue?
> >
> > Thanks and Regards
> > Vishnu Bhaskar
> > Acceleron Labs Pvt Ltd
> > Bangalore, India
> > _______________________________________________
> > ceph-users mailing list -- ceph-users@ceph.io
> > To unsubscribe send an email to ceph-users-le...@ceph.io
>
>
>
> _______________________________________________
> ceph-users mailing list -- ceph-users@ceph.io
> To unsubscribe send an email to ceph-users-le...@ceph.io
>
_______________________________________________
ceph-users mailing list -- ceph-users@ceph.io
To unsubscribe send an email to ceph-users-le...@ceph.io

Reply via email to