Hi Eugen, If I create another pool with caching, would it be possible to migrate data from the current pool to the new one while the system is live? What would be the best way to move the data in this scenario?
Additionally, I'm wondering if the `rbd migration` command is a viable option for this process. I'm currently running Ceph version 15.2.17. Thanks and regards, Vishnu Bhaskar Acceleron Labs Pvt Ltd Bangalore, India On Wed, Jul 16, 2025 at 3:31 PM Eugen Block <ebl...@nde.ag> wrote: > No, it's definitely not safe. If you remove the overlay without > flushing the dirty objects, you will face data loss. Unfortunately, > the cache tier hasn't been supported for a while and even when it was, > it was discouraged to use it. I'm afraid there's not much more I can > comment, maybe someone else on this list has other ideas than the ones > I already mentioned. But in the past there haven't been many responses > to questions regarding cache tier, so don't be surprised if you won't > get more responses. > > Zitat von Vishnu Bhaskar <vishn...@acceleronlabs.com>: > > > Hi > > Is it safe to remove the cache tier from the base pool using the > following > > commands > > ceph osd tier remove-overlay $BASE_POOL > > ceph osd tier remove $BASE_POOL $CACHE_POOL > > > > anyway we can cant use the same cache pool right. > > So is there any safe procedure to do. > > > > Thanks and Regards > > Vishnu Bhaskar > > Acceleron Labs Pvt Ltd > > Bangalore, India > > > > > > On Wed, Jul 16, 2025 at 2:23 PM Eugen Block <ebl...@nde.ag> wrote: > > > >> Hi (got a bounce, resending), > >> > >> > >> Zitat von Vishnu Bhaskar <vishn...@acceleronlabs.com>: > >> > >> > Hi Eugen, > >> > > >> > I wanted to provide an update regarding the volumes. I've confirmed > that > >> > none of my volumes are mapped to multiple machines, as the `rbd lock` > >> > command output shows only one locker entry per volume. > >> > >> it was just an example (from this list), I wasn't assuming that you > >> have multi-attach volumes in place. > >> > >> > However, I've noticed that the lock list output for both the cache > pool > >> and > >> > the base pool displays the same entry for all volumes, which indicates > >> that > >> > all volumes have a locker entry in both pools. > >> > > >> > Even though I removed the overlay from the cache pool, it seems that > >> > tiering is still present. > >> > >> It's hard to trust any of the information from the cache tier at this > >> point. As I wrote, the safest way would be probably to try and back up > >> the data by attaching an additional volume. > >> > >> > >> > *Rbd lock list output for volume with issue:* > >> > rbd lock ls hdd/volume-d1fde03e-8763-4491-a7e6-444b81372e1a > >> > There is 1 exclusive lock on this image. > >> > Locker ID Address > >> > client.1170597154 auto 140263699951616 10.10.11.253:0/215770161 > >> > > >> > rbd lock ls hdd_cache/volume-d1fde03e-8763-4491-a7e6-444b81372e1a > >> > There is 1 exclusive lock on this image. > >> > Locker ID Address > >> > client.1170597154 auto 140263699951616 10.10.11.253:0/215770161 > >> > > >> > *Rbd lock list output for volume without issue:* > >> > rbd lock ls hdd_cache/volume-cda53542-e5e1-4b8f-8a46-6d0e03fa4a75 > >> > There is 1 exclusive lock on this image. > >> > Locker ID Address > >> > client.1479027429 auto 140278262402928 10.10.11.251:0/2604117598 > >> > rbd lock ls hdd/volume-cda53542-e5e1-4b8f-8a46-6d0e03fa4a75 > >> > There is 1 exclusive lock on this image. > >> > Locker ID Address > >> > client.1479027429 auto 140278262402928 10.10.11.251:0/2604117598 > >> > > >> > Thanks and Regards > >> > Vishnu Bhaskar > >> > Acceleron Labs Pvt Ltd > >> > Bangalore, India > >> > > >> > > >> > On Wed, Jul 16, 2025 at 1:04 PM Vishnu Bhaskar < > >> vishn...@acceleronlabs.com> > >> > wrote: > >> > > >> >> +Prince V S <pri...@acceleronlabs.com> +Jerryn George > >> >> <jer...@acceleronlabs.com> +Felix K J <feli...@acceleronlabs.com> > >> +Bibin > >> >> Bose (Acceleron) <bi...@acceleronlabs.com> > >> >> > >> >> Thanks and Regards > >> >> Vishnu Bhaskar > >> >> Acceleron Labs Pvt Ltd > >> >> Bangalore, India > >> >> > >> >> > >> >> On Wed, Jul 16, 2025 at 1:00 PM Eugen Block <ebl...@nde.ag> wrote: > >> >> > >> >>> Just because you seem to be able to write from a client perspective > >> >>> doesn't mean that the data is actually written onto the OSD. For > >> >>> example, if you attach an RBD image to two VMs simultaneously, you > >> >>> seem to be able to write from both VMs, but in fact only one of them > >> >>> will actually write successfully. So the damage might already be > done, > >> >>> it's unclear which writes were really persistent. Depending on how > >> >>> many VMs are affected, you could try to and mount a new volume to > >> >>> them, then sync the entire filesystem to the new volume, just in > case > >> >>> something goes wrong after shut down. > >> >>> > >> >>> Zitat von Vishnu Bhaskar <vishn...@acceleronlabs.com>: > >> >>> > >> >>> > Hi Eugen, > >> >>> > > >> >>> > Thank you for your response. > >> >>> > > >> >>> > Currently, some of my VMs are running, and for safety, I was > >> planning to > >> >>> > take a snapshot of all volumes. However, I'm encountering an "rbd > >> >>> > read-only" error for some VM volumes, preventing me from taking > their > >> >>> > snapshots. Interestingly, for these same VMs, I am still able to > read > >> >>> and > >> >>> > write files from both the OpenStack console and via RDP. > >> >>> > > >> >>> > I'm concerned about whether rebooting these VMs to attempt a > snapshot > >> >>> would > >> >>> > cause any issues or data loss. > >> >>> > > >> >>> > Thanks and Regards > >> >>> > Vishnu Bhaskar > >> >>> > Acceleron Labs Pvt Ltd > >> >>> > Bangalore, India > >> >>> > > >> >>> > > >> >>> > On Tue, Jul 15, 2025 at 3:34 PM Eugen Block <ebl...@nde.ag> > wrote: > >> >>> > > >> >>> >> Hi, > >> >>> >> > >> >>> >> we've been there a couple of months ago. > >> >>> >> > >> >>> >> Since my attempts of flushing the cache objects didn't complete, > I > >> >>> >> experimented a bit. I gradually decreased the target bytes of the > >> >>> >> cache which then caused automatic flushing of most of the > remaining > >> >>> >> data objects. But all the header objects were still in the cache > >> (and > >> >>> >> the number of object_map objects increased). So at that point we > >> shut > >> >>> >> down all VMs to safely remove the cache tier. > >> >>> >> > >> >>> >> By simply removing the cache without a proper flush, you're > risking > >> >>> >> permanent data loss. > >> >>> >> > >> >>> >> Regards, > >> >>> >> Eugen > >> >>> >> > >> >>> >> Zitat von Vishnu Bhaskar <vishn...@acceleronlabs.com>: > >> >>> >> > >> >>> >> > Hi, > >> >>> >> > I was attempting to increase the cache pool's PG value. When I > >> used > >> >>> the > >> >>> >> > command `ceph osd pool set volumes_cache 64`, I encountered the > >> error > >> >>> >> > "Error EPERM: splits in cache pools must be followed by scrubs > and > >> >>> leave > >> >>> >> > sufficient free space to avoid overfilling. use > >> >>> --yes-i-really-mean-it to > >> >>> >> > force." > >> >>> >> > > >> >>> >> > To address this, I decided to remove the cache from the volumes > >> pool > >> >>> and > >> >>> >> > followed these steps: > >> >>> >> > > >> >>> >> > 1. Set the cache mode to `readproxy`: > >> >>> >> > `ceph osd tier cache-mode volumes_cache readproxy` > >> >>> >> > > >> >>> >> > 2. Started flushing dirty objects: > >> >>> >> > `rados -p volumes_cache cache-flush-evict-all` > >> >>> >> > I stopped this flush prematurely due to the large number of > dirty > >> >>> >> objects. > >> >>> >> > > >> >>> >> > 3. Removed the overlay from the base pool: > >> >>> >> > `ceph osd tier remove-overlay volumes` > >> >>> >> > > >> >>> >> > 4. Resumed flushing the remaining objects in the cache pool: > >> >>> >> > `rados -p volumes_cache cache-flush-evict-all` > >> >>> >> > > >> >>> >> > Error occurred while flushing: > >> >>> >> > > >> >>> >> > rbd_data.f2804088f4e54a.000000000001cb71 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001cb71: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b4 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b4: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000027 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000027: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000061 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000061: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004dd > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004dd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ebd6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ebd6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000000e7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000000e7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000436c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000436c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eace > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eace: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000003e7d > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000003e7d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb6a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000663 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000663: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000326 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000326: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000031d > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000031d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000edd > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000edd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ef09 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ef09: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eef1 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eef1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000983 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000983: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001c05c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001c05c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec9f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec9f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000002 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000002: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000014726 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000014726: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000031e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000031e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000007f4 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000007f4: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001a7c5 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001a7c5: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000658 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000658: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000007f38 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000007f38: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000081e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000081e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000495 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000495: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000000 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000000: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000002159 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000002159: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000fdb1 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000fdb1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000101 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000101: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000e6f4 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000e6f4: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000fa6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000bf6c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000bf6c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000093cc > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000093cc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000021a0 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000021a0: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb6c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000125d6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000125d6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000153 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000153: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001627a > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001627a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000024 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000024: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000825 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000825: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000021dc > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000021dc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000000c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000000c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000009454 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000009454: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000314 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000314: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000f98 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f98: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000002fe > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000002fe: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000002f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000002f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000030 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000030: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000c3d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000c3d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000049 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000049: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ecdc > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecdc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000032d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000032d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000666 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000666: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000031 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000031: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000053 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000053: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000326 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000326: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000100 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000100: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001b3dd > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001b3dd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000011395 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000011395: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000002fd > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000002fd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b2 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000300 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000300: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000002ff > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000002ff: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001ed9e > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001ed9e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000878 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000878: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000316 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000316: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b3 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b3: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000308 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000308: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb70 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb70: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000086d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000086d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000013b1f > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000013b1f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000325 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000325: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb2f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb2f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001b413 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001b413: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000079b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000079b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000309 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000309: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001edc6 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001edc6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000104bd > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000104bd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb2a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb2a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec77 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec77: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000001a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000001a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e5d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e5d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e56 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e56: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000000a7 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000000a7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000d3e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d3e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000f5cb > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000f5cb: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eda7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eda7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000317 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000317: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb14 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb14: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000010c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000010c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000331 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000331: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000659 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000659: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000070 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000070: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000303 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000303: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000063 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000063: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000306 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000306: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ecdb > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecdb: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb34 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb34: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000063c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000063c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000876 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000876: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000009453 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000009453: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008ad > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008ad: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000672 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000672: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede8 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede8: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000f5f8 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000f5f8: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001efde > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001efde: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000edc > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000edc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000bf45 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000bf45: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000002fc > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000002fc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec9d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec9d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec17 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec17: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000000b1 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000000b1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000f21d > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000f21d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004bc > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004bc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000030a > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000030a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ee03 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ee03: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000006110 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000006110: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000074d3 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000074d3: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000618f > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000618f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000013aef > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000013aef: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000318 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000318: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000009db > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000009db: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000ede > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000ede: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000030b > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000030b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000011369 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000011369: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000018044 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000018044: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000330 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000330: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000110 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000110: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000492 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000492: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000307 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000307: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb6b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000018c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000018c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb30 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb30: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ebd7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ebd7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eca3 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eca3: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004e8 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004e8: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004c5 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004c5: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e5a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e5a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000315 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000315: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004d9 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004d9: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000052c0 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000052c0: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004c2 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004c2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000a29 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000a29: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000494 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000494: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000013afe > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000013afe: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001a50e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001a50e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb31 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb31: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000009799 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000009799: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000003043 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000003043: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001eea2 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001eea2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec35 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec35: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000031e > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000031e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000d24 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d24: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001bb7c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001bb7c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000006c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000006c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede0 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede0: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede5 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede5: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede3 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede3: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000002e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000002e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e3c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e3c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000f108 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000f108: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001a7a1 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001a7a1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b0 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b0: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004b6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004b6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000005a9 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000005a9: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000032 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000032: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b6 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000013b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000013b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000f90 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f90: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000320 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000320: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004bb > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004bb: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000813 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000813: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004b0 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004b0: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000783 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000783: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb33 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb33: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000009d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000009d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000154 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000154: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000001e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000001e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000002f6 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000002f6: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000fa1 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001e7df > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001e7df: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000006 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000006: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb29 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb29: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000006b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000006b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000005cd > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000005cd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000319 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000319: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000302b > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000302b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede2 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e0a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e0a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000005cf > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000005cf: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000320 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000320: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e58 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e58: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001049a > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001049a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eca7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eca7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000e22f > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000e22f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001801b > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001801b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000812 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000812: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000031a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000031a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000072 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000072: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000008 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000008: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001e80b > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001e80b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000055 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000055: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000001aa > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000001aa: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000e202 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000e202: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000302 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000302: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede4 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede4: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000007f74 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000007f74: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000152 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000152: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000019 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000019: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008af > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008af: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000004dc > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000004dc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000030c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000030c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001a4f2 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001a4f2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000086f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000086f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000305 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000305: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000301 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000301: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000028 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000028: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ede9 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ede9: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000032c > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000032c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ec4b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ec4b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000006f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000006f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000033 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000033: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e59 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e59: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000001228 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000001228: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000352 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000352: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008bd > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008bd: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000009433 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000009433: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.00000000000008b5 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.00000000000008b5: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000e6f1 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000e6f1: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000782 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000782: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ed02 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ed02: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001eb6e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001eb6e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000003efa > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000003efa: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000001315 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000001315: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ed8a > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ed8a: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000022 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000022: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000009308 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000009308: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000fa2 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa2: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000031c > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000031c: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000f238 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000f238: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000313 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000313: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000d4f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000d4f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000002abc > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000002abc: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000f75 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000f75: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.00000000000000a8 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.00000000000000a8: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000000e721 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000000e721: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000085e > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000085e: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001e10d > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001e10d: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000103 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000103: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ecbb > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ecbb: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000073 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000073: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.000000000001ef05 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.000000000001ef05: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000007552 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000007552: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.5f35353775dd58.0000000000000304 > >> >>> >> > failed to flush /rbd_data.5f35353775dd58.0000000000000304: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000000031f > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000000031f: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000e0b > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000e0b: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.0000000000000fa7 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.0000000000000fa7: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > rbd_data.f2804088f4e54a.000000000001ef32 > >> >>> >> > failed to flush /rbd_data.f2804088f4e54a.000000000001ef32: (2) > No > >> >>> such > >> >>> >> > file or directory > >> >>> >> > cache-flush-evict-all finished with errors > >> >>> >> > > >> >>> >> > > >> >>> >> > Is there any way we can resolve this issue? > >> >>> >> > > >> >>> >> > Thanks and Regards > >> >>> >> > Vishnu Bhaskar > >> >>> >> > Acceleron Labs Pvt Ltd > >> >>> >> > Bangalore, India > >> >>> >> > _______________________________________________ > >> >>> >> > ceph-users mailing list -- ceph-users@ceph.io > >> >>> >> > To unsubscribe send an email to ceph-users-le...@ceph.io > >> >>> >> > >> >>> >> > >> >>> >> > >> >>> >> _______________________________________________ > >> >>> >> ceph-users mailing list -- ceph-users@ceph.io > >> >>> >> To unsubscribe send an email to ceph-users-le...@ceph.io > >> >>> >> > >> >>> > >> >>> > >> >>> > >> >>> > >> >>> > >> > >> > >> _______________________________________________ > >> ceph-users mailing list -- ceph-users@ceph.io > >> To unsubscribe send an email to ceph-users-le...@ceph.io > >> > > > _______________________________________________ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
