Hi Gerard,
You have very few PGs for very large disks. 50PGs account for 11TB of space.
Also full, nearfull and backfillfull is the same value. You want to set them
different.
ceph osd set-nearfull-ratio .85
ceph osd set-backfillfull-ratio .90
ceph osd set-full-ratio .95
I could imagine a lot
Just to add a bit of additional information:
- I have tried failing the active MGR but that appeared to make no difference.
- I found restarting the primary OSD on a PG that is reporting backfill_toofull
clears to toofull status.
It could just be coincidence but since I've started clearing the