Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-31 Thread Brett Chancellor
I was able to answer my own question. For future interested parties, I initiated a deep scrub on the placement group, which cleared the error. On Tue, Jul 30, 2019 at 1:48 PM Brett Chancellor wrote: > I was able to remove the meta objects, but the cluster is still in WARN > state > HEALTH_WARN 1

Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-30 Thread Brett Chancellor
I was able to remove the meta objects, but the cluster is still in WARN state HEALTH_WARN 1 large omap objects LARGE_OMAP_OBJECTS 1 large omap objects 1 large objects found in pool 'us-prd-1.rgw.log' Search the cluster log for 'Large omap object found' for more details. How do I go about c

Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-25 Thread Brett Chancellor
14.2.1 Thanks, I'll try that. On Thu, Jul 25, 2019 at 2:54 PM Casey Bodley wrote: > What ceph version is this cluster running? Luminous or later should not > be writing any new meta.log entries when it detects a single-zone > configuration. > > I'd recommend editing your zonegroup configuration

Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-25 Thread Casey Bodley
What ceph version is this cluster running? Luminous or later should not be writing any new meta.log entries when it detects a single-zone configuration. I'd recommend editing your zonegroup configuration (via 'radosgw-admin zonegroup get' and 'put') to set both log_meta and log_data to false,

Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-25 Thread Brett Chancellor
Casey, These clusters were setup with the intention of one day doing multi site replication. That has never happened. The cluster has a single realm, which contains a single zonegroup, and that zonegroup contains a single zone. -Brett On Thu, Jul 25, 2019 at 2:16 PM Casey Bodley wrote: > Hi B

Re: [ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-25 Thread Casey Bodley
Hi Brett, These meta.log objects store the replication logs for metadata sync in multisite. Log entries are trimmed automatically once all other zones have processed them. Can you verify that all zones in the multisite configuration are reachable and syncing? Does 'radosgw-admin sync status'

[ceph-users] Large OMAP Objects in zone.rgw.log pool

2019-07-25 Thread Brett Chancellor
I'm having an issue similar to http://lists.ceph.com/pipermail/ceph-users-ceph.com/2019-March/033611.html . I don't see where any solution was proposed. $ ceph health detail HEALTH_WARN 1 large omap objects LARGE_OMAP_OBJECTS 1 large omap objects 1 large objects found in pool 'us-prd-1.rgw.log