On Fri, May 29, 2015 at 5:47 PM, Samuel Just <sj...@redhat.com> wrote: > Many people have reported that they need to lower the osd recovery config > options to minimize the impact of recovery on client io. We are talking > about changing the defaults as follows: > > osd_max_backfills to 1 (from 10) > osd_recovery_max_active to 3 (from 15) > osd_recovery_op_priority to 1 (from 10) > osd_recovery_max_single_start to 1 (from 5) > > We'd like a bit of feedback first though. Is anyone happy with the current > configs? Is anyone using something between these values and the current > defaults? What kind of workload? I'd guess that lowering osd_max_backfills > to 1 is probably a good idea, but I wonder whether lowering > osd_recovery_max_active and osd_recovery_max_single_start will cause small > objects to recover unacceptably slowly. > > Thoughts?
When we enable explicit rebalancing, we set the parameters as such to reduce the impact on client I/O: osd_recovery_max_active = 1 osd_max_backfills = 1 osd_op_threads = 10 osd_recovery_op_priority = 1 osd_mon_report_interval_min = 30 See https://github.com/bloomberg/chef-bcpc/blob/master/cookbooks/bcpc/templates/default/ceph.conf.erb Cheers. -- justin _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
