On Fri, May 29, 2015 at 5:47 PM, Samuel Just <sj...@redhat.com> wrote:
> Many people have reported that they need to lower the osd recovery config 
> options to minimize the impact of recovery on client io.  We are talking 
> about changing the defaults as follows:
>
> osd_max_backfills to 1 (from 10)
> osd_recovery_max_active to 3 (from 15)
> osd_recovery_op_priority to 1 (from 10)
> osd_recovery_max_single_start to 1 (from 5)
>
> We'd like a bit of feedback first though.  Is anyone happy with the current 
> configs?  Is anyone using something between these values and the current 
> defaults?  What kind of workload?  I'd guess that lowering osd_max_backfills 
> to 1 is probably a good idea, but I wonder whether lowering 
> osd_recovery_max_active and osd_recovery_max_single_start will cause small 
> objects to recover unacceptably slowly.
>
> Thoughts?

When we enable explicit rebalancing, we set the parameters as such to
reduce the impact on client I/O:

osd_recovery_max_active = 1
osd_max_backfills = 1
osd_op_threads = 10
osd_recovery_op_priority = 1
osd_mon_report_interval_min = 30

See 
https://github.com/bloomberg/chef-bcpc/blob/master/cookbooks/bcpc/templates/default/ceph.conf.erb

Cheers.  -- justin
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to