Re: [ceph-users] Recovery/Backfill Speedup

2016-10-06 Thread Ronny Aasen
how did you set the parameter ? editing ceph.conf only works when you restart the osd nodes. but running something like ceph tell osd.* injectargs '--osd-max-backfills 6' would set all osd's max backfill dynamically without restarting the osd. and you should fairly quickly afterwards see more

Re: [ceph-users] Recovery/Backfill Speedup

2016-10-05 Thread Dan Jakubiec
Thank Ronny, I am working with Reed on this problem. Yes something is very strange. Docs say osd_max_backfills default to 10, but when we examined the run-time configuration using "ceph --show-config" it was showing osd_max_backfills set to 1 (we are running latest Jewel release). We have e

Re: [ceph-users] Recovery/Backfill Speedup

2016-10-05 Thread Ronny Aasen
On 04.10.2016 16:31, Reed Dier wrote: Attempting to expand our small ceph cluster currently. Have 8 nodes, 3 mons, and went from a single 8TB disk per node to 2x 8TB disks per node, and the rebalancing process is excruciatingly slow. Originally at 576 PGs before expansion, and wanted to allow