Re: [ceph-users] bluefs-bdev-expand experience

2019-04-12 Thread Alfredo Deza
On Thu, Apr 11, 2019 at 4:23 PM Yury Shevchuk wrote: > > Hi Igor! > > I have upgraded from Luminous to Nautilus and now slow device > expansion works indeed. The steps are shown below to round up the > topic. > > node2# ceph osd df > ID CLASS WEIGHT REWEIGHT SIZERAW USE DATAOMAPMETA

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-12 Thread Igor Fedotov
On 4/11/2019 11:23 PM, Yury Shevchuk wrote: Hi Igor! I have upgraded from Luminous to Nautilus and now slow device expansion works indeed. The steps are shown below to round up the topic. node2# ceph osd df ID CLASS WEIGHT REWEIGHT SIZERAW USE DATAOMAPMETAAVAIL %USE VAR

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-11 Thread Yury Shevchuk
Hi Igor! I have upgraded from Luminous to Nautilus and now slow device expansion works indeed. The steps are shown below to round up the topic. node2# ceph osd df ID CLASS WEIGHT REWEIGHT SIZERAW USE DATAOMAPMETAAVAIL %USE VAR PGS STATUS 0 hdd 0.22739 1.0 233 GiB 9

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-10 Thread Igor Fedotov
On 4/9/2019 1:59 PM, Yury Shevchuk wrote: Igor, thank you, Round 2 is explained now. Main aka block aka slow device cannot be expanded in Luminus, this functionality will be available after upgrade to Nautilus. Wal and db devices can be expanded in Luminous. Now I have recreated osd2 once agai

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-09 Thread Yury Shevchuk
Igor, thank you, Round 2 is explained now. Main aka block aka slow device cannot be expanded in Luminus, this functionality will be available after upgrade to Nautilus. Wal and db devices can be expanded in Luminous. Now I have recreated osd2 once again to get rid of the paradoxical cepf osd df o

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-08 Thread Igor Fedotov
Hi Yuri, both issues from Round 2 relate to unsupported expansion for main device. In fact it doesn't work and silently bypasses the operation in you case. Please try with a different device... Also I've just submitted a PR for mimic to indicate the bypass, will backport to Luminous once mim

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-05 Thread Yury Shevchuk
On Fri, Apr 05, 2019 at 02:42:53PM +0300, Igor Fedotov wrote: > wrt Round 1 - an ability to expand block(main) device has been added to > Nautilus, > > see: https://github.com/ceph/ceph/pull/25308 Oh, that's good. But still separate wal&db may be good for studying load on each volume (blktrace) o

Re: [ceph-users] bluefs-bdev-expand experience

2019-04-05 Thread Igor Fedotov
Hi Yuri, wrt Round 1 - an ability to expand block(main) device has been added to Nautilus, see: https://github.com/ceph/ceph/pull/25308 wrt Round 2: - not setting 'size' label looks like a bug although I recall I fixed it... Will double check. - wrong stats output is probably related to

[ceph-users] bluefs-bdev-expand experience

2019-04-05 Thread Yury Shevchuk
Hello all! We have a toy 3-node Ceph cluster running Luminous 12.2.11 with one bluestore osd per node. We started with pretty small OSDs and would like to be able to expand OSDs whenever needed. We had two issues with the expansion: one turned out user-serviceable while the other probably needs