On Tue, Aug 6, 2019 at 7:45 PM Robert LeBlanc <rob...@leblancnet.us> wrote:
> We have a 12.2.8 luminous cluster with all NVMe and we want to take some of 
> the NVMe OSDs and allocate them strictly to metadata pools (we have a problem 
> with filling up this cluster and causing lingering metadata problems, and 
> this will guarantee space for metadata operations).

Depending on the workload and metadata size: this might be a bad idea
as it reduces parallelism.


> In the past, we have done this the old-school way of creating a separate 
> root, but I wanted to see if we could leverage the device class function 
> instead.
>
> Right now all our devices show as ssd rather than nvme, but that is the only 
> class in this cluster. None of the device classes were manually set, so is 
> there a reason they were not detected as nvme?

Ceph only distinguishes rotational vs. non-rotational for device
classes and device-specific configuration options

>
> Is it possible to add a new device class like 'metadata'?

yes, it's just a string, you can use whatever you want. For example,
we run a few setups that distinguish 2.5" and 3.5" HDDs.


>
> If I set the device class manually, will it be overwritten when the OSD boots 
> up?

not sure about this, we run all of our setups with auto-updating on
start disabled

> Is what I'm trying to accomplish better done by the old-school separate root 
> and the osd_crush_location_hook (potentially using a file with a list of 
> partition UUIDs that should be in the metadata pool).?

device classes are the way to go here

-- 
Paul Emmerich

Looking for help with your Ceph cluster? Contact us at https://croit.io

croit GmbH
Freseniusstr. 31h
81247 München
www.croit.io
Tel: +49 89 1896585 90


> Thank you,
> Robert LeBlanc
> ----------------
> Robert LeBlanc
> PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to