Do you perhaps have anything in the ceph.conf files on the servers with those OSDs that would attempt to tell the daemon that they are filestore osds instead of bluestore? I'm sure you know that the second part [1] of the output in both cases only shows up after an OSD has been rebooted. I'm sure this too could be cleaned up by adding that line to the ceph.conf file.
[1] rocksdb_separate_wal_dir = 'false' (not observed, change may require restart) On Sun, Apr 21, 2019 at 8:32 AM Marc Roos <m.r...@f1-outsourcing.eu> wrote: > > > Just updated luminous, and setting max_scrubs value back. Why do I get > osd's reporting differently > > > I get these: > osd.18: osd_max_scrubs = '1' (not observed, change may require restart) > osd_objectstore = 'bluestore' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.19: osd_max_scrubs = '1' (not observed, change may require restart) > osd_objectstore = 'bluestore' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.20: osd_max_scrubs = '1' (not observed, change may require restart) > osd_objectstore = 'bluestore' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.21: osd_max_scrubs = '1' (not observed, change may require restart) > osd_objectstore = 'bluestore' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.22: osd_max_scrubs = '1' (not observed, change may require restart) > osd_objectstore = 'bluestore' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > > > And I get osd's reporting like this: > osd.23: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.24: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.25: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.26: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.27: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > osd.28: osd_max_scrubs = '1' (not observed, change may require restart) > rocksdb_separate_wal_dir = 'false' (not observed, change may require > restart) > > > > > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com