So I was able to change the perms using : chown -h ceph:ceph
/var/lib/ceph/osd/ceph-6/block.db
However now I get the following when starting the OSD which then causes it
to crash
bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-8/block size
8.9 TiB
-1> 2019-02-25 15:03:51.990 7f26d4777240 1 bluefs mount
0> 2019-02-25 15:03:52.006 7f26d4777240 -1 *** Caught signal
(Segmentation fault) **
in thread 7f26d4777240 thread_name:ceph-osd
ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic
(stable)
1: (()+0x9414c0) [0x55a8fc0b54c0]
2: (()+0x12dd0) [0x7f26d5da8dd0]
3: (BlueFS::_replay(bool, bool)+0x11ce) [0x55a8fc079e6e]
4: (BlueFS::mount()+0xff) [0x55a8fc07d16f]
5: (BlueStore::_open_db(bool, bool)+0x81c) [0x55a8fbfa9c3c]
6: (BlueStore::_mount(bool, bool)+0x1a3) [0x55a8fbfd04a3]
7: (OSD::init()+0x27d) [0x55a8fbbc250d]
8: (main()+0x30a2) [0x55a8fba9ceb2]
9: (__libc_start_main()+0xeb) [0x7f26d567a09b]
10: (_start()+0x2a) [0x55a8fbb685aa]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed
to interpret this.
Not sure if this just means the bluefs is corrupt or something I can try
and repair.
On Mon, Feb 25, 2019 at 10:15 AM Ashley Merrick <singap...@amerrick.co.uk>
wrote:
> After a reboot of a node I have one particular OSD that won't boot.
> (Latest Mimic)
>
> When I "/var/lib/ceph/osd/ceph-8 # ls -lsh"
>
> I get " 0 lrwxrwxrwx 1 root root 19 Feb 25 02:09 block.db -> '/dev/sda5
> /dev/sdc5'"
>
> For some reasons it is trying to link block.db to two disks, if I remove
> the block.db link and manually create the correct link the OSD still fails
> to start due to the perms on block.db file being root:root.
>
> If I run a chmod it just goes back to root:root and the following shows in
> the OSD logs
>
> 2019-02-25 02:03:21.738 7f574b2a1240 -1
> bluestore(/var/lib/ceph/osd/ceph-8) _open_db
> /var/lib/ceph/osd/ceph-8/block.db symlink exists but target unusable: (13)
> Permission denied
> 2019-02-25 02:03:21.738 7f574b2a1240 1 bdev(0x55dbf0a56700
> /var/lib/ceph/osd/ceph-8/block) close
> 2019-02-25 02:03:22.034 7f574b2a1240 -1 osd.8 0 OSD:init: unable to mount
> object store
> 2019-02-25 02:03:22.034 7f574b2a1240 -1 ** ERROR: osd init failed: (13)
> Permission denied
>
> Thanks
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
