[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Hi, thank you. Done, I put the link below. Maybe someone else on this list can enlighten us ;-) https://tracker.ceph.com/issues/55395 On Wed, Apr 20, 2022 at 2:55 PM Eugen Block wrote: > I see. I'm not sure if cephadm should be able to handle that and this > is a bug or if you need to create t

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Eugen Block
I see. I'm not sure if cephadm should be able to handle that and this is a bug or if you need to create those files and directories yourself. I was able to revive OSDs in a test cluster this way, but that should not be necessary. Maybe there is already an existing tracker, but if not you sh

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Thank you for your reply. However, the cephadm command did not create the osd.X directories in /var/lib/ceph/FSID... Subsequently the start fails which is also shown in the journalctl output: Apr 20 14:51:28 dmz-host-4 bash[2540969]: /bin/bash: /var/lib/ceph/d221bc3c-8ff4-11ec-b4ba-b02628267680/o

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Eugen Block
Well, at least it reports that the OSDs were activated successfully: /bin/docker: --> ceph-volume lvm activate successful for osd ID: 12 /bin/docker: --> Activating OSD ID 25 FSID 3f3d61f8-6964-4922-98cb-6620aff5cb6f Now you need to get the pods up, I'm not sure if cephadm will manage that

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Hm, not much more luck: # cephadm --verbose ceph-volume lvm activate --all --no-systemd cephadm ['--verbose', 'ceph-volume', 'lvm', 'activate', '--all', '--no-systemd'] Using default config: /etc/ceph/ceph.conf /bin/d

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Eugen Block
IIUC it's just the arrow that can't be displayed when the systemd-unit is enabled and the symlinks in /etc/systemd/system/multi-user.target.wants/ are created. When OSDs are created by cephadm the flag --no-systemd is usually used, can you try this command? cephadm ceph-volume lvm activat

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Hi, thank you for your reply. That really is all. I tried to call `cephadm ceph-volume lvm activate --all`, see below, and this apparently crashes because of some unicode problem... might that be the root cause? Cheers, Manuel [root@dmz-host-4 rocky]# cephadm ceph-volume lvm activate --all Infe

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Eugen Block
Hi, and the relevant log output is here: https://privatepastebin.com/?f95c66924a7ddda9#ADEposX5DCo5fb5wGv42czrxaHscnwoHB7igc3eNQMwc This is just the output of 'ceph-volume lvm list', is that really all? I haven't had the chance to test 'ceph cephadm osd activate' myself so I can't really t

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Dear Eugen, thanks for the hint. The output is pasted below. I can't gather any useful information from that. I also followed the instructions from https://docs.ceph.com/en/latest/cephadm/operations/#watching-cephadm-log-messages ``` ceph config set mgr mgr/cephadm/log_to_cluster_level debug ce

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Eugen Block
Hi, have you checked /var/log/ceph/cephadm.log for any hints? ceph-volume.log may also provide some information (/var/log/ceph//ceph-volume.log) what might be going on. Zitat von Manuel Holtgrewe : Dear all, I now attempted this and my host is back in the cluster but the `ceph cephadm os

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-04-20 Thread Manuel Holtgrewe
Dear all, I now attempted this and my host is back in the cluster but the `ceph cephadm osd activate` does not work. # ceph cephadm osd activate HOST Created no osd(s) on host HOST; already created? Using --verbose is not too helpful either: bestcmds_sorted: [{'flags': 8, 'help': 'Start OSD c

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-02-06 Thread bbk
Hi, i don't know if that still applies, but on the newly installed system, i didn't had the OSD auth keys so the daemons where not able to connect to the cluster. I had to manually create a osd config and add the osd daemon by hand: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-02-02 Thread Robert Sander
On 02.02.22 12:15, Manuel Holtgrewe wrote: Would this also work when renaming hosts at the same time? - remove host from ceph orch - reinstall host with different name/IP - add back host into ceph orch - use ceph osd activate as above? That could also work as long as the OSDs are still in th

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-02-02 Thread Manuel Holtgrewe
Thank you for the information. I will try this. Would this also work when renaming hosts at the same time? - remove host from ceph orch - reinstall host with different name/IP - add back host into ceph orch - use ceph osd activate as above? On Mon, Jan 31, 2022 at 10:44 AM Robert Sander wrote:

[ceph-users] Re: Reinstalling OSD node managed by cephadm

2022-01-31 Thread Robert Sander
Am 28.01.22 um 21:09 schrieb Manuel Holtgrewe: What is the overall process of reinstalling (e.g., for going from enterprise linux 7 to 8) and getting my OSDs back afterwards. - reinstall operating system on system disk - install cephadm binary - ... now what? ;-) You need to add the cephadm S