If iirc you can just wait and it will start and resolve by himself. Perhaps a systemctl stop, is failed and than start after you have a message like "couldnt start osd" in the osd log.
Hth Mehmet Am 13. Dezember 2024 12:03:20 MEZ schrieb Frank Schilder <fr...@dtu.dk>: >Hi all, > >we had to bring the OSDs back up prior to an upgrade from octopus to pacific. >Unfortunately, instructions we found for an off-line update of the osdmap did >not work. We first tried a command like > > ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-556/ --op > set-osdmap --file osd.map > >but this gave an error; see full session log below. We found that --force >should force the update and it "worked" without an error message. However, >when we started the OSDs they ignored the injected OSD map and started to get >into their endless "try to catch up" loop spamming the log partition to death. >In the end we did a zap+recreate and got them up. > >Afterwards we found that we might have missed an important flag. In tracker >https://tracker.ceph.com/issues/15520 the command also has the --epoch flag >that we overlooked (and doesn't use the --file flag): > > ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-556/ –op set-osdmap > <osdmap-file> --epoch <epoch-number> --force > >It would be great if someone could provide a correct and complete example for >how to set an osdmap with ceph-objectstore-tool, the documentation at >https://docs.ceph.com/en/pacific/man/8/ceph-objectstore-tool/#description (and >also for latest) is "a bit sparse" here. Working examples for such operations >would be great in the docs. My best bet after failing is: > > ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-556/ --op > set-osdmap --file osd.map --epoch <epoch-number> [--force] > >Can't confirm though. > >Here our session log: > >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --no-mon-config --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >osdmap (#-1:bdf1d99b:::osdmap.3145505:0#) does not exist. > >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >osdmap (#-1:bdf1d99b:::osdmap.3145505:0#) does not exist. >[root@ceph-adm:ceph-13 ~]# ceph osd getmap -o osd.map >got osdmap epoch 3145529 >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >osdmap (#-1:b9b9d99b:::osdmap.3145529:0#) does not exist. >[root@ceph-adm:ceph-13 ~]# echo $? >1 >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op get-osdmap --file osd.map.2 >osdmap#2971464 exported. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >osdmap (#-1:b9b9d99b:::osdmap.3145529:0#) does not exist. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --force --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >osdmap (#-1:b9b9d99b:::osdmap.3145529:0#) does not exist. >Creating a new epoch. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op get-osdmap --file osd.map.2 >osdmap#2971464 exported. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map --force >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op get-osdmap --file osd.map.2 >osdmap#2971464 exported. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map >[root@ceph-adm:ceph-13 ~]# ceph osd getmap -o osd.map >got osdmap epoch 3145556 >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1004/ --op set-osdmap --file osd.map --force >osdmap (#-1:bc85d99b:::osdmap.3145556:0#) does not exist. >Creating a new epoch. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-990/ --op set-osdmap --file osd.map --force >osdmap (#-1:bc85d99b:::osdmap.3145556:0#) does not exist. >Creating a new epoch. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-995/ --op set-osdmap --file osd.map --force >osdmap (#-1:bc85d99b:::osdmap.3145556:0#) does not exist. >Creating a new epoch. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1000/ --op set-osdmap --file osd.map --force >osdmap (#-1:bc85d99b:::osdmap.3145556:0#) does not exist. >Creating a new epoch. >[root@ceph-adm:ceph-13 ~]# ceph-objectstore-tool --data-path >/var/lib/ceph/osd/ceph-1004/ --op set-osdmap --file osd.map --force > >Thanks and best regards, >================= >Frank Schilder >AIT Risø Campus >Bygning 109, rum S14 >_______________________________________________ >ceph-users mailing list -- ceph-users@ceph.io >To unsubscribe send an email to ceph-users-le...@ceph.io _______________________________________________ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
