Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Christopher Samuel
On 5/17/22 12:00 pm, Paul Edmon wrote: Database upgrades can also take a while if your database is large. Definitely recommend backing up prior to upgrade as well as running slurmdbd -Dv and not the systemd daemon as if the upgrade takes a long time it will kill it preemptively due to unre

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Paul Edmon
Database upgrades can also take a while if your database is large.  Definitely recommend backing up prior to upgrade as well as running slurmdbd -Dv and not the systemd daemon as if the upgrade takes a long time it will kill it preemptively due to unresponsiveness which will create all sort

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Ole Holm Nielsen
Hi, You can upgrade from 19.05 to 20.11 in one step (2 major releases), skipping 20.02. When that is completed, it is recommended to upgrade again from 20.11 to 21.08.8 in order to get the current major version. The 22.05 will be out very soon, but you may want to wait a couple of minor rele

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Brian Andrus
So the need to go step-by-step is due to changes in the database schema. The upgrade process is not able to upgrade if there is too big of a difference. That is a little gotcha: so when upgrading, you need to start slurmdbd and let it run for a bit as it does the database update (you can watch

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Paul Edmon
I think it should be, but you should be able to run a test and find out. -Paul Edmon- On 5/17/22 12:13 PM, byron wrote: Sorry, I should have been clearer.   I understand that with regards to slurmd / slurmctld you can skip a major release without impacting running jobs etc.  My questions was a

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread byron
Sorry, I should have been clearer. I understand that with regards to slurmd / slurmctld you can skip a major release without impacting running jobs etc. My questions was about upgrading slurmdbd and whether it was necessary to upgrade through the intermediate major releases (which I know underst

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Paul Edmon
The slurm docs say you can do two major releases at a time (https://slurm.schedmd.com/quickstart_admin.html): "Almost every new major release of Slurm (e.g. 20.02.x to 20.11.x) involves changes to the state files with new data structures, new options, etc. Slurm permits upgrades to a new major

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread byron
Thanks Brian for the speedy responce. Am I not correct in thinking that if I just go from 19.05 to 20.11 then there is the advantage that I can upgrade slurmd and slurmctld in one go and it won't affect the running jobs since upgrading to a new major release from the past two major releases doesn'

Re: [slurm-users] upgrading slurm to 20.11

2022-05-17 Thread Brian Andrus
You need to step upgrade through major versions (not minor). So 19.05=>20.x I would highly recommend going to 21.08 while you are at it. I just did the same migration (although they started at 18.x) with no issues. Running jobs were not impacted and users didn't even notice. Brian Andrus On

[slurm-users] upgrading slurm to 20.11

2022-05-17 Thread byron
Hi I'm looking at upgrading our install of slurm from 19.05 to 20.11 in responce to the recenty announced security vulnerabilities. I've been through the documentation / forums and have managed to find the answers to most of my questions but am still unclear about the following - In upgrading t