Hello!
On 18/08/16 12:33, Ole Holm Nielsen wrote:
On 08/17/2016 03:49 PM, Barbara Krasovec wrote:
I upgraded SLURM rom 15.08 to 16.05 without draining the nodes and
without loosing any jobs, this was my procedure:
I increased timeouts in slurm.conf:
SlurmctldTimeout=3600
SlurmdTimeout=3600
Question: When you change parameters in slurm.conf, how do you force
all daemons to reconfigure this? Can you reload the slurm.conf
without restarting the daemons (which is what you want to avoid)?
scontrol reconfigure
Did mysqldump of slurm database and copied slurmstate dir (just in
What do you mean by "slurmstate"?
StateSaveLocation=/var/spool/slurmstate
case), I increased innodb_buffer_size in my.cnf to 128M, then I followed
The 128 MB seems to be the default! But in the SLURM accounting page
I found some recommendations for the MySQL/Mariadb configuration. How
to implement these recommendations has now been added to my Wiki:
https://wiki.fysik.dtu.dk/niflheim/SLURM#mysql-configuration
the instructions on slurm page:
Shutdown the slurmdbd daemon
Upgrade the slurmdbd daemon
Restart the slurmdbd daemon
Shutdown the slurmctld daemon(s)
Shutdown the slurmd daemons on the compute nodes
Upgrade the slurmctld and slurmd daemons
Restart the slurmd daemons on the compute nodes
Restart the slurmctld daemon(s)
Chris Samuel in a previous posting had some more cautious advice about
upgrading slurmd daemons! I hope that Chris may offer addition insights.
/Ole
Cheers,
Barbara
