Re: [slurm-users] update_node / reason set to: slurm.conf / state set to DRAINED

2020-11-08 Thread Kevin Buckley
On 2020/11/05 17:15, Zacarias Benta wrote: On 05/11/2020 02:00, Kevin Buckley wrote: We have had a couple of nodes enter a DRAINED state where scontrol gives the reason as Reason=slurm.conf Hi Kevin, I have no experience with version 20 of slurm, but probably you have some misconfiguration.

Re: [slurm-users] update_node / reason set to: slurm.conf / state set to DRAINED

2020-11-05 Thread Christopher Samuel
Hi Kevin, On 11/4/20 6:00 pm, Kevin Buckley wrote: In looking at the SlurmCtlD log we see pairs of lines as follows  update_node: node nid00245 reason set to: slurm.conf  update_node: node nid00245 state set to DRAINED I'd go looking in your healthcheck scripts, I took a quick look at the

Re: [slurm-users] update_node / reason set to: slurm.conf / state set to DRAINED

2020-11-05 Thread Zacarias Benta
Hi Kevin, I have no experience with version 20 of slurm, but probably you have some misconfiguration. Have you changed any settings in your slurm.conf file after the upgrade? Dive into the documentation and verify if there aren't any changes to some of the directives within the slurm.conf. On

[slurm-users] update_node / reason set to: slurm.conf / state set to DRAINED

2020-11-04 Thread Kevin Buckley
We have had a couple of nodes enter a DRAINED state where scontrol gives the reason as Reason=slurm.conf In looking at the SlurmCtlD log we see pairs of lines as follows update_node: node nid00245 reason set to: slurm.conf update_node: node nid00245 state set to DRAINED A search of the int