I'd like to configure E-mail notifications of failing nodes. I already use the LBL NHC (Node Health Check) on the compute nodes to send alerts, but one may also use the Slurm strigger mechanism on the slurmctld host.

The examples in http://slurm.schedmd.com/strigger.html are quite rudimentary, so I've experimented with writing a slightly more user friend script https://ftp.fysik.dtu.dk/Slurm/notify_nodes_down

Question: Has anyone already written (and is willing to share) the ultimately clever tool using strigger to monitor nodes going down etc.?

Thanks,
Ole

Reply via email to