[slurm-users] sacct output in tabular form

Hello! this is a simple wrapper for sacct which prints the output from sacct as table. So you can make a "sacctml -j foo --long" even without two 8k displays ;-) cheers#!/usr/bin/python3 def sacct_command(cmd): cmd_list=["sacct","--parsable2"] cmd_list.extend(cmd) result=subproces

[slurm-users] scancel gpu jobs when gpu is not requested

Hello, I have written a script in my prolog.sh that cancels any slurm job if the parameter gres=gpu is not present. This is the script i added to my prolog.sh if [ $SLURM_JOB_PARTITION == "gpu" ]; then if [ ! -z "${GPU_DEVICE_ORDINAL}" ]; then echo "GPU ID used is ID: $GPU

Re: [slurm-users] [External] Re: Preemption not working for jobs in higher priority partition

I can confirm that we do preemption based on partition for one of our clusters. I will say that we are not using time-based partitions, ours are always up and they are based on group node ownership. I wonder if Slurm is refusing to preempt a job in a DOWN partition. Maybe try leaving the partiti

Re: [slurm-users] Preemption not working for jobs in higher priority partition

I have been researching this further and I see other systems that appear to be set up the same way we are. Example: https://hpcrcf.atlassian.net/wiki/spaces/TCP/pages/733184001/How-to+Use+the+preempt+Partition Any further insight into what may be wrong with our setup is appreciated. I am not seein

Re: [slurm-users] [EXT] Alert-Verify-Sender: Elasticsearch Plugin Not Working After Update

And I figured it out very quickly after doing the obvious and turning up the logging level to debug. It appears authentication is required for the new index URL path. Sorry for the spam! Jason Dana JHUAPL REDD/RA2 Senior Systems Administrator/Software Engineer jason.d...@jhuapl.edu

[slurm-users] Elasticsearch Plugin Not Working After Update

Hello all, I recently updated our cluster from Slurm 20.02.03 to 20.11.8. The Elasticsearch plugin was working great before the upgrade, but afterwards I’m not seeing any indications of the plugin running or attempting to connect in the logs. Here is the slurm.conf entry for 20.11.8: Slurmctld