[slurm-users] Slurm version 21.08 is now available

2021-08-26 Thread Tim Wickberg
After 9 months of development and testing we are pleased to announce the availability of Slurm version 21.08! Slurm 21.08 includes a number of new features including: - A new "AccountingStoreFlags=job_script" option to store the job scripts directly in SlurmDBD. - Added "sacct -o SubmitLine"

Re: [slurm-users] SLURM reservations with MAGNETIC flag

2021-08-26 Thread Bas van der Vlies
The problem has been solved. We tested it with ’srun’ and that did not work the same is for ’salloc’ To make it work with these commands apply one of the solutions: 1. Add ‘defer’ to ScheduleParameters 2. srun --begin=now+1 sbatch works out of the box. Thanks to schedmd (Ben) for the solu

Re: [slurm-users] scancel gpu jobs when gpu is not requested

2021-08-26 Thread Renfro, Michael
Not a solution to your exact problem, but we document partitions for interactive, debug, and batch, and have a job_submit.lua [1] that routes GPU-reserving jobs to gpu-interactive, gpu-debug, and gpu partitions automatically. Since our GPU nodes have extra memory slots, and have tended to run a

Re: [slurm-users] EXTERNAL-Re: [External] scancel gpu jobs when gpu is not requested

2021-08-26 Thread Michael Robbert
You need to set the following option in slurm.conf JobSubmitPlugins A comma delimited list of job submission plugins to be used. The specified plugins will be executed in the order listed. These are intended to be site-specific plugins which can be used to set default job parameters and/or loggi

Re: [slurm-users] free resources

2021-08-26 Thread Ole Holm Nielsen
On 26-08-2021 08:01, Pankaj Dorlikar wrote: We are using slurm-20.11..7 on ubuntu system having GPUs. What is the equivalent of “showbf –S” in maui or any command in slurm for checking the free resources ? Maybe "sinfo -t idle"? The showbf manual doesn't document any -S flag: https://docs.ada

Re: [slurm-users] free resources

2021-08-26 Thread Ole Holm Nielsen
On 26-08-2021 09:34, Pankaj Dorlikar wrote: However, sinfo -t idle /sinfo -t mix is only giving the node names which are idle/mix. To get exact number of cpus / gpus, what command need to be used. If sinfo doesn't show what you want, perhaps you can try installing my "pestat" command from htt

Re: [slurm-users] free resources

2021-08-26 Thread Pankaj Dorlikar
Thank you. However, sinfo -t idle /sinfo -t mix is only giving the node names which are idle/mix. To get exact number of cpus / gpus, what command need to be used. showbf -S backfill window (user: 'root' group: 'root' partition: ALL) Thu Aug 26 12:53:23 410 procs available for 3:57:21 21