[slurm-users] Re: All GPUs are Usable if no Gres is Defined

2025-01-04 Thread Brian Andrus via slurm-users
Ensure cgroups is working and configured to limit access to devices (which includes gpus). Check your cgroup.conf to see that there is an entry for:     ConstrainDevices=yes Brian Andrus On 1/3/2025 10:49 AM, Groner, Rob via slurm-users wrote: I'm not entirely sure, and I can't vouch for di

[slurm-users] Re: All GPUs are Usable if no Gres is Defined

2025-01-03 Thread Groner, Rob via slurm-users
I'm not entirely sure, and I can't vouch for differences in a (relatively) older version of slurm But I'm pretty sure on our cluster, we have to specify the GRES in the partition in order for Slurm to treat them as allocatable resources. On our interactive nodes, we have GPUs but we don't