Re: [slurm-users] Usage gathering for GPUs

2023-06-06 Thread Vecerka Daniel
Hi all,  I'm trying to get working the gathering of gres/gpumem and gres/gpuutil on Slurm 23.02.2 , but with no success yet. We have: AccountingStorageTRES=cpu,mem,gres/gpu in the slurm.conf and Slurm is build with NVML support. Autodetect=NVML in gres.conf gres/gpumem and gres/gpuutil now a

Re: [slurm-users] Usage gathering for GPUs

2023-05-24 Thread Christopher Samuel
On 5/24/23 11:39 am, Fulton, Ben wrote: Hi, Hi Ben, The release notes for 23.02 say “Added usage gathering for gpu/nvml (Nvidia) and gpu/rsmi (AMD) plugins”. How would I go about enabling this? I can only comment on the nvidia side (as those are the GPUs we have) but for that you need S

[slurm-users] Usage gathering for GPUs

2023-05-24 Thread Fulton, Ben
Hi, The release notes for 23.02 say "Added usage gathering for gpu/nvml (Nvidia) and gpu/rsmi (AMD) plugins". How would I go about enabling this? Thanks! -- Ben Fulton Research Applications and Deep Learning Research Technologies Indiana University