Re: [slurm-users] Autodetect of nvml is not working in gres.conf

2023-11-30 Thread Shunran Zhang
ers on behalf of > Ravi Konila > *Sent:* Thursday, November 30, 2023 9:06 AM > *To:* slurm-users@lists.schedmd.com > *Subject:* [slurm-users] Autodetect of nvml is not working in gres.conf > > You don't often get email from ravibh...@gmail.com. Learn why this is > import

Re: [slurm-users] Autodetect of nvml is not working in gres.conf

2023-11-30 Thread Shunran Zhang
Hi all, If you could offer a little bit more details on your OS and Slurm version that might shed some light. There is an interesting detail about the NVML package if you are using RHEL-like OS. The NVML detection part of the slurm library (/usr/lib64/slurm/gpu_nvml.so) is linked against the /lib

Re: [slurm-users] Autodetect of nvml is not working in gres.conf

2023-11-30 Thread Groner, Rob
fy --with-nvml= if it's not in a standard location. Rob From: slurm-users on behalf of Ravi Konila Sent: Thursday, November 30, 2023 9:06 AM To: slurm-users@lists.schedmd.com Subject: [slurm-users] Autodetect of nvml is not working in gres.conf You don&#x

Re: [slurm-users] Autodetect of nvml is not working in gres.conf

2023-11-30 Thread Josef Dvoracek
couldn't be that library "cuda-nvml-devel" was not installed when you were building slurm? cheers josef On 30. 11. 23 15:06, Ravi Konila wrote: Hello, My gres.conf has AutoDetect=nvml when I restart slurmd service I do get *fatal: We were configured to autodetect nvml functionality, but we w

[slurm-users] Autodetect of nvml is not working in gres.conf

2023-11-30 Thread Ravi Konila
Hello, My gres.conf has AutoDetect=nvml when I restart slurmd service I do get fatal: We were configured to autodetect nvml functionality, but we weren't able to find that lib when Slurm was configured. Referred few links to solve along with slurm-users email archives but could not understand