Re: [slurm-users] GPU jobs not running correctly

What SLURM version are you running? What are the #SLURM directives in the batch script? (or the sbatch arguments) When the single GPU jobs are pending, what's the output of 'scontrol show job JOBID'? What are the node definitions in slurm.conf, and the lines in gres.conf? Are the nodes all the

[slurm-users] GPU jobs not running correctly

Hello, We are in the process of finishing up the setup of a cluster with 3 nodes, 4 GPUs each. One node has RTX3090s and the other 2 have RTX6000s.Any job asking for 1 GPU in the submission script will wait to run on the 3090 node, no matter resource availability. Same job requesting 2 or more GPU

[slurm-users] Preemption not working for jobs in higher priority partition

Hi all, I could use some help to understand why preemption is not working for me properly. I have a job blocking other jobs that doesn't make sense to me. Any assistance is appreciated, thank you! I have two partitions defined in slurm, a day time and a night time pariition: Day partition - Pri

Re: [slurm-users] PrivateData does not filter the billing info "scontrol show assoc_mgr flags=qos"

Hi Hemanta, is PrivateData also set in your slurmdbd.conf? Best regards Juergen * Hemanta Sahu [210818 15:04]: > I am still searching for a solution for this . > > On Fri, Aug 7, 2020 at 1:15 PM Hemanta Sahu > wrote: > > > Hi All, > > > > I have configured in our test cluster "PrivateDa