Re: [slurm-users] Job are pending when plenty of resources available

2020-03-30 Thread Marcus Wagner
Hi Mike, but that would mean, that 409978 requests nearly the whole cluster. I'm wondering for what resources it waits. Yet, there are nearly 32000 nodes idle. I would assume, such one node job would fit. But you are right, depends on the higher prio job. Best Marcus On 3/30/20 3:47 PM, Ren

Re: [slurm-users] Job are pending when plenty of resources available

2020-03-30 Thread Renfro, Michael
All of this is subject to scheduler configuration, but: what has job 409978 requested, in terms of resources and time? It looks like it's the highest priority pending job in the interactive partition, and I’d expect the interactive partition has a higher priority than the regress partition. As

[slurm-users] Job are pending when plenty of resources available

2020-03-29 Thread Carter, Allan
I'm perplexed. My cluster has been churning along and tonight it has decided to start pending jobs even though there are plenty of nodes available. An example job from squeue: JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) 409978 interactiver