Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-24 Thread Chris Samuel
On Thursday, 22 November 2018 2:21:45 AM AEDT Baker D. J. wrote: > Hi Chris, Hi David, > Our SchedulerParameters are... > > SchedulerParameters = bf_window=3600,bf_resolution=180,bf_max_job_user=4 > > I gather that the "bf_window" should be as high as the highest maximum time > limit on th

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-21 Thread Baker D . J .
ds, David From: slurm-users on behalf of Chris Samuel Sent: 20 November 2018 20:12:20 To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Excessive use of backfill on a cluster On Tuesday, 20 November 2018 11:42:49 PM AEDT Baker D. J. wrote: > We are running Slu

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-21 Thread Baker D . J .
gt; PriorityWeightPartition = 0 > PriorityWeightQOS = 100 > PriorityWeightTRES = (null) > PropagatePrioProcess = 0 > > -- > From: Loris Bennett > Sent: 20 November 2018 13:26:14 > To: Baker D.J. > Cc: Slurm User Community List > Subject

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Chris Samuel
On Tuesday, 20 November 2018 11:42:49 PM AEDT Baker D. J. wrote: > We are running Slurm 18.08.0 on our cluster and I am concerned that Slurm > appears to be using backfill scheduling excessively. What are your SchedulerParameters ? All the beest, Chris -- Chris Samuel : http://www.csamuel.o

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Loris Bennett
riorityWeightPartition = 0 > PriorityWeightQOS = 100 > PriorityWeightTRES = (null) > PropagatePrioProcess = 0 > > -- > From: Loris Bennett > Sent: 20 November 2018 13:26:14 > To: Baker D.J. > Cc: Slurm User Community List > Subject: Re: [slurm-users] Excessive use of b

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Baker D . J .
tition = 0 PriorityWeightQOS = 100 PriorityWeightTRES = (null) PropagatePrioProcess= 0 From: Loris Bennett Sent: 20 November 2018 13:26:14 To: Baker D.J. Cc: Slurm User Community List Subject: Re: [slurm-users] Excessive use of backfill on a cluster

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Bjørn-Helge Mevik
It might be unrelated, but I remember we had some similar problems when setting up a new cluster two years ago. I don't remember the details, but I believe it was related to qos'es overriding partition limits. Jobs in these qos'es (with requests that exceeded a partition limit like the minimum num

Re: [slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Loris Bennett
Hi David, Baker D.J. writes: > Hello, > > We are running Slurm 18.08.0 on our cluster and I am concerned that > Slurm appears to be using backfill scheduling excessively. In fact the > vast majority of jobs are being scheduled using backfill. So, for > example, I have just submitted a set of thr

[slurm-users] Excessive use of backfill on a cluster

2018-11-20 Thread Baker D . J .
Hello, We are running Slurm 18.08.0 on our cluster and I am concerned that Slurm appears to be using backfill scheduling excessively. In fact the vast majority of jobs are being scheduled using backfill. So, for example, I have just submitted a set of three serial jobs. They all started on a c