Re: [slurm-users] Guarantee minimum amount of GPU resources to a Slurm account

2023-09-12 Thread Stephan Roth
Thanks Chris, this completes what I was looking for. Should have had a better look at the scontrol man page. Best, Stephan On 13.09.23 02:24, Chris Samuel wrote: On 12/9/23 9:22 am, Stephan Roth wrote: Thanks Noam, this looks promising! I would suggest that as was as the "magnetic" flag yo

Re: [slurm-users] Guarantee minimum amount of GPU resources to a Slurm account

2023-09-12 Thread Chris Samuel
On 12/9/23 9:22 am, Stephan Roth wrote: Thanks Noam, this looks promising! I would suggest that as was as the "magnetic" flag you may want the "flex" flag on the reservation too in order to let jobs that match it run on GPUs outside of the reservation. All the best, Chris

Re: [slurm-users] Guarantee minimum amount of GPU resources to a Slurm account

2023-09-12 Thread Stephan Roth
Thanks Noam, this looks promising! I'll have to test whether a job allowed to use such a reservation will run outside of it in case the reservation's resources are all occupied or queue up waiting to run in the reservation. On 12.09.23 16:28, Bernstein, Noam CIV USN NRL (6393) Washington DC

Re: [slurm-users] Guarantee minimum amount of GPU resources to a Slurm account

2023-09-12 Thread Bernstein, Noam CIV USN NRL (6393) Washington DC (USA)
Is this what you want? Magnetic Reservations The default behavior for reservations is that jobs must request a reservation in order to run in it. The MAGNETIC flag allows you to create a reservation that will allow jobs to run in it without requiring that they specify the name of the reservatio

[slurm-users] Guarantee minimum amount of GPU resources to a Slurm account

2023-09-12 Thread Stephan Roth
Dear Slurm users, I'm looking to fulfill the requirement of guaranteeing availability of GPU resources to a Slurm account, while allowing this account to use other available GPU resources as well. The guaranteed GPU resources should be of at least 1 type, optionally up to 3 types, as in: Gr

Re: [slurm-users] squeue: unrecognized option '--array-unique'

2023-09-12 Thread Loris Bennett
Loris Bennett writes: > Hi, > > Since upgrading to 23.02.5, I am seeing the following error > > $ squeue --array-unique > squeue: unrecognized option '--array-unique' > Try "squeue --help" for more information > > The help for 'squeue' implies it is still a valid option: > > $ squeue --he

Re: [slurm-users] squeue: unrecognized option '--array-unique'

2023-09-12 Thread Tommi Tervo
> Since upgrading to 23.02.5, I am seeing the following error > > $ squeue --array-unique > squeue: unrecognized option '--array-unique' > > Is this a regression or is something else going on? 23.05 NEWS file reveals that it's removed, unfortunately bug 4346 is private. commit e7fbb89b810cb7a

[slurm-users] squeue: unrecognized option '--array-unique'

2023-09-12 Thread Loris Bennett
Hi, Since upgrading to 23.02.5, I am seeing the following error $ squeue --array-unique squeue: unrecognized option '--array-unique' Try "squeue --help" for more information The help for 'squeue' implies it is still a valid option: $ squeue --help | grep array-unique --array-uni