[slurm-users] Limit usage outside reservation

2020-10-20 Thread SJTU
Hi, We reserved compute node resource on SLURM for specific users and hope they will make good use of it. But in some cases users forgot the '--reservation' parameter in job scripts, competing with other users outside the reserved nodes. Is there a recommended way to limit users' usage *OUTSIDE

Re: [slurm-users] SLES 15 rpmbuild from 20.02.5 tarball wants munge-libs: system munge RPMs don't provide it

2020-10-20 Thread Kevin Buckley
On 2020/10/20 11:50, Christopher Samuel wrote: I forgot I do have access to a SLES15 SP1 system, that has: # rpm -q libmunge2 --provides libmunge.so.2()(64bit) libmunge2 = 0.5.14-4.9.1 libmunge2(x86-64) = 0.5.14-4.9.1 munge-libs = 0.5.14 # rpm -q libmunge2 libmunge2-0.5.14-4.9.1.x86_64 So tha

[slurm-users] TaskPlugin task/affinity and task/cgroup

2020-10-20 Thread Max Quast
Dear Slurm users, i would like to use the taskplugin cgroups on my system. I have configured cgroups as recommended by slurm: cgroup.conf: CgroupAutomount=yes CgroupMountpoint=/sys/fs/cgroup TaskAffinity=no ConstrainCores=yes slurm.conf: ... TaskPlugin=task/affinity,task/cgroup #Ta

Re: [slurm-users] SLES 15 rpmbuild from 20.02.5 tarball wants munge-libs: system munge RPMs don't provide it

2020-10-20 Thread Michael Jennings
On Tuesday, 20 October 2020, at 15:49:25 (+0800), Kevin Buckley wrote: > On 2020/10/20 11:50, Christopher Samuel wrote: > > > > I forgot I do have access to a SLES15 SP1 system, that has: > > > > # rpm -q libmunge2 --provides > > libmunge.so.2()(64bit) > > libmunge2 = 0.5.14-4.9.1 > > libmunge2(

Re: [slurm-users] SLES 15 rpmbuild from 20.02.5 tarball wants munge-libs: system munge RPMs don't provide it

2020-10-20 Thread Brian Andrus
I concur with so much of this. One thing I tend to do is just keep my own .spec file updated to build the various things I need done in a particular way (openmpi, slurm, etc) When a source is updated, I update it as necessary, but at least I have a known process and environment for my package

Re: [slurm-users] Limit usage outside reservation

2020-10-20 Thread Michael Gutteridge
I'm unaware of any mechanism to do this on a per-user basis. The partition configuration does include the parameter "ReqResv" ( https://slurm.schedmd.com/slurm.conf.html): ReqResv Specifies users of this partition are required to designate a reservation when submitting a job. This option can be u

[slurm-users] Reserve some cores per GPU

2020-10-20 Thread Relu Patrascu
Hi all, We have a GPU cluster and have run into this issue occasionally. Assume four GPUs per node; when a user requests a GPU on such a node, and all the cores, or all the RAM, the other three GPUs will be wasted for the duration of the job, as slurm has no more cores or RAM available to all

Re: [slurm-users] Reserve some cores per GPU

2020-10-20 Thread Aaron Jackson
I look after a very heterogeneous GPU Slurm setup and some nodes have quite few cores. We use a job_submit lua script which calculates the number of requested cpu cores per gpu. This is then used to scan through a table of 'weak nodes' based on a 'max cores per gpu' property. The node names are app

Re: [slurm-users] Use gres to handle permissions of /dev/dri/card* and /dev/dri/renderD*?

2020-10-20 Thread Mgr. Martin Pecka
Pinging this topic again. Nobody has an idea how to define multiple files to be treated as a single gres? Thank you for help, Martin Pecka Dne 4.9.2020 v 21:29 Martin Pecka napsal(a): Hello, we want to use EGL backend for accessing OpenGL without the need for Xorg. This approach requires acc

Re: [slurm-users] Reserve some cores per GPU

2020-10-20 Thread Relu Patrascu
I thought of doing this, but, I'm guessing you don't have preemption enabled. With preemption enabled this becomes more complicated, and error prone, but I'll think some more about it. It'd be nice leverage slurm's scheduling engine and just add this constraint. Relu On 2020-10-20 16:20

Re: [slurm-users] SLES 15 rpmbuild from 20.02.5 tarball wants munge-libs: system munge RPMs don't provide it

2020-10-20 Thread Kevin Buckley
On 2020/10/20 23:46, Michael Jennings wrote: So one thing I've done/recommended in the past is to create a ".nosrc.rpm" - i.e., an RPM that builds with a specfile but with no buildable source - that has "Requires:" entries to pull in the correct packages that you *wish* provided particular thin

Re: [slurm-users] SLES 15 rpmbuild from 20.02.5 tarball wants munge-libs: system munge RPMs don't provide it

2020-10-20 Thread Christopher Samuel
On 10/20/20 12:49 am, Kevin Buckley wrote: only have, as listed before, Munge 0.5.13. I guess the question is (going back to your initial post): > error: Failed build dependencies: >munge-libs is needed by slurm-20.02.5-1.x86_64 Had you installed libmunge2 before trying this build?