[slurm-users] Another batch script archiver solution

2021-10-05 Thread Christopher Benjamin Coffey
Howdy, With the release of 21.08 series of slurm, we now have the ability to archive batch scripts within slurm. Yeah, thanks! This is very cool and handy, yet before this feature was added to slurm, we developed another option that may be of interest to you. In my opinion, it’s a better one as

[slurm-users] Slurm version 21.08.2 is now available

2021-10-05 Thread Tim Wickberg
We are pleased to announce the availability of Slurm version 21.08.2. There is one significant change include in this maintenance release: the removal of support for the long-misunderstood TaskAffinity=yes option in cgroup.conf. Please consider using "TaskPlugins=cgroup,affinity" in slurm.conf

Re: [slurm-users] How to enforce memory contrains?

2021-10-05 Thread Rodrigo Santibáñez
Hello Tina and Hermann, Thanks for your suggestions. @Tina, I have SelectType=select/cons_res and SelectTypeParameters=CR_CPU_Memory in slurm.conf I added TaskAffinity=no, MaxRAMPercent=100 and MaxSwapPercent=0 to cgroup.conf. I will see what happens. Best! On Tue, Oct 5, 2021 at 1:33 AM Tina

Re: [slurm-users] 21.08: Removing batch scripts from the database

2021-10-05 Thread Andy Georges
Hi, On 05/10/2021 08:45, Kevin Buckley wrote: Trying to get my head around the extremely useful addition, for 21.08 onwards, as regards storing the batch scripts in the accounting database, You are aware of two existing solutions to this that do not involve the slurm accounting DB? https:/

Re: [slurm-users] How to enforce memory contrains?

2021-10-05 Thread Tina Friedrich
Hi Rodrigo, we do pretty much what you do - constrain via cgroups - and it works fine. So I know it's possible. (I don't think I've ever twiddled the VSizeFactor.) I think you also need SelectType=select/cons_res (or cons_tres) SelectTypeParameters=CR_Core_Memory in your slurm.conf; have yo

Re: [slurm-users] How to enforce memory contrains?

2021-10-05 Thread Hermann Schwärzler
Hi Rodrigo, a possible solution is using VSizeFactor=100 in slurm.conf. With this settings, programs that try to allocate more memory than requested in the job's settings will fail. Be aware that this puts a limit on *virtual* memory, not on RSS. This might or might not be what you want as

Re: [slurm-users] "Low RealMem" after upgrade

2021-10-05 Thread Diego Zuccato
Il 05/10/2021 09:22, Ole Holm Nielsen ha scritto: What is a "frontend"?  Do you mean the slurmctld server? Yes, sorry. "Frontend" is how we call the node(s) used by users to submit jobs, where slurmctld and slurmdbd run. We'll probably move slurmdbd and slurmctld to a dedicated VM in a future

Re: [slurm-users] "Low RealMem" after upgrade

2021-10-05 Thread Ole Holm Nielsen
On 10/5/21 8:05 AM, Diego Zuccato wrote: I already tried multiple times, both RESUME and IDLE, and it didn't work: it just returned to "IDLE+DRAIN" with 'Reason="low realmem"'. :( I just tried again (after an unplanned shutdown of the frontend) and it What is a "frontend"? Do you mean the slu