[slurm-users] Application level checkpointing

After resources are available it would be restarted and let run ·After completion all resulting files are merged. Supose these bash scripts are there (I know how to do it). The question is how to incorporate it in the slurm scheduling mechanism. Oytun Peksel Eng Simulation & Digi

[slurm-users] Execute scripts on suspend and cancel

Hi, I was wondering is there an option in Slurm to execute custom scripts before Suspend signal. What I need to do is to tell an application to release it's licenses before sending the suspend signal during preemption. I think went through all the documentation but could not find a mechanism l

Re: [slurm-users] Execute scripts on suspend and cancel

o there is no distinctive flag for resuming. Anyone has any other method to execute scripts during preemption? Oytun Peksel oytun.pek...@semcon.com <mailto:oytun.pek...@semcon.com> +46739205917 From: slurm-users On Behalf Of Oytun Peksel Sent: den 11 oktober 2019 09:10

Re: [slurm-users] Execute scripts on suspend and cancel

e end, these feel like dirty tricks to me. The select/* plugins should have mechanisms to run scripts and such before sending signals. But apparently there is no such mechanism. So probably I will dig deeper into what you suggested. Thanks Oytun Peksel oytun.pek...@semcon.com <mailto:o

[slurm-users] Preemption Priority

Thanks Oytun Peksel When you communicate with us or otherwise interact with Semcon, we will process personal data that you provide to us or we collect about you, please read more in our Privacy Policy<https://semcon.com/data-privacy-policy/>.

[slurm-users] calculate license tokens from cpus

I would like to expose user to slurm as much as possible, and use scripts as little as possible. Any way to do this kind of thing? Oytun Peksel Eng Simulation & Digital Twins Semcon Sweden AB Lindholmsallén 2 417 80 GÖTEBORG Sweden Phone +46739205917 Mobile +46739205917

Re: [slurm-users] calculate license tokens from cpus

Thanks for the tip Mark it looks quite useful for my purposes. I am setting this up for a small intimate group so abuse is a non issue and I want everyone to be responsible for maintenance. Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm

Re: [slurm-users] Preemption Priority

t=YES PriorityTier=1 PreemptMode=requeue 37 PartitionName=HighPrio MaxTime=240 PriorityTier=2 PreemptMode=suspend Default=NO 38 PartitionName=Express MaxTime=30 PriorityTier=3 PreemptMode=off Default=NO Oytun Peksel oytun.pek...@semcon.com <mailto:oytun.pek...@semcon.com> +4673920

Re: [slurm-users] Help with preemtion based on licenses

Hi Eric, Have you been able to find a solution to your problem. Facing the same issue right now.. BR Oytun Peksel When you communicate with us or otherwise interact with Semcon, we will process personal data that you provide to us or we collect about you, please read more in our Privacy

Re: [slurm-users] Help with preemtion based on licenses

? If it isn't currently possible, could this be a feature included in the current cons_tres work that is going on? I've read through a bunch of the documentation and tried to do my due diligence but haven't found a definitive answer. Thanks, Eric W From: slurm-users On Beh

Re: [slurm-users] Help with preemtion based on licenses

The above behavior is observed with select/cons_tres plugin and license defined as a TRES "AccountingStorageTres=license/someSoftware Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm-users On Behalf Of Mark Hahn Sent: den 5 november 2019

Re: [slurm-users] Help with preemtion based on licenses

other jobs." This does not make sense to me. If gpu is my generic resource why would it not release the gpu resources if a job is suspended? Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm-users On Behalf Of Oytun Peksel Sent: den 6 novembe

Re: [slurm-users] Help with preemtion based on licenses

I have no better plan than to dig in the source code to find an easy way to change this behavior. Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm-users On Behalf Of Mark Hahn Sent: den 6 november 2019 16:23 To: Slurm User Community List

Re: [slurm-users] Help with preemtion based on licenses

n the output: TRES=cpu=23,mem=23G,node=1,billing=23 Or sacct --format=tres Shows just the default trackable resources. Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm-users On Behalf Of Chris Samuel Sent: den 7 november 2019 08:03 To: slurm-

Re: [slurm-users] Help with preemtion based on licenses

://github.com/baytuni/slurm.git Oytun Peksel oytun.pek...@semcon.com Mobile +46739205917 -Original Message- From: slurm-users On Behalf Of Oytun Peksel Sent: den 7 november 2019 08:48 To: Slurm User Community List Subject: Re: [slurm-users] Help with preemtion based on licenses Thank