[slurm-users] Re: Job pre / post submit scripts

[Christopher Samuel via slurm-users]

On 10/28/24 10:56 am, Bhaskar Chakraborty via slurm-users wrote:

Is there an option in slurm to launch a custom script at the time of job 
submission through sbatch

or salloc? The script should run with submit user permission in submit area.


I think you are after the cli_filter functionality which can run plugins 
in that environment. There is a Lua plugin for that which will allow you 
to write your code in something a little less fraught than C.


https://slurm.schedmd.com/cli_filter_plugins.html

There is example Lua code for this here:

https://github.com/SchedMD/slurm/blob/master/etc/cli_filter.lua.example

All the best,
Chris
--
Chris Samuel  :  http://www.csamuel.org/  :  Berkeley, CA, USA

--
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com

[slurm-users] 转发: What is the safe upgrade path when upgrade from slurm21.08 and mariadb5.5?

[hermes via slurm-users]

Hi everyone:

 

We are currently running business on SLURM21.08 and mariadb5.5. 

When talking about the upgrade, we need to keep all the users and jobs
history data. And we see the official document wrote:

“When upgrading an existing accounting database to MariaDB 10.2.1 or later
from an older version of MariaDB or any version of MySQL, ensure you are
running slurmdbd 22.05.7 or later. These versions will gracefully handle
changes to MariaDB default values that can cause problems for slurmdbd.”

 

So is this mean we have to firstly build SLURM>22.05 over mariadb5.5, and do
the SLURM upgrade. Then upgrade the mariadb to newer version, and rebuild
the same version of SLURM over new mariadb-devel?

And is it safe to jump directly from mariadb5.5 to latest version? How can
we check whether the slurm have correctly inherited the historical data?

 

Thanks,

Tianyang Zhang

SJTU Network Information Center


-- 
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com

[slurm-users] Job pre / post submit scripts

[Bhaskar Chakraborty via slurm-users]

Hi,
Is there an option in slurm to launch a custom script at the time of job 
submission through sbatchor salloc? The script should run with submit user 
permission in submit area.
The idea is that we need to enquire something which characterises our job’s 
requirement like CPUslots, memory etc from a central server and we do need read 
access to user area prior to that.
In our use case the user doesn’t necessarily know beforehand what kind of 
resource his job needs.(Hence, the need for such a script which will contact 
the server with user area info.)
Based on it we can modify the job a little later. A post submit script, if 
available, would inform us the slurm job id as well, it would get called just 
after the job has entered the system and prior to its scheduling.

Thanks,Bhaskar.

Sent from Yahoo Mail for iPad

-- 
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com

[slurm-users] I need to limit the number of jobs per user per partition

[Stephen Connolly via slurm-users]

  I am unable to limit the number of jobs per user per partition. I 
have searched the internet, the forums and the slurm documentation.

  I created a partition with a QOS having MaxJobsPU=1 and MaxJobsPA=1
  Created a user stephen with account=stephen and MaxJobs=1
  However if I sbatch a test job (sleep 180) multiple times they all 
run concurrently. I am at a loss of what else to do. Help would be very 
appreciated .


Thank you
--
Stephen Connolly
JSI Data Systems Ltd
613-727-9353
step...@jsidata.ca


--
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com

[slurm-users] Re: I need to limit the number of jobs per user per partition

[Bjørn-Helge Mevik via slurm-users]

Have you set the AccountingStorageEnforce parameter in slurm.conf?  I
believe that it should be set to at least "limits", but do check "man
slurm.conf" to be sure.

-- 
Regards,
Bjørn-Helge Mevik, dr. scient,
Department for Research Computing, University of Oslo



signature.asc
Description: PGP signature

-- 
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com

[slurm-users] Re: Job pre / post submit scripts

[Davide DelVento via slurm-users]

Not sure if I understand your use case, but if I do I am not sure if Slurm
provides that functionality.
If it doesn't (and if my understanding is correct), you can still achieve
your goal by:

1) removing sbatch and salloc from user's path
2) writing your own custom scripts named sbatch (and hard/symbolic linked
to salloc) which does what you want and at the end (with $0 variable or
similar thing) it actually invokes full-path to sbatch and salloc --
actually it could do that after, rather than before, if you so prefer

Hope this helps

On Mon, Oct 28, 2024 at 11:59 AM Bhaskar Chakraborty via slurm-users <
slurm-users@lists.schedmd.com> wrote:

> Hi,
>
> Is there an option in slurm to launch a custom script at the time of job
> submission through sbatch
> or salloc? The script should run with submit user permission in submit
> area.
>
> The idea is that we need to enquire something which characterises our
> job’s requirement like CPU
> slots, memory etc from a central server and we do need read access to user
> area prior to that.
>
> In our use case the user doesn’t necessarily know beforehand what kind of
> resource his job needs.
> (Hence, the need for such a script which will contact the server with user
> area info.)
>
> Based on it we can modify the job a little later. A post submit script, if
> available, would inform us the slurm job id as well, it would get called
> just after the job has entered the system and prior to its scheduling.
>
> Thanks,
> Bhaskar.
>
> Sent from Yahoo Mail for iPad
> 
>
> --
> slurm-users mailing list -- slurm-users@lists.schedmd.com
> To unsubscribe send an email to slurm-users-le...@lists.schedmd.com
>

-- 
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-le...@lists.schedmd.com