On 06/01/17 15:08, Vicker, Darby (JSC-EG311) wrote:

> Among other things we want the prolog and epilog scripts to clean up any 
> stray processes.

I would argue that a much better way to do that is to use Slurm's
cgroups support, that will contain a jobs processes into the cgroup
allowing it to kill off only those processes (and not miss any) when the
job ends.

If you are unlucky enough to have SSH based job launchers then you would
also look at the BYU contributed pam_slurm_adopt which will put those
tasks into the cgroup of that users job on the node they are trying to
SSH into.  You do need PrologFlags=contain for that to ensure that all
jobs get an "extern" batch step on job creation for these processes to
be adopted into.

We use both here with great success.

All the best,
Chris
-- 
 Christopher Samuel        Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: [email protected] Phone: +61 (0)3 903 55545
 http://www.vlsci.org.au/      http://twitter.com/vlsci

Reply via email to