Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-07 Thread Ole Holm Nielsen
Hi Brian, Presumably the users' home directory is NFS automounted using autofs, and therefore it doesn't exist when the job starts. The job_container/tmpfs plugin ought to work correctly with autofs, but maybe this is still broken in 23.02? /Ole On 3/6/23 21:06, Brian Andrus wrote: That

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-06 Thread Michael Jennings
On Monday, 06 March 2023, at 10:15:22 (+0100), Niels Carl W. Hansen wrote: Seems there still are some issues with the autofs - job_container/tmpfs functionality in Slurm 23.02. If the required directories aren't mounted on the allocated node(s) before jobstart, we get: slurmstepd: error: coul

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-06 Thread Brian Andrus
1 March 2023 at 8:29 pm *To: *slurm-users@lists.schedmd.com *Subject: *Re: [slurm-users] Cleanup of job_container/tmpfs ! EXTERNAL EMAIL: Think before you click. If suspicious send to cyberrep...@petermac.org Hi Jason, IMHO, the job_container/tmpfs is not working well in Slurm 22.05, but there m

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-06 Thread Niels Carl W. Hansen
Head - Research Computing Facility Office of Cancer Research Peter MacCallum Cancer Center *From: *slurm-users on behalf of Ole Holm Nielsen *Date: *Wednesday, 1 March 2023 at 8:29 pm *To: *slurm-users@lists.schedmd.com *Subject: *Re: [slurm-users] Cleanup of job_container/tmpfs ! EXTERNAL EMAI

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-01 Thread Jason Ellul
@lists.schedmd.com Subject: Re: [slurm-users] Cleanup of job_container/tmpfs ! EXTERNAL EMAIL: Think before you click. If suspicious send to cyberrep...@petermac.org On Wednesday, 01 March 2023, at 10:28:24 (+0100), Ole Holm Nielsen wrote: > but there may be some significant improvements included in 23

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-01 Thread Jason Ellul
behalf of Ole Holm Nielsen Date: Wednesday, 1 March 2023 at 8:29 pm To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Cleanup of job_container/tmpfs ! EXTERNAL EMAIL: Think before you click. If suspicious send to cyberrep...@petermac.org Hi Jason, IMHO, the job_container/tmpfs is not

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-01 Thread Michael Jennings
On Wednesday, 01 March 2023, at 10:28:24 (+0100), Ole Holm Nielsen wrote: but there may be some significant improvements included in 23.02 TL;DR: I can vouch for this. The primary problem with the interaction between the new namespace code and the automounter daemon was simply that the shar

Re: [slurm-users] Cleanup of job_container/tmpfs

2023-03-01 Thread Ole Holm Nielsen
Hi Jason, IMHO, the job_container/tmpfs is not working well in Slurm 22.05, but there may be some significant improvements included in 23.02 (announced yesterday). I've documented our experiences in the Wiki page https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_configuration/#temporary-job-dir

[slurm-users] Cleanup of job_container/tmpfs

2023-02-28 Thread Jason Ellul
Hi, We have recently moved to slurm 22.05.8 and have configured job_container/tmpfs to allow private tmp folders. job_container.conf contains: AutoBasePath=true BasePath=/slurm And in slurm.conf we have set JobContainerType=job_container/tmpfs I can see the folders being created and they are b