Hi Marcus,
I would advise against putting a loop in your job script. The job array
mechanism is designed exactly for this purpose:
https://slurm.schedmd.com/job_array.html
If you have very small jobs, it is usually better to run them separately
so that the individual jobs can fill gaps in the
I would suggest using Gnu Parallel (https://www.gnu.org/software/parallel/).
Also, if you run that many "srun" in a row, on a very large cluster where
the slurmctl is very solicited some of the srun might time out and not run.
Richard
Le ven. 5 nov. 2021 à 05:45, Marcus Pedersén a
écrit :
> Hi
Hi Marcus,
Is something like staskfarm, https://github.com/paddydoyle/staskfarm,
https://www.tchpc.tcd.ie/node/1127 any use for your needs? Sorry if not.
Regards
Sean
On Fri, Nov 05, 2021 at 10:42:32AM +0100, Marcus Peders?n wrote:
> Hi all,
> I have setup a basic slurm system and been testin
Hi all,
I have setup a basic slurm system and been testing out
a nuber of things.
The latest thing I started to test is the parallel parts.
What I have is about 70 independent scripts that would be
ideal to run in parallel.
For testing purposes I have created 20 dummy scripts
that print script name
