Re: Spreading parallel across nodes on HPC system

2022-11-11 Thread Ken Mankoff
On 2022-11-11 at 08:37 +01, Rob Sargent wrote: > How do you mix slurm and parallel hostfile? I have a script S that launches parallel with 30 tasks via "::: $(seq 30)" I start S with "sbatch" and --ntasks=31. One for S itself, 30 for the parallel processes. When slurm gives me 1 node with 31

Re: Spreading parallel across nodes on HPC system

2022-11-11 Thread Christian Meesters
On 11/11/22 08:05, Ken Mankoff wrote: Hi Rob, On 2022-11-10 at 21:21 +01, Rob Sargent wrote: I do this, in slurm bash script, to get the number of jobs I want to run (turns out it's better for me to not load the full hyper-threaded count) cores=`grep -c processor /proc/cpuinfo` cores

Re: Spreading parallel across nodes on HPC system

2022-11-11 Thread Ole Tange
On Fri, Nov 11, 2022 at 5:58 PM Ken Mankoff wrote: > I'll try to simplify my original question... > > If I run > > parallel -s-slf hostfile -j 1000