Re: [slurm-users] Using hyperthreaded processors

2020-11-06 Thread Diego Zuccato
Il 06/11/20 13:43, Valerio Bellizzomi ha scritto: > Usually hyperthreading will halve the memory-bandwidth available to one > thread running in one core, the other half being used by the second > thread. True. That's one of the "many factors" to consider. We tested with MPI jobs that are mostly CP

Re: [slurm-users] Using hyperthreaded processors

2020-11-06 Thread Valerio Bellizzomi
On Fri, 2020-11-06 at 13:00 +0100, Diego Zuccato wrote: > Il 04/11/20 19:12, Brian Andrus ha scritto: > > > One thing you will start finding in HPC is that, by it's goal, > > hyperthreading is usually a poor fit. > Depends on many factors, but our tests confirm it can do much good! > > > If you a

Re: [slurm-users] Using hyperthreaded processors

2020-11-06 Thread Diego Zuccato
Il 04/11/20 19:12, Brian Andrus ha scritto: > One thing you will start finding in HPC is that, by it's goal, > hyperthreading is usually a poor fit. Depends on many factors, but our tests confirm it can do much good! > If you are properly utilizing your cores, your jobs will actually be > slowed

Re: [slurm-users] Using hyperthreaded processors

2020-11-05 Thread Jean-Christophe HAESSIG
Le mercredi 04 novembre 2020 à 21:41 +, Sebastian T Smith a écrit : > Hi, Hi, > We have Hyper-threading/SMT enabled on our cluster. It's challenging > to fully utilize threads, as Brian suggests. We have a few workloads > that benefit from it being enabled Our cluster services tasks in the

Re: [slurm-users] Using hyperthreaded processors

2020-11-04 Thread Sebastian T Smith
4, 2020 10:12 AM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Using hyperthreaded processors JC, One thing you will start finding in HPC is that, by it's goal, hyperthreading is usually a poor fit. If you are properly utilizing your cores, your jobs will actually be slowed b

Re: [slurm-users] Using hyperthreaded processors

2020-11-04 Thread Brian Andrus
JC, One thing you will start finding in HPC is that, by it's goal, hyperthreading is usually a poor fit. If you are properly utilizing your cores, your jobs will actually be slowed by using hyperthreading.  They are not 'extra' cores, but a method of swapping a core to a different workload d

[slurm-users] Using hyperthreaded processors

2020-11-04 Thread Jean-Christophe HAESSIG
Hi, I would like to make good use of hyperthreaded processors and I already skimmed through a quantity of posts and documentation. It is pretty clear that Slurm likes to allocate processing units up to the core level, and to be able to allocate threads one has to either : - not declare Sockets/Co