Dear Slurm developers, and Marcin, "--hint=nomultithread" is not what I would like to use.
I have checked the topology with "lstopo" and "hwloc-ls". They show the
topology correctly, like:
Machine (96GB total)
NUMANode L#0 (P#0 96GB) + Package L#0 + L3(MemorySideCache) L#0 (16GB)
L2 L#0 (1024KB)
L1d L#0 (32KB) + L1i L#0 (32KB) + Core L#0
PU L#0 (P#0)
PU L#1 (P#64)
PU L#2 (P#128)
PU L#3 (P#192)
What library does Slurm use to identify the topology on the compute node?
Thank you,
Ulf
Am 14.02.2017 um 16:33 schrieb Marcin Stolarek:
> I don't think you can specify it. I believe slurm makes use of external
> library to recognize the cores topology.
> To check if this is a bug or designed behaviur, you can check:
> --hint=nomultithread option to srun
>
> cheers,
> Marcin
>
> 2017-02-09 8:21 GMT+01:00 Ulf Markwardt <[email protected]
> <mailto:[email protected]>>:
>
> Dear all,
>
> where can I tell Slurm what core numbers belong to the same physical
> core?
>
> The physical cores on our KNL are 0-63, followed by hyperthreads 64-255.
> cat /sys/devices/system/cpu/cpu0/topology/thread_siblings_list
> 0,64,128,192
>
> When I ask for 4 cores with "srun --pty -c 4 -p knl bash" I see:
> taurusknl1 /home/mark taskset -pc $$
> pid 285662's current affinity list: 0,64,128,192
> but these are not 4 cores but only one core!
>
> It looks like Slurm does not recognize the numbering scheme for the
> cores on the node. Where can I specify this?
>
>
> Thank you,
> Ulf
>
> "scontrol show node " says:
> CoreSpecCount=1 CPUSpecList=252-255
> this, again, are 4 threads on 4 different cores!
>
> This is my node entry for this guy:
> NodeName=taurusknl[1] Sockets=1 CoresPerSocket=64 ThreadsPerCore=4
> State=UNKNOWN RealMemory=94000 Weight=64 CoreSpecCount=1
>
>
> --
> ___________________________________________________________________
> Dr. Ulf Markwardt
>
> Technische Universität Dresden
> Center for Information Services and High Performance Computing (ZIH)
> 01062 Dresden, Germany
>
> Phone: (+49) 351/463-33640 <tel:%28%2B49%29%20351%2F463-33640>
> WWW: http://www.tu-dresden.de/zih
>
>
--
___________________________________________________________________
Dr. Ulf Markwardt
Technische Universität Dresden
Center for Information Services and High Performance Computing (ZIH)
01062 Dresden, Germany
Phone: (+49) 351/463-33640 WWW: http://www.tu-dresden.de/zih
smime.p7s
Description: S/MIME Cryptographic Signature
