Hi Sebastian, Another solution could be to change the configuration of nodes in slurm.conf, making use of NodeName and NodeHostname (and NodeAddr if needed) :
“ NodeName Name that Slurm uses to refer to a node[...]. Typically this would be the string that "/bin/hostname -s" returns.[...]It may also be an arbitrary string if NodeHostname is specified.[...] NodeHostname Typically this would be the string that "/bin/hostname -s" returns.[...]By default, the NodeHostname will be identical in value to NodeName. NodeAddr Name that a node should be referred to in establishing a communications path.[...] NodeAddr may also contain IP addresses. By default, the NodeAddr will be identical in value to NodeHostname. “ For the nodes having an infiniband interface declare the associated name in NodeName and the regular hostname in NodeHostname. SLURM_NODELIST will contain the names declared in NodeName. Regards, Pierre-Marie Le Biot From: Sebastian Eastham [mailto:seast...@mit.edu] Sent: Tuesday, October 24, 2017 10:02 PM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Selecting a network interface with srun Dear Slurm Developers mailing list, When calling the “srun” command, is there any way to specify the desired network interface? Our network is a mix of ethernet and inifiniband, such that only a subset of the nodes have an infiniband interface. When using “mpirun” we can specify “-iface ib0”, but there does not appear to be a similar option for “srun”. Although we can successfully run our applications with “srun”, we can see from “iftop” that the application is communicating purely through the ethernet interface. Once again, I appreciate any help or guidance that you can give me! Regards, Seb =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Dr. Sebastian D. Eastham Research Scientist Laboratory for Aviation and the Environment Massachusetts Institute of Technology =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
