fwiw, with Open MPI, ib0 can be selected with
export OMPI_MCA_btl_openib_if_include=ib0
assuming slurm was not configured not to export this environment variable
Gilles
On 10/25/2017 12:55 PM, Paul Hargrove wrote:
Re: [slurm-dev] Re: Selecting a network interface with srun
The "-iface ib0" syntax is used by the hydra launcher if MPICH and its
derivatives such as MVAPICH.
I suggest
http://wiki.mcs.anl.gov/mpich2/index.php/Using_the_Hydra_Process_Manager
as a starting point.
-Paul
On Tue, Oct 24, 2017 at 8:19 PM, r...@open-mpi.org
<mailto:r...@open-mpi.org> <r...@open-mpi.org <mailto:r...@open-mpi.org>>
wrote:
“ibface” isn’t an OpenMPI cmd line option, so I suspect you are
using something other than OpenMPI. For OMPI, you could specify
the interface via MCA param in the environment or default MCA
parameter file. Most MPI implementations have a similar mechanism
- you might check your documentation.
On Oct 24, 2017, at 6:48 PM, Doug Meyer <dameye...@gmail.com
<mailto:dameye...@gmail.com>> wrote:
Hi,
I believe that if you are using OpenMPI you can declare the
interface. By default it should select the fastest interface on
the system. This FAQ may be of help.
https://www.open-mpi.org/faq/?category=tcp
<https://www.open-mpi.org/faq/?category=tcp>
If I have misunderstood the problem I apologize. best of luck!
Doug
On Tue, Oct 24, 2017 at 1:00 PM, Sebastian Eastham
<seast...@mit.edu <mailto:seast...@mit.edu>> wrote:
Dear Slurm Developers mailing list,
When calling the “srun” command, is there any way to specify
the desired network interface? Our network is a mix of
ethernet and inifiniband, such that only a subset of the
nodes have an infiniband interface. When using “mpirun” we
can specify “-iface ib0”, but there does not appear to be a
similar option for “srun”. Although we can successfully run
our applications with “srun”, we can see from “iftop” that
the application is communicating purely through the ethernet
interface.
Once again, I appreciate any help or guidance that you can
give me!
Regards,
Seb
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Dr. Sebastian D. Eastham
Research Scientist
Laboratory for Aviation and the Environment
Massachusetts Institute of Technology
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
--
Paul H. Hargrove phhargr...@lbl.gov <mailto:phhargr...@lbl.gov>
Computer Languages & Systems Software (CLaSS) Group
Computer Science Department Tel: +1-510-495-2352
Lawrence Berkeley National Laboratory Fax: +1-510-486-6900
