Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-22 Thread Jeff Squyres (jsquyres) via users
Glad you figured it out! I was waiting for Mellanox support to jump in and answer here; I am not part of the UCX community, so I can't really provide definitive UCX answers. On Jul 22, 2020, at 1:16 PM, Lana Deere mailto:lana.de...@gmail.com>> wrote: Never mind. This was apparently because

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-22 Thread Lana Deere via users
Never mind. This was apparently because I had ucx configured for static libraries while openmpi was configured for shared libraries. .. Lana (lana.de...@gmail.com) On Tue, Jul 21, 2020 at 12:58 PM Lana Deere wrote: > I'm using the infiniband drivers in the CentOS7 distribution, not the > Me

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-21 Thread Lana Deere via users
I'm using the infiniband drivers in the CentOS7 distribution, not the Mellanox drivers. The version of Lustre we're using is built against the distro drivers and breaks if the Mellanox drivers get installed. Is there a particular version of ucx which should be used with openmpi 4.0.4? I download

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-20 Thread Jeff Squyres (jsquyres) via users
Correct, UCX = OpenUCX.org. If you have the Mellanox drivers package installed, it probably would have installed UCX (and Open MPI). You'll have to talk to your sysadmin and/or Mellanox support for details about that. On Jul 20, 2020, at 11:36 AM, Lana Deere mailto:lana.d

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-20 Thread Lana Deere via users
I assume UCX is https://www.openucx.org? (Google found several things called UCX when I searched, but that seemed the right one.) I will try installing it and then reinstall OpenMPI. Hopefully it will then choose between network transports automatically based on what's available. I'll also look

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-18 Thread Jeff Squyres (jsquyres) via users
On Jul 16, 2020, at 2:56 PM, Lana Deere via users mailto:users@lists.open-mpi.org>> wrote: I am new to open mpi. I built 4.0.4 on a CentOS7 machine and tried doing an mpirun of a small program compiled against openmpi. It seems to have failed because my host does not have infiniband. I can't

Re: [OMPI users] choosing network: infiniband vs. ethernet

2020-07-18 Thread Jeff Squyres (jsquyres) via users
Woo hoo! I love getting emails like this. We actually spend quite a bit of time in the design and implementation of the configure/build system so that it will "just work" in a wide variety of situations. Thanks! On Jul 17, 2020, at 5:43 PM, John Duffy via users mailto:users@lists.open-mpi.o

[OMPI users] choosing network: infiniband vs. ethernet

2020-07-17 Thread John Duffy via users
Hi Lana I’m a Open MPI newbie too, but I managed to build Open MPI 4.0.4 quite easily on Ubuntu 20.04 just following the instructions in README/INSTALL in the top level source directory, namely: mkdir build cd build ../configure CFLAGS=ā€œ-O3ā€ # My CFLAGS make all sudo make all sudo make install

[OMPI users] choosing network: infiniband vs. ethernet

2020-07-16 Thread Lana Deere via users
I am new to open mpi. I built 4.0.4 on a CentOS7 machine and tried doing an mpirun of a small program compiled against openmpi. It seems to have failed because my host does not have infiniband. I can't seem to figure out how I should configure when I build so it will do what I want, namely use i