Charles -- It may have gotten lost in the middle of this thread, but the vendor-recommended way of running on InfiniBand these days is with UCX. I.e., install OpenUCX and use one of the UCX transports in Open MPI. Unless you have special requirements, you should likely give this a try and see if it works for you.
The libfabric / verbs combo *may* work, but I don't know how robust the verbs libfabric support was in the v1.5 release series. > On Jun 14, 2018, at 10:01 AM, Charles A Taylor <chas...@ufl.edu> wrote: > > Hi Matias, > > Thanks for the response. > > As of a couple of hours ago we are running: > > libfabric-devel-1.5.3-1.el7.x86_64 > libfabric-1.5.3-1.el7.x86_64 > > As for the provider, I saw that one but just listed “verbs”. I’ll go with > the “verbs;ofi_rxm” going forward. > > Regards, > > Charlie > > >> On Jun 14, 2018, at 12:49 PM, Cabral, Matias A <matias.a.cab...@intel.com> >> wrote: >> >> Hi Charles, >> >> What version of libfabric do you have installed? To run OMPI using the verbs >> provider you need to pair it with the ofi_rxm provider. fi_info should list >> it like: >> … >> provider: verbs;ofi_rxm >> … >> >> So in your command line you have to specify: >> mpirun -mca pml cm -mca mtl ofi -mca mtl_ofi_provider_include >> “verbs;ofi_rxm” …. >> >> (don’t skip the quotes) >> > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users -- Jeff Squyres jsquy...@cisco.com _______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
