no need IPoIB, mxm uses native IB. Please see HPCX (pre-compiled ompi, integrated with MXM and FCA) README file for details how to compile/select.
The default transport is UD for internode communication and shared-memory for intra-node. http://bgate,mellanox.com/products/hpcx/ Also, mxm included in the Mellanox OFED. On Fri, Apr 10, 2015 at 5:26 AM, Subhra Mazumdar <subhramazumd...@gmail.com> wrote: > Hi, > > Does ipoib need to be configured on the ib cards for mxm (I have a > separate ethernet connection too)? Also are there special flags in mpirun > to select from UD/RC/DC? What is the default? > > Thanks, > Subhra. > > > On Tue, Mar 31, 2015 at 9:46 AM, Mike Dubman <mi...@dev.mellanox.co.il> > wrote: > >> Hi, >> mxm uses IB rdma/roce technologies. Once can select UD/RC/DC transports >> to be used in mxm. >> >> By selecting mxm, all MPI p2p routines will be mapped to appropriate mxm >> functions. >> >> M >> >> On Mon, Mar 30, 2015 at 7:32 PM, Subhra Mazumdar < >> subhramazumd...@gmail.com> wrote: >> >>> Hi MIke, >>> >>> Does the mxm mtl use infiniband rdma? Also from programming perspective, >>> do I need to use anything else other than MPI_Send/MPI_Recv? >>> >>> Thanks, >>> Subhra. >>> >>> >>> On Sun, Mar 29, 2015 at 11:14 PM, Mike Dubman <mi...@dev.mellanox.co.il> >>> wrote: >>> >>>> Hi, >>>> openib btl does not support this thread model. >>>> You can use OMPI w/ mxm (-mca mtl mxm) and multiple thread mode lin 1.8 >>>> x series or (-mca pml yalla) in the master branch. >>>> >>>> M >>>> >>>> On Mon, Mar 30, 2015 at 9:09 AM, Subhra Mazumdar < >>>> subhramazumd...@gmail.com> wrote: >>>> >>>>> Hi, >>>>> >>>>> Can MPI_THREAD_MULTIPLE and openib btl work together in open mpi >>>>> 1.8.4? If so are there any command line options needed during run time? >>>>> >>>>> Thanks, >>>>> Subhra. >>>>> >>>>> _______________________________________________ >>>>> users mailing list >>>>> us...@open-mpi.org >>>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>>>> Link to this post: >>>>> http://www.open-mpi.org/community/lists/users/2015/03/26574.php >>>>> >>>> >>>> >>>> >>>> -- >>>> >>>> Kind Regards, >>>> >>>> M. >>>> >>>> _______________________________________________ >>>> users mailing list >>>> us...@open-mpi.org >>>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>>> Link to this post: >>>> http://www.open-mpi.org/community/lists/users/2015/03/26575.php >>>> >>> >>> >>> _______________________________________________ >>> users mailing list >>> us...@open-mpi.org >>> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >>> Link to this post: >>> http://www.open-mpi.org/community/lists/users/2015/03/26580.php >>> >> >> >> >> -- >> >> Kind Regards, >> >> M. >> >> _______________________________________________ >> users mailing list >> us...@open-mpi.org >> Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users >> Link to this post: >> http://www.open-mpi.org/community/lists/users/2015/03/26584.php >> > > > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: > http://www.open-mpi.org/community/lists/users/2015/04/26663.php > -- Kind Regards, M.
