I have found this thread form two years ago. I am some kind of lost on configuring an infiniband cluster for openmpi. What is best: use iboip or use native infiniband ibverbs interface ? For now I am using native infiniband withou ipoib. But I have lots of problems specially with latency in the cluster. Which of these two ipoib or ibverbs is more likely to be fault tolerant or stable ?
On Nov 25, 2009, at 1:03 PM, Don Kerr wrote: > > On 11/25/09 02:04, Vivek Satpute wrote: >> >> Hi, >> >> I tried to execute OpenMPI examples from OFED-1.4 stack and found >> that all those >> examples uses IPoIB. > How are you determining that it is using IPoIB? >> >> Is there any way to execute MPI applications on only Infiniband >> stack i.e. without >> using IPoIB module ? >> Can we execute MPI applications using libibverbs, librdma, or some >> other libraries ? > OpenMPI by default will select and use the best available path. If > the ibverbs interace is available and operational OpenMPI will use > this for off-node MPI communication. If you are concerned that > ibverbs is not in use specifically calling it out on the mpirun > command line will assure you that it is being used, e.g. "mpirun -- > mca btl self,sm,openib .... ". This command will instruct OpenMPI to > use shared memory for on node communication and openib (ibverbs), > for off-node communication. > > -DON >> >> >> Thanks, >> Vivek >> >> _______________________________________________ >> users mailing list >> users_at_[hidden] >> http://www.open-mpi.org/mailman/listinfo.cgi/users >> > _______________________________________________ > users mailing list > users_at_[hidden] > http://www.open-mpi.org/mailman/listinfo.cgi/users
