Re: [OMPI users] OpenMPI without IPoIB

2011-03-15 Thread Shamis, Pavel
I would recommend you to read OFED (or Mellanox OFED) documentation. It will be good start point. Regards, Pavel (Pasha) Shamis --- Application Performance Tools Group Computer Science and Math Division Oak Ridge National Laboratory On Mar 14, 2011, at 4:37 PM, Bernardo F Costa wrote: > O

Re: [OMPI users] OpenMPI without IPoIB

2011-03-15 Thread Jeff Squyres
On Mar 14, 2011, at 4:37 PM, Bernardo F Costa wrote: > I've tried ibdiagnet and other ofed tools. I also tried to debug the > network environment with simple jobs to measure bandwidth and latency. > In most cases, I've seen high peaks of measures who come and go > without any reason I could catch

Re: [OMPI users] OpenMPI without IPoIB

2011-03-15 Thread Peter Kjellström
On Monday, March 14, 2011 09:37:54 pm Bernardo F Costa wrote: > Ok. Native ibverbs/openib is preferable although cannot be used by all > applications (those who do not have a native ip interface). Applications (in this context at least) uses the MPI interface. MPI in general and OpenMPI in pertic

Re: [OMPI users] OpenMPI without IPoIB

2011-03-14 Thread Bernardo F Costa
Ok. Native ibverbs/openib is preferable although cannot be used by all applications (those who do not have a native ip interface). I suppose that if I configure my network nodes to use ipoib (by simply probing ib_ipoib module) I'd still be able to use native ibverbs interface without any delay caus

Re: [OMPI users] OpenMPI without IPoIB

2011-03-13 Thread Shamis, Pavel
Please see my comment below. Pavel (Pasha) Shamis --- Application Performance Tools Group Computer Science and Math Division Oak Ridge National Laboratory On Mar 11, 2011, at 2:47 PM, Bernardo F Costa wrote: > I have found this thread form two years ago. I am some kind of lost on > configuring

Re: [OMPI users] OpenMPI without IPoIB

2011-03-11 Thread Bernardo F Costa
I have found this thread form two years ago. I am some kind of lost on configuring an infiniband cluster for openmpi. What is best: use iboip or use native infiniband ibverbs interface ? For now I am using native infiniband withou ipoib. But I have lots of problems specially with latency in the clu

Re: [OMPI users] OpenMPI without IPoIB

2009-12-01 Thread Jeff Squyres
You might also want to ensure that your Open MPI was built with OpenFabrics support (i.e., to use verbs directly instead of IPoIB). Try this: ompi_info | grep openib If that returns a line with "openib" and "btl" in it, then your Open MPI has OpenFabrics support (we named the plugin "o

Re: [OMPI users] OpenMPI without IPoIB

2009-11-25 Thread Don Kerr
On 11/25/09 02:04, Vivek Satpute wrote: Hi, I tried to execute OpenMPI examples from OFED-1.4 stack and found that all those examples uses IPoIB. How are you determining that it is using IPoIB? Is there any way to execute MPI applications on only Infiniband stack i.e. without using IPoIB

[OMPI users] OpenMPI without IPoIB

2009-11-25 Thread Vivek Satpute
Hi, I tried to execute OpenMPI examples from OFED-1.4 stack and found that all those examples uses IPoIB. Is there any way to execute MPI applications on only Infiniband stack i.e. without using IPoIB module ? Can we execute MPI applications using libibverbs, librdma, or some other libraries ?