Re: [OMPI users] General Questions

2016-03-05 Thread Jeff Squyres (jsquyres)
I just realized that I replied directly to Matthew and not to the list. Let me add most of my reply to the thread here on the list, in case it's helpful to others. See my reply to Matthew, below. > On Mar 5, 2016, at 10:53 AM, Jeff Squyres (jsquyres) > wrote: > > Let me try to explain a lit

Re: [OMPI users] General Questions

2016-03-05 Thread Matthew Larkin
> > I don't think the Open MPI TCP BTL will pass the SDP socket type when > creating sockets -- SDP is much lower performance than native verbs/RDMA.  > You should use a "native" interface to your RDMA network instead (which one > you use depends on which kind of network you have). > > > I

Re: [OMPI users] General Questions

2016-03-02 Thread Jeff Squyres (jsquyres)
On Mar 1, 2016, at 10:25 PM, dpchoudh . wrote: > > > I don't think the Open MPI TCP BTL will pass the SDP socket type when > creating sockets -- SDP is much lower performance than native verbs/RDMA. > You should use a "native" interface to your RDMA network instead (which one > you use depen

Re: [OMPI users] General Questions

2016-03-01 Thread dpchoudh .
I don't think the Open MPI TCP BTL will pass the SDP socket type when creating sockets -- SDP is much lower performance than native verbs/RDMA. You should use a "native" interface to your RDMA network instead (which one you use depends on which kind of network you have). I have a rather naive fo

Re: [OMPI users] General Questions

2016-03-01 Thread Gilles Gouaillardet
my 0.02 US$ i do not think the OMPI TCP BTL *explicitly* passses the SDP socket type when creating sockets. and though i did not try that, i suspect using SDP via an LD_PRELOAD'ed library would be enought to use SDP sockets Cheers, Gilles On 3/2/2016 11:54 AM, Jeff Squyres (jsquyres) wrote:

Re: [OMPI users] General Questions

2016-03-01 Thread Jeff Squyres (jsquyres)
On Mar 1, 2016, at 6:55 PM, Matthew Larkin wrote: > > As far as PCIe, I am looking into: > > 1. Dolphin's implementation of IPoPCIe If it provides a TCP stack and an IP interface, you should be able to use Open MPI's TCP BTL interface over it. > 2. SDP protocol and how it can be utilized, m

Re: [OMPI users] General Questions

2016-03-01 Thread Matthew Larkin
As far as PCIe, I am looking into:  1. Dolphin's implementation of IPoPCIe  2. SDP protocol and how it can be utilized, mapping TCP to RDMA Not sure if the only answer for this is a custom stack, API/kernel module. Do you have any input on the above mentioned things? On Tuesday, March 1, 2016

Re: [OMPI users] General Questions

2016-03-01 Thread Jeff Squyres (jsquyres)
On Feb 29, 2016, at 6:48 PM, Matthew Larkin wrote: > > 1. I know OpenMPI supports ethernet, but where does it clearly state that? > - I see on the FAQ on the web page there is a whole list of network > interconnect, but how do I relate that to Ethernet network etc.? Open MPI actually supports m

[OMPI users] General Questions

2016-02-29 Thread Matthew Larkin
Hello all, First time on here. Two questions. 1. I know OpenMPI supports ethernet, but where does it clearly state that?- I see on the FAQ on the web page there is a whole list of network interconnect, but how do I relate that to Ethernet network etc.? 2. Does OpenMPI work with PCIe and PCIe swit