Hi, I was thinking about the exactly the same thing which Catlin pointed out.
Also, there is an implementation enabling RDMA handling from python: https://github.com/jgunthorpe/python-rdma Thus, I was wondring if I can do something more using the above. BTW, I'm in Boston attending at OpenStack Design Summit/Conference, are any of you in Boston? > Catelin, Narayan, Nick -Masanori From: "Caitlin Bestler" <caitlin.best...@nexenta.com> Subject: Re: [Openstack] OpenStack + RDMA + Infiniband Date: Mon, 3 Oct 2011 14:21:23 -0700 > > > Narayan Desai wrote: > > > > I suspect that the original poster was looking for instance access > (mediated in some way) to IB gear. > > When we were trying to figure out how to best use our IB gear inside > of openstack, we decided that > > it was too risky to try exposing IB at the verbs layer to instances > directly, since the security model > > doesn't appear to have a good way to prevent administrative commands > from being issued from > > untrusted instances. > > > We decided to use to IB as fast plumbing for data movement (using > IPoIB) and have ended up with > > pretty nice I/O performance to the volume service, etc. We haven't > managed to use it for much more > > than that at this point. > > There's no reason to expect use of IPoIB to end up providing better > TCP/IP service for large bulk data > transfer than you would get from a quality Ethernet NIC. But if you have > an existing IB infrastructure > it is certainly worth considering. You should experiment to see whether > you get better performance > under load form IPoIB in connected mode as opposed to trying SDP. > > Either IPoIB or SDP should be accessible via a standard sockets > interface,meaning they could be > plugged in without modifying the Python code or Python libraries. > > The response to congestion by an IB network is different than the > response from a TCP network, > and the response of a TCP network simulated over IPoIB is something else > entirely. So you'd want > to do your evaluation with realistic traffic patterns. > > > _______________________________________________ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > _______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
