[OMPI users] multi-rail failover with IB

2008-04-02 Thread Robin Humble
Hi, from reading the FAQ and this list it seems OpenMPI can use multiple InfiniBand rails by round-robining across the ports out of each node (as long as they're configured to be on separate subnets (I think)). can OpenMPI also deal with one of the subnets failing? ie. will OpenMPI automatically

[OMPI users] quadrics

2007-03-18 Thread Robin Humble
does OpenMPI support Quadrics elan3/4 interconnects? I saw a few hits on google suggesting that support was partial or maybe planned, but couldn't find much in the openmpi sources to suggest any support at all. cheers, robin

Re: [OMPI users] IB bandwidth vs. kernels

2007-01-19 Thread Robin Humble
On Thu, Jan 18, 2007 at 03:10:15PM +0200, Gleb Natapov wrote: >On Thu, Jan 18, 2007 at 07:17:13AM -0500, Robin Humble wrote: >> On Thu, Jan 18, 2007 at 11:08:04AM +0200, Gleb Natapov wrote: >> >On Thu, Jan 18, 2007 at 03:52:19AM -0500, Robin Humble wrote: >> >> On W

Re: [OMPI users] IB bandwidth vs. kernels

2007-01-18 Thread Robin Humble
On Thu, Jan 18, 2007 at 11:08:04AM +0200, Gleb Natapov wrote: >On Thu, Jan 18, 2007 at 03:52:19AM -0500, Robin Humble wrote: >> On Wed, Jan 17, 2007 at 08:55:31AM -0700, Brian W. Barrett wrote: >> >On Jan 17, 2007, at 2:39 AM, Gleb Natapov wrote: >> >> On Wed, Ja

Re: [OMPI users] IB bandwidth vs. kernels

2007-01-18 Thread Robin Humble
argh. attached. cheers, robin On Thu, Jan 18, 2007 at 03:52:19AM -0500, Robin Humble wrote: >On Wed, Jan 17, 2007 at 08:55:31AM -0700, Brian W. Barrett wrote: >>On Jan 17, 2007, at 2:39 AM, Gleb Natapov wrote: >>> On Wed, Jan 17, 2007 at 04:12:10AM -0500, Robin Humble wrote:

Re: [OMPI users] IB bandwidth vs. kernels

2007-01-18 Thread Robin Humble
On Wed, Jan 17, 2007 at 08:55:31AM -0700, Brian W. Barrett wrote: >On Jan 17, 2007, at 2:39 AM, Gleb Natapov wrote: >> On Wed, Jan 17, 2007 at 04:12:10AM -0500, Robin Humble wrote: >>> basically I'm seeing wildly different bandwidths over InfiniBand 4x DDR >>> when

[OMPI users] IB bandwidth vs. kernels

2007-01-17 Thread Robin Humble
so this isn't really an OpenMPI questions (I don't think), but you guys will have hit the problem if anyone has... basically I'm seeing wildly different bandwidths over InfiniBand 4x DDR when I use different kernels. I'm testing with netpipe-3.6.2's NPmpi, but a home-grown pingpong sees the same