Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-27 Thread Jeff Squyres
On Jan 27, 2009, at 10:19 AM, Peter Kjellstrom wrote: It is worth clarifying a point in this discussion that I neglected to mention in my initial post: although Open MPI may not work *by default* with heterogeneous HCAs/RNICs, it is quite possible/likely that if you manually configure Open MPI t

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-27 Thread Peter Kjellstrom
On Tuesday 27 January 2009, Jeff Squyres wrote: > It is worth clarifying a point in this discussion that I neglected to > mention in my initial post: although Open MPI may not work *by > default* with heterogeneous HCAs/RNICs, it is quite possible/likely > that if you manually configure Open MPI to

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-27 Thread Jeff Squyres
It is worth clarifying a point in this discussion that I neglected to mention in my initial post: although Open MPI may not work *by default* with heterogeneous HCAs/RNICs, it is quite possible/likely that if you manually configure Open MPI to use the same verbs/hardware settings across all

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-27 Thread Peter Kjellstrom
On Monday 26 January 2009, Jeff Squyres wrote: > The Interop Working Group (IWG) of the OpenFabrics Alliance asked me > to bring a question to the Open MPI user and developer communities: is > anyone interested in having a single MPI job span HCAs or RNICs from > multiple vendors? (pardon the cros

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-27 Thread Samuel Sarholz
Hi, I can think of a few scenarios where interoperability would be helpful, but I guess in most case you can live without. 1. Some university departments buy tiny clusters (4-8 nodes) and when more projects/funding become available the next one. Thus ending up with 2-4 different CPU generation

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-26 Thread Jeff Squyres
This scenario was not mentioned, but I'll bet it falls into the same general category. If an HCA has different run-time characteristics, regardless of whether they are caused by the OEM or the reseller, that's probably "heterogeneous enough" for this discussion. On Jan 26, 2009, at 2:41 P

Re: [OMPI users] Heterogeneous OpenFabrics hardware

2009-01-26 Thread Don Kerr
Jeff, Did IWG say anything about there being a chip set issue?Example what if a vender, say Sun, wraps Mellanox chips and on its own HCAs, would Mellanox HCA and Sun HCA work together? -DON On 01/26/09 14:19, Jeff Squyres wrote: The Interop Working Group (IWG) of the OpenFabrics Allianc

[OMPI users] Heterogeneous OpenFabrics hardware

2009-01-26 Thread Jeff Squyres
The Interop Working Group (IWG) of the OpenFabrics Alliance asked me to bring a question to the Open MPI user and developer communities: is anyone interested in having a single MPI job span HCAs or RNICs from multiple vendors? (pardon the cross-posting, but I did want to ask each group sep