Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-16 Thread M D Jones
On Wed, 16 Jan 2008, 8mj6tc...@sneakemail.com wrote: Subject: Re: [OMPI users] mixed myrinet/non-myrinet nodes From: M D Jones (jonesm_at_[hidden]) Date: 2008-01-15 14:07:19 Hmm, that is the way that I expected it to work as well - we see the warnings also, but closely followed by the errors

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-16 Thread 8mj6tc902
> Subject: Re: [OMPI users] mixed myrinet/non-myrinet nodes > From: M D Jones (jonesm_at_[hidden]) > Date: 2008-01-15 14:07:19 > Hmm, that is the way that I expected it to work as well - > we see the warnings also, but closely followed by the > errors (I've been trying both

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread Aurélien Bouteiller
Using the --mca btl ^mx totally prevents use of mx interface. So everybody uses tcp (even mx capable nodes). If you want a mixed configuration you have to enforce use of the ob1 pml, but let the mx btl be used where it is suitable (it will be disabled at runtime if it can't run). You're pro

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread M D Jones
ey're expecting the mx library to be there, but it's not?) users-request-at-open-mpi.org |openmpi-users/Allow| wrote: Date: Tue, 15 Jan 2008 10:25:00 -0500 (EST) From: M D Jones Subject: Re: [OMPI users] mixed myrinet/non-myrinet nodes To: Open MPI Users Message-ID: Content-Type: TEXT/P

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread 8mj6tc902
e mx library to be there, but it's not?) users-request-at-open-mpi.org |openmpi-users/Allow| wrote: > Date: Tue, 15 Jan 2008 10:25:00 -0500 (EST) > From: M D Jones > Subject: Re: [OMPI users] mixed myrinet/non-myrinet nodes > To: Open MPI Users > Message-ID: > Content-T

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread Patrick Geoffray
Hi Matt, M Jones wrote: I thought that we would be able to use a single open-mpi build to support both networks (and users would be able to request mx nodes if they need them using the batch queuing system, which they are already accustomed to). Am I missing something (or just doing I don't k

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread M D Jones
Hmm, that combination seems to hang on me - but '--mca pml ob1 --mca btl ^mx' does indeed do the trick. Many thanks! Matt On Tue, 15 Jan 2008, George Bosilca wrote: This case actually works. We run into it few days ago, when we discovered that one of the compute nodes in a cluster didn't get

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread George Bosilca
This case actually works. We run into it few days ago, when we discovered that one of the compute nodes in a cluster didn't get his Myrinet card installed properly ... The performance were horrible but the application run to completion. You will have to use the following flags: --mca pml ob

Re: [OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread Gleb Natapov
On Tue, Jan 15, 2008 at 09:49:40AM -0500, M Jones wrote: > Hi, > >We have a mixed environment in which roughly 2/3 of the nodes > in our cluster have myrinet (mx 1.2.1), while the full cluster has > gigE. Running open-mpi exclusively on myrinet nodes or exclusively > on non-myrinet nodes is f

[OMPI users] mixed myrinet/non-myrinet nodes

2008-01-15 Thread M Jones
Hi, We have a mixed environment in which roughly 2/3 of the nodes in our cluster have myrinet (mx 1.2.1), while the full cluster has gigE. Running open-mpi exclusively on myrinet nodes or exclusively on non-myrinet nodes is fine, but mixing the two nodes types results in a runtime error (PML a