Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-18 Thread Pavel Shamis (Pasha)
Sent: Thursday, February 18, 2010 3:33 AM To: Open MPI Users Subject: Re: [OMPI users] Bad Infiniband latency with subounce Hey, I only may to add the XRC and RC have the same latency. What is the command line that you use to run this benchmark ? What is the system configuration (one hc

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-18 Thread Repsher, Stephen J
.org] On Behalf Of Pavel Shamis (Pasha) Sent: Thursday, February 18, 2010 3:33 AM To: Open MPI Users Subject: Re: [OMPI users] Bad Infiniband latency with subounce Hey, I only may to add the XRC and RC have the same latency. What is the command line that you use to run this benchmark ? What is the s

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-18 Thread Pavel Shamis (Pasha)
microsecs... Steve -Original Message- From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf Of Ralph Castain Sent: Monday, February 15, 2010 11:21 PM To: Open MPI Users Subject: Re: [OMPI users] Bad Infiniband latency with subounce On Feb 15, 2010, at 8:44 PM, Te

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-17 Thread Jeff Squyres
1-2 microsecs... > > Steve > > > -Original Message- > From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On > Behalf Of Ralph Castain > Sent: Monday, February 15, 2010 11:21 PM > To: Open MPI Users > Subject: Re: [OMPI users] Bad Infiniban

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-16 Thread Repsher, Stephen J
en-mpi.org] On Behalf Of Ralph Castain Sent: Monday, February 15, 2010 11:21 PM To: Open MPI Users Subject: Re: [OMPI users] Bad Infiniband latency with subounce On Feb 15, 2010, at 8:44 PM, Terry Frankcombe wrote: > On Mon, 2010-02-15 at 20:18 -0700, Ralph Castain wrote: >> Did you run

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-15 Thread Ralph Castain
On Feb 15, 2010, at 8:44 PM, Terry Frankcombe wrote: > On Mon, 2010-02-15 at 20:18 -0700, Ralph Castain wrote: >> Did you run it with -mca mpi_paffinity_alone 1? Given this is 1.4.1, you can >> set the bindings to -bind-to-socket or -bind-to-core. Either will give you >> improved performance. >

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-15 Thread Terry Frankcombe
On Mon, 2010-02-15 at 20:18 -0700, Ralph Castain wrote: > Did you run it with -mca mpi_paffinity_alone 1? Given this is 1.4.1, you can > set the bindings to -bind-to-socket or -bind-to-core. Either will give you > improved performance. > > IIRC, MVAPICH defaults to -bind-to-socket. OMPI defaults

Re: [OMPI users] Bad Infiniband latency with subounce

2010-02-15 Thread Ralph Castain
Did you run it with -mca mpi_paffinity_alone 1? Given this is 1.4.1, you can set the bindings to -bind-to-socket or -bind-to-core. Either will give you improved performance. IIRC, MVAPICH defaults to -bind-to-socket. OMPI defaults to no binding. On Feb 15, 2010, at 6:51 PM, Repsher, Stephen J