Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

sed nor have I asked about the use of --enable-static for their 1.3.2 configurations. I will have to follow-up on that. Jim On Wed, 2009-06-24 at 19:30 -0400, Gus Correa wrote: > Hi Jim > > Jim Kress ORG wrote: > > Hey Gus. I was correct. > > > > If I did: >

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

Hey Gus. I was correct. If I did: ./configure --prefix=/my/dir --with-openib=/usr --enable-static make all install then reboot and use mpi-selector to choose openmpi-1.3.2, and then: [root@master ~]# ompi_info --config Configured by: root Configured on: Wed Jun 24 18:02:0

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2forcing all MPI traffic over Ethernet instead of using Infiniband

Well, the whole situation is really bizarre. I just uninstalled openmpi 1.3.2 on my system. Then I installed OFED 1.4.1 to see if that resolves this situation. Here's what I get: [root@master ~]# ompi_info --config Configured by: root Configured on: Wed Jun 24 11:10:00 EDT

Re: [OMPI users] 50% performance reduction due toOpenMPI v 1.3.2 forcing all MPI traffic over Ethernet insteadof using Infiniband

until v1.3.2 -- if the > executable was compiled/linked against any version prior to that, it's > pure luck that it works with the 1.3.2 shared libraries at all. > > > On Jun 23, 2009, at 7:25 PM, Jim Kress ORG wrote: > > > This is what I get > &g

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

This is what I get [root@master ~]# ompi_info | grep openib MCA btl: openib (MCA v2.0, API v2.0, Component v1.3.2) [root@master ~]# Jim On Tue, 2009-06-23 at 18:51 -0400, Jeff Squyres wrote: > openib (OpenFabrics) plugin is installed > and at least marginally opera

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

.3.2, or > 1.2.8? I see a 1.2.8 in your app name, hence the question. > > This option only works with 1.3.2, I'm afraid - it was a new feature. > > Ralph > > On Jun 23, 2009, at 2:31 PM, Jim Kress ORG wrote: > > > Ralph, > > > > I did the following

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

. > > This option only works with 1.3.2, I'm afraid - it was a new feature. > > Ralph > > On Jun 23, 2009, at 2:31 PM, Jim Kress ORG wrote: > > > Ralph, > > > > I did the following: > > > > export OMPI_MCA_mpi_show_mca_params=&q

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

he MCA param that you think it is. Try adding: > > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

tting the MCA param that you think it is. Try adding: > > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > >

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

; > -mca mpi_show_mca_params file,env > > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun 22, 2009, at 6:14 PM, Jim Kress ORG wrote: > >

Re: [OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

gt; > to your cmd line. This will cause rank=0 to output the MCA params it > thinks were set via the default files and/or environment (including > cmd line). > > Ralph > > On Jun 22, 2009, at 6:14 PM, Jim Kress ORG wrote: > > > For the app I am using, ORCA (a Qu

[OMPI users] 50% performance reduction due to OpenMPI v 1.3.2 forcing all MPI traffic over Ethernet instead of using Infiniband

For the app I am using, ORCA (a Quantum Chemistry program), when it was compiled using openMPI 1.2.8 and run under 1.2.8 with the following in the openmpi-mca-params.conf file: btl=self,openib the app ran fine with no traffic over my Ethernet network and all traffic over my Infiniband network. H