Supun,
Can you provide more information about the tests like the InfiniBand
and Ethernet hardware you're testing on? I'd also suggest trying
the NetPIPE benchmark and posting the graphs for MPI tests over
both InfiniBand and Ethernet. NetPIPE can also test directly at the
InfiniBand layer so you can see if anything is wrong there.
http://netpipe.cs.ksu.edu/
Dave Turner
> Message: 1
> Date: Thu, 22 Mar 2018 09:31:54 +0900
> From: Gilles Gouaillardet <gil...@rist.or.jp>
> To: users@lists.open-mpi.org
> Subject: Re: [OMPI users] OpenMPI slow with Infiniband
> Message-ID: <95d7fb91-9340-9c90-75e9-0ac217aa4...@rist.or.jp>
> Content-Type: text/plain; charset=utf-8; format=flowed
>
> Supun,
>
>
> did you configure Open MPI with --disable-dlopen ?
>
> It was previously reported that this option disable the patcher (memory
> registration),
>
> which impacts performance negatively.
>
>
> If yes, then I suggest you reconfigure (and rebuild) without this option
> and see if it helps
>
>
> Cheers,
>
>
> Gilles
>
>
> On 3/21/2018 2:46 AM, Supun Kamburugamuve wrote:
> > Hi,
> >
> > I'm trying to run a small benchmark with Infiniband and Ethernet to
> > see the difference. I get strange results where OpenMPI seems to be
> > slower with Infiniband than Ethernet. I'm using the 3.0.0 version.
> >
> > Using the following parameters to enable Ethernet.
> >
> > --mca btl ^openib --mca btl_tcp_if_include 172.29.200.0/22
> > <http://172.29.200.0/22>
> >
> > The slowdown is significant and I cannot explain why. Infiniband seems
> > to be working fine. I ran some benchmarks on IB and it performs as
> > expected.
> >
> > Thanks,
> > Supun..
> >
> >
> >
> > _______________________________________________
> > users mailing list
> > users@lists.open-mpi.org
> > https://lists.open-mpi.org/mailman/listinfo/users
>
> --
Work: davetur...@ksu.edu (785) 532-7791
2219 Engineering Hall, Manhattan KS 66506
Home: drdavetur...@gmail.com
cell: (785) 770-5929
_______________________________________________
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
