Re: [OMPI users] RDMA over Ethernet in Open MPI - RoCE on AWS?

2018-09-06 Thread John Hearns via users
Ben, ping me off list. I know the guy who heads the HPC Solutions Architect team for AWS and an AWS Solutions Architect here in the UK. On Fri, 7 Sep 2018 at 03:11, Benjamin Brock wrote: > > I'm setting up a cluster on AWS, which will have a 10Gb/s or 25Gb/s Ethernet > network. Should I expect t

[OMPI users] RDMA over Ethernet in Open MPI - RoCE on AWS?

2018-09-06 Thread Benjamin Brock
I'm setting up a cluster on AWS, which will have a 10Gb/s or 25Gb/s Ethernet network. Should I expect to be able to get RoCE to work in Open MPI on AWS? More generally, what optimizations and performance tuning can I do to an Open MPI installation to get good performance on an Ethernet network?

Re: [OMPI users] Are MPI datatypes guaranteed to be compile-time constants?

2018-09-06 Thread Benjamin Brock
Thanks for the responses--from what you've said, it seems like MPI types are indeed not guaranteed to be compile-time constants. However, I worked with the people at IBM, and it seems like the difference in behavior was caused by the IBM compiler, not the Spectrum IBM implementation. Ben

Re: [OMPI users] pt2pt osc required for single-node runs?

2018-09-06 Thread Nathan Hjelm via users
You can either move to MPI_Win_allocate or try the v4.0.x snapshots. I will look at bringing the btl/vader support for osc/rdma back to v3.1.x. osc/pt2pt will probably never become truly thread safe. -Nathan On Sep 06, 2018, at 08:34 AM, Joseph Schuchart wrote: All, I installed Open MPI 3.1

[OMPI users] pt2pt osc required for single-node runs?

2018-09-06 Thread Joseph Schuchart
All, I installed Open MPI 3.1.2 on my laptop today (up from 3.0.0, which worked fine) and ran into the following error when trying to create a window: ``` -- The OSC pt2pt component does not support MPI_THREAD_MULTIPLE in