Hi everyone
Could someone please share any experience using MPI with RoCE ?
I am trying to set up infiniband adapters (Mellanox cards for example) and
run MPI applications with RoCE (Instead of TCP).
As I understand, there might be some environment requirements or
restrictions like kernel version,
Hi Harutyun,
We use RoCE v2 using OpenMPI on our cluster, and it works great. We used to use
the openib BTL, but have moved competely across to UCX.
You have to configure RoCE on your switches and NICs (we use a mixture of
Mellanox CX-4, CX-5 and CX-6 NICs, with Mellanox switches running Cumulu
Dear Sean,
You gave me a lot of info!
Now I am going to set up RHEL7 with Mellanox OFED to test it. Before I had
setup without Mlx OFED on Ubuntu. Do you think it might cause issues ?
Also please let me know the ompi version you have used and do I understand
it right that ucx is intalled and confi
