Re: [OMPI users] Open MPI over RoCE using breakout cable and switch

2017-01-24 Thread Brendan Myers
Hello Howard, Here is the error output after building with debug enabled. These CX4 Mellanox cards view each port as a separate device and I am using port 1 on the card which is device mlx5_0. Thank you, Brendan From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Howard

Re: [OMPI users] Startup limited to 128 remote hosts in some situations?

2017-01-24 Thread Mark Dixon
Hi, It works for me :) Thanks! Mark On Fri, 20 Jan 2017, r...@open-mpi.org wrote: Well, it appears we are already forwarding all envars, which should include PATH. Here is the qrsh command line we use: “qrsh --inherit --nostdin -V" So would you please try the following patch: diff --git

Re: [OMPI users] MPI_File_write_shared() and MPI_MODE_APPEND issue ?

2017-01-24 Thread Nicolas Joly
On Mon, Jan 23, 2017 at 09:05:44AM -0600, Edgar Gabriel wrote: > just wanted to give a brief update on this. The problem was in fact that > we did not correctly move the shared file pointer to the end of the file > when a file is opened in append mode. (The individual file pointer did > the righ

Re: [OMPI users] Open MPI over RoCE using breakout cable and switch

2017-01-24 Thread Howard Pritchard
Hello Brendan, This helps some, but looks like we need more debug output. Could you build a debug version of Open MPI by adding --enable-debug to the config options and rerun the test with the breakout cable setup and keeping the --mca btl_base_verbose 100 command line option? Thanks Howard 2