Re: [OMPI users] Invalid results with OpenMPI on Ubuntu Artful because of --enable-heterogeneous

2017-11-13 Thread Gilles Gouaillardet
Xavier, i confirm there is a bug when using MPI_ANY_SOURCE with Open MPI configure'd with --enable-heterogeneous i made https://github.com/open-mpi/ompi/pull/4501 in order to fix that, and will merge and backport once reviewed Cheers, Gilles On Mon, Nov 13, 2017 at 8:46 AM, Gilles Gouaillarde

Re: [OMPI users] Invalid results with OpenMPI on Ubuntu Artful because of --enable-heterogeneous

2017-11-13 Thread Gilles Gouaillardet
Xavier, thanks for the report, i will have a look at it. is the bug triggered by MPI_ANY_SOURCE ? /* e.g. does it work if you MPI_Irecv(..., myrank, ...) ? */ Unless ubuntu wants out of the box support between heterogeneous nodes (for example x86_64 and ppc64), there is little to no point in co

Re: [OMPI users] Failed to register memory (openmpi 2.0.2)

2017-11-13 Thread Mark Dixon
Hi there, We're intermittently seeing messages (below) about failing to register memory with openmpi 2.0.2 on centos7 / Mellanox FDR Connect-X 3 / 24 core 126G RAM Broadwell nodes and the vanilla IB stack as shipped by centos. (We previously seen similar messages for the "ud" oob component bu

[OMPI users] Invalid results with OpenMPI on Ubuntu Artful because of --enable-heterogeneous

2017-11-13 Thread Xavier Besseron
Dear all, I want to share with you the follow issue with the OpenMPI shipped with the latest Ubuntu Artful. It is OpenMPI 2.1.1 compiled with option --enable-heterogeneous. Looking at this issue https://github.com/open-mpi/ompi/issues/171, it appears that this option is broken and should not be u

Re: [OMPI users] usNIC BTL unrecognized payload type 255 when running under SLURM srun nut not mpiexec/mpirun

2017-11-13 Thread Forai,Petar
One more thing to add, this is 100% reproducible when running with srun and no output when running with mpirun: Mpiexec [adm_forai@login-01 ~]$ srun -N 2 -n 2 --pty bash [adm_forai@cn-21 ~]$ mpiexec -np 2 IMB-MPI1 PingPong libibverbs: Warning: no node_type attr under /sys/class/infiniband/usnic_0