Re: [OMPI users] Mellanox EDR performance

2017-03-07 Thread Yong Qin
OK, did some testing with MVAPICH and everything is normal so this is clearly with OMPI. Is there anything that I should try? Thanks, Yong Qin On Mon, Mar 6, 2017 at 11:46 AM, Yong Qin wrote: > Hi, > > I'm wondering if anybody who has done perf testing on Mellanox EDR with > OMPI can shed some

Re: [OMPI users] openib/mpi_alloc_mem pathology

2017-03-07 Thread Nathan Hjelm
If this is with 1.10.x or older run with --mca memory_linux_disable 1. There is a bad interaction between ptmalloc2 and psm2 support. This problem is not present in v2.0.x and newer. -Nathan > On Mar 7, 2017, at 10:30 AM, Paul Kapinos wrote: > > Hi Dave, > > >> On 03/06/17 18:09, Dave Love

Re: [OMPI users] openib/mpi_alloc_mem pathology

2017-03-07 Thread Paul Kapinos
Hi Dave, On 03/06/17 18:09, Dave Love wrote: I've been looking at a new version of an application (cp2k, for for what it's worth) which is calling mpi_alloc_mem/mpi_free_mem, and I don't Welcome to the club! :o) In our measures we see some 70% of time in 'mpi_free_mem'... and 15x performance

Re: [OMPI users] MPI_THREAD_MULTIPLE: Fatal error in MPI_Win_flush

2017-03-07 Thread Jeff Hammond
Nathan and I discussed at the MPI Forum last week. I argued that your usage is not erroneous, although certain pathological cases (likely concocted) can lead to nasty behavior. He indicated that he would remove the error check, but it may require further discussion/debate with others. You can re