Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-12-04 Thread Nathan Hjelm
This is not fixed in the trunk. At this time MPI_THREAD_MULTIPLE will always hang (though there may be some configurations that don't.) The problem is when multiple threads are active opal_condition_wait ALWAYS blocks on a condition variable instead of calling opal_progress(). Thus we will not p

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-12-04 Thread Dominique Orban
I built the 1.7.x nightly tar ball on 10.8 (Mountain Lion) and 10.9 (Mavericks) and it still hangs. I tried compiling with --enable-mpi-thread-multiple only and with the other options Pierre mentioned. The PETSc tests hang in both cases. I'm curious to know if the nightly tar ball fixes the issu

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple -- part II

2013-12-02 Thread Ralph Castain
No surprise there - that's known behavior. As has been said, we hope to extend the thread-multiple support in the 1.9 series. On Mon, Dec 2, 2013 at 6:33 PM, Eric Chamberland < eric.chamberl...@giref.ulaval.ca> wrote: > Hi, > > I just open a new "chapter" with the same subject. ;-) > > We are u

[OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple -- part II

2013-12-02 Thread Eric Chamberland
Hi, I just open a new "chapter" with the same subject. ;-) We are using OpenMPI 1.6.5 (compiled with --enable-thread-multiple) with Petsc 3.4.3 (on colosse supercomputer: http://www.calculquebec.ca/en/resources/compute-servers/colosse). We observed a deadlock with threads within the openib bt

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-12-02 Thread Jeff Squyres (jsquyres)
I'm joining this thread late, but I think I know what is going on: - I am able to replicate the hang with 1.7.3 on Mavericks (with threading enabled, etc.) - I notice that the hang has disappeared at the 1.7.x branch head (also on Mavericks) Meaning: can you try with the latest 1.7.x nightly ta

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-25 Thread Dominique Orban
On 2013-11-25, at 9:02 PM, Ralph Castain wrote: > On Nov 25, 2013, at 5:04 PM, Pierre Jolivet wrote: > >> >> On Nov 24, 2013, at 3:03 PM, Jed Brown wrote: >> >>> Ralph Castain writes: >>> Given that we have no idea what Homebrew uses, I don't know how we could clarify/respond. >

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-25 Thread Ralph Castain
Sent from my iPhone > On Nov 25, 2013, at 5:04 PM, Pierre Jolivet wrote: > > >> On Nov 24, 2013, at 3:03 PM, Jed Brown wrote: >> >> Ralph Castain writes: >> >>> Given that we have no idea what Homebrew uses, I don't know how we >>> could clarify/respond. > > Ralph, it is pretty easy to k

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-25 Thread Pierre Jolivet
On Nov 24, 2013, at 3:03 PM, Jed Brown wrote: > Ralph Castain writes: > >> Given that we have no idea what Homebrew uses, I don't know how we >> could clarify/respond. > Ralph, it is pretty easy to know what Homebrew uses, c.f. https://github.com/mxcl/homebrew/blob/master/Library/Formula/op

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-24 Thread Jed Brown
Ralph Castain writes: > Given that we have no idea what Homebrew uses, I don't know how we > could clarify/respond. Pierre provided a link to MacPorts saying that all of the following options were needed to properly enable threads. --enable-event-thread-support --enable-opal-multi-threads --e

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-24 Thread Ralph Castain
Given that we have no idea what Homebrew uses, I don't know how we could clarify/respond. On Nov 24, 2013, at 12:43 PM, Jed Brown wrote: > Pierre Jolivet writes: >> It looks like you are compiling Open MPI with Homebrew. The flags they use >> in the formula when --enable-mpi-thread-multiple

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-24 Thread Jed Brown
Dominique Orban writes: > My question originates from a hang similar to the one I described in > my first message in the PETSc tests. They still hang after I corrected > the OpenMPI compile flags. I'm in touch with the PETSc folks as well > about this. Do you have an updated stack trace? pgpg26

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-24 Thread Jed Brown
Pierre Jolivet writes: > It looks like you are compiling Open MPI with Homebrew. The flags they use in > the formula when --enable-mpi-thread-multiple is wrong. > c.f. a similar problem with MacPorts > https://lists.macosforge.org/pipermail/macports-tickets/2013-June/138145.html. If these "wron

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-24 Thread Dominique Orban
Pierre, Thank you for pointing out the erroneous flags. I am indeed compiling from Homebrew. After using the flags mentioned in the link you give, this is the output of Ralph's test program: $ mpirun -n 2 ./testmpi2 Calling MPI_Init_thread... Calling MPI_Init_thread... MPI_Init_thread returned,

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-23 Thread Pierre Jolivet
Dominique, It looks like you are compiling Open MPI with Homebrew. The flags they use in the formula when --enable-mpi-thread-multiple is wrong. c.f. a similar problem with MacPorts https://lists.macosforge.org/pipermail/macports-tickets/2013-June/138145.html. Pierre On Nov 23, 2013, at 4:56 PM

Re: [OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-23 Thread Ralph Castain
Hmmm...well, it seems to work for me: $ mpirun -n 4 ./thread_init Calling MPI_Init_thread... Calling MPI_Init_thread... Calling MPI_Init_thread... Calling MPI_Init_thread... MPI_Init_thread returned, provided = 3 MPI_Init_thread returned, provided = 3 MPI_Init_thread returned, provided = 3 MPI_Ini

[OMPI users] MPI process hangs if OpenMPI is compiled with --enable-thread-multiple

2013-11-21 Thread Dominique Orban
Hi, I'm compiling the example code at the bottom of the following page that illustrates MPI_Init_Thread(): http://mpi.deino.net/mpi_functions/mpi_init_thread.html I have OpenMPI 1.7.3 installed on OSX 10.8.5 with --enable-thread-multiple compiled with clang-425.0.28. I can reproduce t