Re: [OMPI users] Using Open MPI as a communication library

You still need a rendezvous of some kind for comm_connect to work. If you want to try using the file-based method from early MPI days, you can try it - haven’t seen anyone test it in some time, and so I honestly don’t know if it will work. You’d still require some way of telling the application

Re: [OMPI users] Using Open MPI as a communication library

I guess this is client server. Can we do communications collective communications with this approach? Thanks, Supun.. On Fri, Jul 8, 2016 at 5:37 PM, Jeff Hammond wrote: > Why wouldn't https://www.open-mpi.org/doc/v1.8/man3/MPI_Comm_connect.3.php > and friends work after MPI_Init is called, reg

Re: [OMPI users] Using Open MPI as a communication library

Why wouldn't https://www.open-mpi.org/doc/v1.8/man3/MPI_Comm_connect.3.php and friends work after MPI_Init is called, regardless of how the process is spawned? Jeff On Fri, Jul 8, 2016 at 9:55 AM, Ralph Castain wrote: > You’d need to have some rendezvous mechanism. I suppose one option would >

Re: [OMPI users] Using Open MPI as a communication library

Thanks Ralph. Will have a look in these. Supun.. On Fri, Jul 8, 2016 at 1:05 PM, Ralph Castain wrote: > I don’t know anything about ZooKeeper. You would need another plugin to > support it, probably down in the OPAL pmix framework I suppose. > > There is a list of info you’d have to get from it

Re: [OMPI users] Using Open MPI as a communication library

I don’t know anything about ZooKeeper. You would need another plugin to support it, probably down in the OPAL pmix framework I suppose. There is a list of info you’d have to get from it: https://github.com/pmix/master/wiki/2.8-Pmix-Server-Data-Requirements

Re: [OMPI users] Using Open MPI as a communication library

I would like to discover the processes using a ZooKeeper server. The purpose is to use MPI as a communication library for applications managed by a resource manager such as Mesos or Yarn. Thanks, Supun.. On Fri, Jul 8, 2016 at 12:55 PM, Ralph Castain wrote: > You’d need to have some rendezvous

Re: [OMPI users] Using Open MPI as a communication library

You’d need to have some rendezvous mechanism. I suppose one option would be to launch a set of PMIx servers on the nodes (and ensure they know about each other) to support these things, but that’s all mpirun really does anyway. What did you have in mind? > On Jul 8, 2016, at 9:49 AM, Supun Kam

Re: [OMPI users] Using Open MPI as a communication library

Thanks for the quick response. Is there a way for extending OpenMPI so that it can discover the processes using other means? Supun. On Fri, Jul 8, 2016 at 12:45 PM, Ralph Castain wrote: > If not spawned by mpirun, and not spawned by a resource manager, then it > won’t work. There is no way for

Re: [OMPI users] Using Open MPI as a communication library

If not spawned by mpirun, and not spawned by a resource manager, then it won’t work. There is no way for the procs to wireup. > On Jul 8, 2016, at 9:42 AM, Supun Kamburugamuve > wrote: > > Yes, the processes are not spawned by MPI and they are not spawned by > something like Slurm/PBS. > >

Re: [OMPI users] Using Open MPI as a communication library

Yes, the processes are not spawned by MPI and they are not spawned by something like Slurm/PBS. How does MPI get to know what processes running in what nodes in a general sense? Do we need to write some plugin so that it can figure out this information? I guess this must be the way it is supportin

Re: [OMPI users] Using Open MPI as a communication library

You mean you didn’t launch those procs via mpirun, yes? If you started them via some resource manager, then you might just be able to call MPI_Init and have them wireup. > On Jul 8, 2016, at 8:55 AM, Supun Kamburugamuve > wrote: > > Hi, > > I have a set of processes running and these are no