Re: [OMPI users] Dynamically throttle/scale processes

2016-03-18 Thread Andrus, Brian Contractor
divisor changes, it can cause race conditions I don't want. Thanks for the feedback from both of you. Brian Andrus From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Gilles Gouaillardet Sent: Thursday, March 17, 2016 4:59 PM To: Open MPI Users Subject: Re: [OMPI users] Dynami

Re: [OMPI users] Dynamically throttle/scale processes

2016-03-17 Thread Gilles Gouaillardet
Brian, unlike Ralph, i will assume all your processes are MPI tasks. at first glance, the MPI philosophy is the other way around : start with mpirun -np 1 traffic_cop, and then MPI_Comm_spawn("child") when you need more workers. that being said, if you are fine with having idle children (e.g.

Re: [OMPI users] Dynamically throttle/scale processes

2016-03-17 Thread Ralph Castain
Hmmm….I haven’t heard of that specific use-case, but I have seen some similar things. Did you want the processes to be paused, or killed, when you scale down? Obviously, I’m assuming they are not MPI procs, yes? I can certainly see a way to make mpirun do it without too much fuss, though it wou

[OMPI users] Dynamically throttle/scale processes

2016-03-17 Thread Andrus, Brian Contractor
All, I have an mpi-based program that has a master process that acts as a 'traffic cop' in that it hands out work to child processes. I want to be able to dynamically throttle how many child processes are in use at any given time. For instance, if I start it with "mpirun -n 512" I could send a