Re: Multiprocessing vs subprocess

2019-03-13 Thread oliver
With multiprocessing you can take advantage of multi-core processing as it launches a separate python interpreter process and communicates with it via shared memory (at least on windows). The big advantage of multiprocessing module is that the interaction between processes is much richer than subpr

RE: Multiprocessing vs subprocess

2019-03-12 Thread Schachner, Joseph
Re: " My understanding (so far) is that the tradeoff of using multiprocessing is that my manager script can not exit until all the work processes it starts finish. If one of the worker scripts locks up, this could be problematic. Is there a way to use multiprocessing where processes are launched

Re: Multiprocessing vs subprocess to run Python scripts in parallel

2019-03-12 Thread Chris Angelico
On Wed, Mar 13, 2019 at 2:01 AM Malcolm Greene wrote: > > Use case: I have a Python manager script that monitors several conditions > (not just time based schedules) that needs to launch Python worker scripts to > respond to the conditions it detects. Several of these worker scripts may end > u

Multiprocessing vs subprocess to run Python scripts in parallel

2019-03-12 Thread Malcolm Greene
Use case: I have a Python manager script that monitors several conditions (not just time based schedules) that needs to launch Python worker scripts to respond to the conditions it detects. Several of these worker scripts may end up running in parallel. There are no dependencies between individu