Re: multiprocessing speedup

2015-09-29 Thread Rita
Thanks for the responses. I will create another thread to supply a more realistic example. On Tue, Sep 29, 2015 at 10:12 AM, Oscar Benjamin wrote: > On Tue, 29 Sep 2015 at 02:22 Rita wrote: > >> I am using the multiprocessing with apply_async to do some work. Each >> task takes a few seconds

Re: multiprocessing speedup

2015-09-29 Thread Oscar Benjamin
On Tue, 29 Sep 2015 at 02:22 Rita wrote: > I am using the multiprocessing with apply_async to do some work. Each task > takes a few seconds but I have several thousand tasks. I was wondering if > there is a more efficient method and especially when I plan to operate on a > large memory arrays (n

Re: multiprocessing speedup

2015-09-29 Thread Peter Otten
Rita wrote: > I am using the multiprocessing with apply_async to do some work. Each task > takes a few seconds but I have several thousand tasks. I was wondering if > there is a more efficient method and especially when I plan to operate on > a > large memory arrays (numpy) > > Here is what I ha

multiprocessing speedup

2015-09-28 Thread Rita
I am using the multiprocessing with apply_async to do some work. Each task takes a few seconds but I have several thousand tasks. I was wondering if there is a more efficient method and especially when I plan to operate on a large memory arrays (numpy) Here is what I have now import multiproces