On Nov 15, 10:06 pm, John Nagle <na...@animats.com> wrote: > On 11/14/2010 11:08 AM, Artur Siekielski wrote: > > > Hi. > > I'm using CPython 2.7 and Linux. In order to make parallel > > computations on a large list of objects I want to use multiple > > processes (by using multiprocessing module). In the first step I fill > > the list with objects and then I fork() my worker processes that do > > the job. > > > This should work optimally in the aspect of memory usage because Linux > > implements copy-on-write in forked processes. > > There used to be a memory leak when using Pickle to talk > to subprocesses. See what I wrote at
It's something different - I'm not using serialization at all - I have full Python objects "copied" into child processes :). -- http://mail.python.org/mailman/listinfo/python-list
