Hi Martin,
Thank you for the links, they contain a lot of useful information!
I am trying to understand more about mclapply because of mainly two cases.
1) I have a large DataFrame which I use because of the low memory footprint
and because the data is well behaved for compression using Rle's.
Hello Ryan,
Thank you for looking at the example and even forking the gist. I have
updated the example with your approach and also calculated that it uses 6.794G
RAM when starting from scratch using 20 cores and thus beating the other 3
approaches under that scenario.
Also note that just generati
On 11/14/2013 12:13 AM, Leonardo Collado Torres wrote:
Dear BioC developers,
I am trying to understand how to use mclapply() without blowing up the
memory usage and need some help.
My use case is splitting a large IRanges::DataFrame() into chunks, and
feeding these chunks to mclapply(). Let say
The minimize the additional memory used by mclapply, remember that
mclapply works by forking processes, and the advantage of this is that
as long as an object is not modified in either the parent or child,
they will share the memory for that object, which effectively means
that a child process
