> I have some Pickled data, which is stored on disk, and it is about 100 MB in
> size.
>
> When my python program is executed, the picked data is loaded using the
> cPickle module, and all that works fine.
>
> If I execute the python multiple times using python main.py for example, each
> python
raunakgu...@gmail.com wrote:
I have some Pickled data, which is stored on disk, and it is about 100 MB in
size.
When my python program is executed, the picked data is loaded using the cPickle
module, and all that works fine.
If I execute the python multiple times using python main.py for exam
> How can I make it so, all new python process share this data, so it is only
> loaded a single time into memory?
You can have one process as server and client ask for parts of data.
You might be able to do something smart with mmap but I can't think of a way.
I Linux systems, if you first load t
