On Wed, Apr 22, 2015 at 8:11 AM, Rustom Mody <rustompm...@gmail.com> wrote:
> On Wednesday, April 22, 2015 at 4:07:35 PM UTC+5:30, Cem Karan wrote: > > Hi all, I need some help. I'm working on a simple event-based simulator > for my dissertation research. The simulator has state information that I > want to analyze as a post-simulation step, so I currently save (pickle) the > entire simulator every time an event occurs; this lets me analyze the > simulation at any moment in time, and ask questions that I haven't thought > of yet. The problem is that pickling this amount of data is both > time-consuming and a space hog. This is true even when using bz2.open() to > create a compressed file on the fly. > > No answer to your questions... > But you do know that bzip is rather worse than gzip in time > and not really so much better in space dont you?? > http://tukaani.org/lzma/benchmarks.html > I had no idea, I'll try my tests using gzip as well, just to see. That said, I could still use the diff between object graphs; saving less state is definitely going to be a speed/space improvement over saving everything! Thanks, Cem Karan
-- https://mail.python.org/mailman/listinfo/python-list
