On Wednesday, April 22, 2015 at 4:07:35 PM UTC+5:30, Cem Karan wrote: > Hi all, I need some help. I'm working on a simple event-based simulator for > my dissertation research. The simulator has state information that I want to > analyze as a post-simulation step, so I currently save (pickle) the entire > simulator every time an event occurs; this lets me analyze the simulation at > any moment in time, and ask questions that I haven't thought of yet. The > problem is that pickling this amount of data is both time-consuming and a > space hog. This is true even when using bz2.open() to create a compressed > file on the fly.
No answer to your questions... But you do know that bzip is rather worse than gzip in time and not really so much better in space dont you?? http://tukaani.org/lzma/benchmarks.html -- https://mail.python.org/mailman/listinfo/python-list
