Re: cdb/Storable (Was: Storable Freeze/thaw ....)

2005-09-19 Thread Perrin Harkins
On Mon, 2005-09-19 at 13:09 -0700, Bill Whillers wrote: > So at what point (1k, 10k, 100k) might the overhead of a decompress on a > frozen chunk make real sense? You have to benchmark it yourself with your own data and network to see. - Perrin

Re: cdb/Storable (Was: Storable Freeze/thaw ....)

2005-09-19 Thread Bill Whillers
Thanks Perrin, > Compression (using zlib) tends to speed things up a bit. So at what point (1k, 10k, 100k) might the overhead of a decompress on a frozen chunk make real sense? -- If we compressed every frozen 1k item (requiring decompress everytime), might this only add unnecessary overhead?

Re: cdb/Storable (Was: Storable Freeze/thaw ....)

2005-09-19 Thread Perrin Harkins
On Mon, 2005-09-19 at 12:02 -0700, Bill Whillers wrote: > From what I've learned (mostly from the generous people on this list), our > local mysql, Storable and other usages does a great job at meeting those > needs. In reality, the ideal case would be if our data were non-changing and > could