Re: ZipFile directory implementation

2009-03-09 Thread Michael McCandless
tsuraan wrote: Sounds interesting. Can you tell us a bit more about the use case for it? Is it basically you are in a situation where you can't unzip the index? Indices compress pretty nicely: 30% to 50% in my experience. So, if youre indices are read-only anyhow (mine aren't live; we

Re: ZipFile directory implementation

2009-03-09 Thread tsuraan
> Also, have you looked at how it performs? Just making a directory of 1,000,000 documents and reading from it, it looks like this implementation is probably unbearably slow, unless Lucene has some really good caching. ZipFile gives InputStreams for the zip contents, and InputStreams don't suppor

Re: ZipFile directory implementation

2009-03-09 Thread tsuraan
> Sounds interesting. Can you tell us a bit more about the use case for it? Is it basically you are in a situation where you can't unzip the index? Indices compress pretty nicely: 30% to 50% in my experience. So, if youre indices are read-only anyhow (mine aren't live; we do batch jobs to modif

Re: ZipFile directory implementation

2009-03-08 Thread Grant Ingersoll
Hi, Sounds interesting. Can you tell us a bit more about the use case for it? Is it basically you are in a situation where you can't unzip the index? Also, have you looked at how it performs? -Grant On Mar 6, 2009, at 5:02 PM, tsuraan wrote: I wrote a really basic read-only Directory