Re: Seeking advice on index parameter settings for large index

2005-03-30 Thread Doug Cutting
Chuck Williams wrote: index.setMaxBufferedDocs(10); // Buffer 10 documents at a time in memory (they could be big) You might use a larger value here for the index with the small documents. I've sucessfully used values as high as a 1000 when indexing documents that average a few kilobyte

Seeking advice on index parameter settings for large index

2005-03-29 Thread Chuck Williams
I'm preparing to help a company run a scalability test and decide whether or not to use Lucene. Relevant particulars for the test include: 1. 2 pairs of indices. Each pair has 1 index with about 7.5 million small documents and 1 index with about 1 million large documents. Each index has a s