Re: Indexing slows down considerably after a few million documents

2006-10-27 Thread Yonik Seeley
Hi Mekin, A couple of things: - You might try increasing maxBufferedDocs to 1000 or so (depending on your document size). That controls the size of the smallest segments and will decrease the numer of merges you end up doing. - Try using the trunk lucene version... it has indexing enhancements l

Re: Indexing slows down considerably after a few million documents

2006-10-27 Thread Shane
Are you doing all 7 million docs with the same writer? The call to optimize will take longer as your index size increases. So if you are actually indexing your docs in smaller chunks, the speed will decrease due to the call to optimize. Mekin Maheshwari wrote: I am creating an index of abou