Re: addIndexes() is taking infinite time ...

2006-06-22 Thread Otis Gospodnetic
.apache.org Sent: Thursday, June 22, 2006 4:09:06 AM Subject: Re: addIndexes() is taking infinite time ... so how it can be ignored ?? On 6/22/06, Mike Streeton <[EMAIL PROTECTED]> wrote: > > From memory addIndexes() also does and optimization before hand, this > might be what is

Re: addIndexes() is taking infinite time ...

2006-06-22 Thread heritrix . lucene
mailto:[EMAIL PROTECTED] Sent: 22 June 2006 05:05 To: java-user@lucene.apache.org Subject: Re: addIndexes() is taking infinite time ... No. I haven't tried. Today i can try it. One thing that i m thinking is that what role does the file system plays here. I mean is there any difference on if

RE: addIndexes() is taking infinite time ...

2006-06-21 Thread Mike Streeton
Re: addIndexes() is taking infinite time ... No. I haven't tried. Today i can try it. One thing that i m thinking is that what role does the file system plays here. I mean is there any difference on if i am doing indexing on FAT32 or i am on EXT3??? i'll have to find it out Can any

Re: addIndexes() is taking infinite time ...

2006-06-21 Thread heritrix . lucene
No. I haven't tried. Today i can try it. One thing that i m thinking is that what role does the file system plays here. I mean is there any difference on if i am doing indexing on FAT32 or i am on EXT3??? i'll have to find it out Can anybody put some light on this?? With regards On 6/22/06,

Re: addIndexes() is taking infinite time ...

2006-06-21 Thread Daniel Noll
heritrix.lucene wrote: hi Otis, Now this time it took 10 Hr 34 Min. to merge the indexes. During merging i noticed it was not completey using the CPU. I have 512MB RAM. and here i found it used upto the 256 MB. Are there some more possibilities to make it more fast ... Have you tested how fast

Re: addIndexes() is taking infinite time ...

2006-06-21 Thread heritrix . lucene
hi Otis, Now this time it took 10 Hr 34 Min. to merge the indexes. During merging i noticed it was not completey using the CPU. I have 512MB RAM. and here i found it used upto the 256 MB. Are there some more possibilities to make it more fast ... With Regards, On 6/21/06, heritrix. lucene <[E

Re: addIndexes() is taking infinite time ...

2006-06-20 Thread heritrix . lucene
hi, thanks for your reply. Now i restarted my application with maxBufferedDocs=10,000. And i am sorry to say that i was adding those indexes one by one. :-) Anyway Can you please explain me the addIndex ? I want to know what exactly happens while adding these.. With Regards, On 6/20/06, Otis G

Re: addIndexes() is taking infinite time ...

2006-06-20 Thread Otis Gospodnetic
If you can tell how many indices you've merged, you must be mering them one at a time, and the pre and post merge optimize() calls are costing you. Also, that maxBufferedDocs looks pretty low. Unless you are working with very large documents and small heap, you should be able to bump that up mu

Re: addIndexes() is taking infinite time ...

2006-06-20 Thread Volodymyr Bychkoviak
I guess that you're adding those indexes one by one.. You should add all indexes at once rather then adding them one by one. addIndexes() method takes array of directories/readers to add indexes. IndexWriter performs optimize() after adding indexes, so with your big index it can take long enoug