Calling writer.setRamBufferSizeMB(X) won't immediately free any held
RAM; on making the next change to the index (deletion or addition) the
RAM should be freed. The workaround is to close & open a new writer.
Can you open readers to do deletion?
Mike
Ganesh wrote:
I am sharding my index database and as i move on to different
database, the memory acquired by the writer is not released and
shortly the app is crashed due to out of memory.
During indexing a particular folder, i want the RAM buffer set to
50MB, thereafter i should do only deletions and the RAM buffer
should be set to 10MB or even less 5MB. I need to someway release
the memory hold by the writer. I am refreshing my searcher often. I
need to keep open all my writers to do deletion.
writer.setRamBufferSizeMB(50)
.....
writer.setRamBufferSizeMB(5) //Whether this call will reset the
buffer. OR closing and opening writer will reset the buffer
Please let me know, is there any other way?
Regards
Ganesh
----- Original Message ----- From: "Michael McCandless" <luc...@mikemccandless.com
>
To: <java-user@lucene.apache.org>
Sent: Thursday, January 08, 2009 6:44 PM
Subject: Re: Writer memory released after flush
Opening a writer should be a very fast operation, but closing may
be costly since that does a commit() to make the changes permanent
in the IO system.
Still... if you don't need to refresh your searchers you may want
to just leave the writers open, but perhaps lower the RAM buffer
if you don't have enough memory dedicated to the JRE?
Mike
Ganesh wrote:
Whether it will be a good idea to open writer only when required.
Whether opening writer will take some time as like searcher?
Whether to initialize writer will take some time?
Regards
Ganesh
----- Original Message ----- From: "Michael McCandless"
<luc...@mikemccandless.com
>
To: <java-user@lucene.apache.org>
Sent: Thursday, January 08, 2009 3:52 PM
Subject: Re: Writer memory released after flush
IndexWriter holds onto the memory & recycles it. It's best to
close the writer if you need to release the memory.
Mike
Ganesh wrote:
I am maintaing multiple indexes and all writers will be
opened. Based on some criteria, the document is added to a
particular index. I am using 50 MB of RAM buffer size. Whether
the buffer will be released once flush or optinization done or
the writer will maintain the memory and recyle it.
Regards
Ganesh
Send instant messages to your online friends http://in.messenger.yahoo.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
Send instant messages to your online friends http://in.messenger.yahoo.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
Send instant messages to your online friends http://in.messenger.yahoo.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
