Re: outof memory error

2008-02-05 Thread Erick Erickson
See below: On Feb 5, 2008 9:41 AM, SK R <[EMAIL PROTECTED]> wrote: > Hi, > Thanks for your help Erick. > > I changed my code to flush writer before document add which helps to > reduce memory usage. > Also reducing mergefactor and max buffered docs to some level help me to > avoid this OOM

Re: outof memory error

2008-02-05 Thread SK R
Hi, Thanks for your help Erick. I changed my code to flush writer before document add which helps to reduce memory usage. Also reducing mergefactor and max buffered docs to some level help me to avoid this OOM error (eventhough index size is ~1GB). But please clarify below doubts Make s

Re: outof memory error

2008-02-04 Thread Erick Erickson
u index smaller documents? You cannot expect to index a 1G doc with 512M of memory in the JVM. The first thing I'd try is upping your JVM memory to the max your machine will accept. Make sure you flush your IndexWriter before attempting to index this document. But I would not be surprised i

outof memory error

2008-02-04 Thread SK R
Hi, I got outof memory exception while indexing huge documents (~1GB) in one thread and optimizing some other (2 to 3) indexes in different threads. Max JVM heap size is 512MB. I'm using lucene2.3.0. Please suggest a way to avoid this exception. Regards RSK