Try 1) reducing the RAM buffer of your IndexWriter (IndexWriter.setRAMBufferSizeMB), 2) using a term divisor when opening your reader (pass 2 or 3 or 4 as termInfosIndexDivisor when opening IndexReader), and 3) disabling norms or not indexing as many fields as possible.
70Mb is not that much RAM to work with, but, for only 80K docs it should be possible as long as the docs are not large. Mike http://blog.mikemccandless.com On Mon, Apr 4, 2011 at 6:39 AM, Claudio R <user...@yahoo.com.br> wrote: > Hi, > > I am using Lucene 2.9.4 with FSDirectory. > My index has 80 thousand documents (each document has 12 fields). > My jvm has 70Mb of RAM memory (limited by my hosting). > I am getting various OutOfMemoryError. > I ran jmap and I got: > > num #instances #bytes Class description > -------------------------------------------------------------------------- > 1: 275926 32074080 char[] > 2: 657724 31570752 > org.apache.lucene.index.FreqProxTermsWriter$PostingList > 3: 200 16094896 org.apache.lucene.index.RawPostingList[] > > The Lucene is > consuming 47Mb of RAM memory. > Why there is this excessive memory consumption in FSDirectory? > Is it correct? > Thanks. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
