I met a problem to open an index bigger than 8GB and the following
exception was thrown. There is a segment which is bigger than 4GB
already. After searching internet, it is said that not using compound
index may solve the problem.
The same exception was thrown when merging with another index happens.
If the problem is caused by the big segment, we can adjust Lucene
parameters to control the segment size.
Anyone knows what's the cause for this exception? As reproducing the
problem will take a long time, your idea will be save us a lot of
effort.
java.io.IOException: Insufficient system resources exist to complete the
requested service
at java.io.RandomAccessFile.readBytes(Native Method)
at java.io.RandomAccessFile.read(RandomAccessFile.java:315)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.readInternal(FSDirector
y.java:596)
at
org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.jav
a:157)
at
org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.j
ava:38)
at
org.apache.lucene.store.IndexInput.readVInt(IndexInput.java:78)
at
org.apache.lucene.index.CompoundFileReader.<init>(CompoundFileReader.jav
a:73)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:321)
at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:306)
at
org.apache.lucene.index.SegmentReader.get(SegmentReader.java:228)
at
org.apache.lucene.index.MultiSegmentReader.<init>(MultiSegmentReader.jav
a:55)
at
org.apache.lucene.index.DirectoryIndexReader$1.doBody(DirectoryIndexRead
er.java:104)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.j
ava:653)
at
org.apache.lucene.index.DirectoryIndexReader.open(DirectoryIndexReader.j
ava:115)
at
org.apache.lucene.index.IndexReader.open(IndexReader.java:316)
at
org.apache.lucene.index.IndexReader.open(IndexReader.java:227)
Thanks,
-Li
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org
