Hi,

below is an exception I get from one Solr core. According to https://issues.apache.org/jira/browse/LUCENE-5617 the check that leads to the exception was introduced recently.

Two things are worth mentioning:

a) contrary to the expectation expressed in the message (file truncated?), the actual file length is *greater* than the expected length.

b) the actual length is 2966208512=0xB0CC_C000 which looks like rounded up to a page size of 4096 bytes.

The code leading to the exception is (http://svn.apache.org/viewvc/lucene/dev/trunk/lucene/core/src/java/org/apache/lucene/codecs/compressing/CompressingStoredFieldsReader.java?view=markup&pathrev=1592731)

if (maxPointer + CodecUtil.footerLength() != fieldsStream.length()) {
throw new CorruptIndexException("Invalid fieldsStream maxPointer (file truncated?): maxPointer=" + maxPointer + ", length=" + fieldsStream.length());
}


Without delving further into the code, can anyone comment on the chance this is actually a bug? Should the test possibly be '<' instead of '!=' because fieldsStream.length() is an OS-backed size that may report the fully allocated disk space rounded upwards to 4k pages? (Just guessing?)

The Lucene version is the one shipped with solr 4.8.1.

Here is the exception:

Caused by: org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream maxPointer (file truncated?): maxPointer=2966205946, length=2966208512 at org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:136) at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113) at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:129) at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:101) at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:142) at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:236) at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:99) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:385) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:112) at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:41)
        at org.apache.solr.core.SolrCore$2.call(SolrCore.java:815)
        at org.apache.solr.core.SolrCore$2.call(SolrCore.java:808)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1509)

Cheers,
Harald.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to