[
https://issues.apache.org/jira/browse/LUCENE-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078063#comment-14078063
]
ASF GitHub Bot commented on LUCENE-5857:
----------------------------------------
GitHub user cpoerschke opened a pull request:
https://github.com/apache/lucene-solr/pull/76
LUCENE-5857: genLookaheadCountLimit configurable, add genLookbackCountLimit
https://issues.apache.org/jira/i#browse/LUCENE-5857
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bloomberg/lucene-solr trunk-gen-look-lucene
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/lucene-solr/pull/76.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #76
----
commit 47693ccdef418de0d3bb419a5071516e203a1de6
Author: Christine Poerschke <[email protected]>
Date: 2014-06-17T18:40:48Z
lucene: make genLookaheadCountLimit configurable, add genLookbackCountLimit
parameter
The problem we saw was that an error-in-final-commit during solr-shutdown
led to a corrupted segments_.... file which prevented subsequent solr-start,
details below.
this change:
* adds genLookbackCountLimit similar to the existing genLookaheadCountLimit
* makes both parameters configurable (initial values defaulted to existing
behaviour)
error-in-final-commit result:
* segments_2fi5 file present and zero-bytes long
* segments_2fi4 file absent on disk (speculation: 2fi4 was result of
in-memory segment merging)
* segments_2fi3 file present and usable (but not found by existing
looking-logic)
* segments.gen file referenced 2fi3
solr-start failure details:
ERROR [coreLoadExecutor-4-thread-6] o.a.s.c.CoreContainer
[CoreContainer.java:910] Unable to create core: collection_shard_replica
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:858)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:641)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:556)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:261)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:253)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[na:1.7.0_10]
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[na:1.7.0_10]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[na:1.7.0_10]
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[na:1.7.0_10]
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[na:1.7.0_10]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[na:1.7.0_10]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[na:1.7.0_10]
at java.lang.Thread.run(Thread.java:722) [na:1.7.0_10]
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1550)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1662)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:838)
... 12 common frames omitted
Caused by: java.io.EOFException: read past EOF:
MMapIndexInput(path="/dir/collection_shard_replica/data/index.YYYYMMDDHHMMSSMMM/segments_2fi5")
at
org.apache.lucene.store.ByteBufferIndexInput.readByte(ByteBufferIndexInput.java:78)
at
org.apache.lucene.store.BufferedChecksumIndexInput.readByte(BufferedChecksumIndexInput.java:41)
at org.apache.lucene.store.DataInput.readInt(DataInput.java:96)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:331)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:416)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:864)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:710)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:412)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:749)
at
org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:77)
at
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64)
at
org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:267)
at
org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:110)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1513)
... 14 common frames omitted
ERROR [coreLoadExecutor-4-thread-6] o.a.s.c.CoreContainer
[SolrException.java:120] null:org.apache.solr.common.SolrException: Unable to
create core: collection_shard_replica
at
org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:911)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:568)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:261)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:253)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:858)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:641)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:556)
... 10 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1550)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1662)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:838)
... 12 more
----
> make genLookaheadCountLimit configurable, add genLookbackCountLimit parameter
> -----------------------------------------------------------------------------
>
> Key: LUCENE-5857
> URL: https://issues.apache.org/jira/browse/LUCENE-5857
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Christine Poerschke
>
> The problem we saw was that an error-in-final-commit during solr-shutdown led
> to a corrupted segments_.... file which prevented subsequent solr-start,
> details below.
> this change:
> * adds genLookbackCountLimit similar to the existing genLookaheadCountLimit
> * makes both parameters configurable (initial values defaulted to existing
> behaviour)
> error-in-final-commit result:
> * segments_2fi5 file present and zero-bytes long
> (https://issues.apache.org/jira/i#browse/SOLR-6296 concerns root cause)
> * segments_2fi4 file absent on disk (speculation: 2fi4 was result of
> in-memory segment merging)
> * segments_2fi3 file present and usable (but not found by existing
> looking-logic)
> * segments.gen file referenced 2fi3
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
