[
https://issues.apache.org/jira/browse/SOLR-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870367#comment-15870367
]
Steve Rowe commented on SOLR-10114:
-----------------------------------
{{git bisect}} points the finger at the
{{99188ae00c0c46d9af47b9773d492de40de4aa83}} commit under this issue for a
reproducing {{TestRecovery}} failures - all three succeed just before this
commit and fail after it. I had to remove the
{{-Dtests.method=testCorruptLog}} cmdline param to get these to reproduce, so
maybe there's some method order dependence here?:
[https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18975/]:
{noformat}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRecovery
-Dtests.method=testCorruptLog -Dtests.seed=87E0BD7E2E527DCE
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sah-RU
-Dtests.timezone=America/North_Dakota/Center -Dtests.asserts=true
-Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 1.29s J1 | TestRecovery.testCorruptLog <<<
[junit4] > Throwable #1: java.lang.RuntimeException: mismatch: '3'!='0' @
response/numFound
[junit4] > at
__randomizedtesting.SeedInfo.seed([87E0BD7E2E527DCE:753D09ADD46A2C12]:0)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1006)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:953)
[junit4] > at
org.apache.solr.search.TestRecovery.testCorruptLog(TestRecovery.java:1274)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at
java.base/java.lang.reflect.Method.invoke(Method.java:543)
[...]
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70):
{val_i=Lucene50(blocksize=128), _root_=PostingsFormat(name=Direct),
id=Lucene50(blocksize=128)},
docValues:{_version_=DocValuesFormat(name=Lucene70),
val_i_dvo=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1693,
maxMBSortInHeap=6.736398983719205, sim=RandomSimilarity(queryNorm=true): {},
locale=sah-RU, timezone=America/North_Dakota/Center
[junit4] 2> NOTE: Linux 4.4.0-53-generic i386/Oracle Corporation 9-ea
(32-bit)/cpus=12,threads=1,free=183244888,total=536870912
{noformat}
[https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1136/]:
{noformat]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRecovery
-Dtests.method=testCorruptLog -Dtests.seed=79A0B057C8C8D5DB -Dtests.slow=true
-Dtests.locale=ar-OM -Dtests.timezone=Asia/Krasnoyarsk -Dtests.asserts=true
-Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.45s J1 | TestRecovery.testCorruptLog <<<
[junit4] > Throwable #1: java.lang.RuntimeException: mismatch: '3'!='0' @
response/numFound
[junit4] > at
__randomizedtesting.SeedInfo.seed([79A0B057C8C8D5DB:8B7D048432F08407]:0)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1006)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:953)
[junit4] > at
org.apache.solr.search.TestRecovery.testCorruptLog(TestRecovery.java:1274)
[...]
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70):
{val_i=BlockTreeOrds(blocksize=128),
_root_=PostingsFormat(name=LuceneFixedGap), id=BlockTreeOrds(blocksize=128)},
docValues:{_version_=DocValuesFormat(name=Memory),
val_i_dvo=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=586,
maxMBSortInHeap=6.1661193810062755, sim=RandomSimilarity(queryNorm=false): {},
locale=ar-OM, timezone=Asia/Krasnoyarsk
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_121
(64-bit)/cpus=3,threads=1,free=163066016,total=536870912
{noformat}
[https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/3836/]:
{noformat}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRecovery
-Dtests.method=testCorruptLog -Dtests.seed=A33AFB76746001BE -Dtests.slow=true
-Dtests.locale=ar -Dtests.timezone=Universal -Dtests.asserts=true
-Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.66s J1 | TestRecovery.testCorruptLog <<<
[junit4] > Throwable #1: java.lang.RuntimeException: mismatch: '3'!='0' @
response/numFound
[junit4] > at
__randomizedtesting.SeedInfo.seed([A33AFB76746001BE:51E74FA58E585062]:0)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1006)
[junit4] > at
org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:953)
[junit4] > at
org.apache.solr.search.TestRecovery.testCorruptLog(TestRecovery.java:1274)
[...]
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70):
{val_i=BlockTreeOrds(blocksize=128),
_root_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
id=BlockTreeOrds(blocksize=128)},
docValues:{_version_=DocValuesFormat(name=Direct),
val_i_dvo=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1861,
maxMBSortInHeap=5.220105645523462, sim=RandomSimilarity(queryNorm=false): {},
locale=ar, timezone=Universal
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_121
(64-bit)/cpus=3,threads=1,free=171695816,total=536870912
{noformat}
> Reordered delete-by-query can delete or omit child documents
> ------------------------------------------------------------
>
> Key: SOLR-10114
> URL: https://issues.apache.org/jira/browse/SOLR-10114
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Affects Versions: 4.5
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Fix For: master (7.0)
>
> Attachments: SOLR-10114-2.patch, SOLR-10114-2.patch,
> SOLR-10114.patch, SOLR-10114.patch, SOLR-10114-test-cleanup.patch,
> SOLR-10114-validation.patch
>
>
> It looks like when a block of documents is indexed, child documents get no
> \_version\_ field. This means (among other potential issues) that a
> delete-by-query that is reordered will cause matching child documents to be
> deleted. DBQ normally prevents deleting newer docs by including a
> restriction on \_version\_, which doesn't work for anything lacking that
> field. Re-ordered delete-by-term of any child docs would also be affected
> (although it should be a much rarer issue.)
> The leading candidate for a fix is to use the exact same \_version\_ for all
> child docs.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
