[
https://issues.apache.org/jira/browse/LUCENE-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860173#comment-16860173
]
Hoss Man commented on LUCENE-8757:
----------------------------------
another similar failure...
http://fucit.org/solr-jenkins-reports/job-data/thetaphi/Lucene-Solr-8.x-Linux/677/
https://jenkins.thetaphi.de/view/Lucene-Solr/job/Lucene-Solr-8.x-Linux/677/
{noformat}
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRegexpRandom2
-Dtests.method=testRegexps -Dtests.seed=A993DB1E59F6C2DC -Dtests.multiplier=3
-Dtests.slow=true -Dtests.locale=rn -D
tests.timezone=Africa/El_Aaiun -Dtests.asserts=true
-Dtests.file.encoding=US-ASCII
[junit4] FAILURE 0.06s J2 | TestRegexpRandom2.testRegexps <<<
[junit4] > Throwable #1: junit.framework.AssertionFailedError: Hit 9
docnumbers don't match
[junit4] > Hits length1=25 length2=25
[junit4] > hit=0: doc3=1.0 shardIndex=0, doc3=1.0 shardIndex=0
[junit4] > hit=1: doc18=1.0 shardIndex=0, doc18=1.0 shardIndex=0
[junit4] > hit=2: doc40=1.0 shardIndex=0, doc40=1.0 shardIndex=0
[junit4] > hit=3: doc81=1.0 shardIndex=0, doc81=1.0 shardIndex=0
[junit4] > hit=4: doc85=1.0 shardIndex=0, doc85=1.0 shardIndex=0
[junit4] > hit=5: doc150=1.0 shardIndex=0, doc150=1.0 shardIndex=0
[junit4] > hit=6: doc159=1.0 shardIndex=0, doc159=1.0 shardIndex=0
[junit4] > hit=7: doc165=1.0 shardIndex=0, doc165=1.0 shardIndex=0
[junit4] > hit=8: doc175=1.0 shardIndex=0, doc175=1.0 shardIndex=0
[junit4] > hit=9: doc208=1.0 shardIndex=0, doc180=1.0 shardIndex=0
[junit4] > hit=10: doc256=1.0 shardIndex=0, doc181=1.0 shardIndex=0
[junit4] > hit=11: doc270=1.0 shardIndex=0, doc208=1.0 shardIndex=0
[junit4] > hit=12: doc295=1.0 shardIndex=0, doc256=1.0 shardIndex=0
[junit4] > hit=13: doc300=1.0 shardIndex=0, doc270=1.0 shardIndex=0
[junit4] > hit=14: doc331=1.0 shardIndex=0, doc295=1.0 shardIndex=0
[junit4] > hit=15: doc347=1.0 shardIndex=0, doc300=1.0 shardIndex=0
[junit4] > hit=16: doc357=1.0 shardIndex=0, doc331=1.0 shardIndex=0
[junit4] > hit=17: doc363=1.0 shardIndex=0, doc347=1.0 shardIndex=0
[junit4] > hit=18: doc366=1.0 shardIndex=0, doc357=1.0 shardIndex=0
[junit4] > hit=19: doc385=1.0 shardIndex=0, doc363=1.0 shardIndex=0
[junit4] > hit=20: doc459=1.0 shardIndex=0, doc366=1.0 shardIndex=0
[junit4] > hit=21: doc464=1.0 shardIndex=0, doc385=1.0 shardIndex=0
[junit4] > hit=22: doc467=1.0 shardIndex=0, doc459=1.0 shardIndex=0
[junit4] > hit=23: doc489=1.0 shardIndex=0, doc464=1.0 shardIndex=0
[junit4] > hit=24: doc514=1.0 shardIndex=0, doc467=1.0 shardIndex=0
[junit4] > for query:field://
[junit4] > at
__randomizedtesting.SeedInfo.seed([A993DB1E59F6C2DC:48CF9A0F875C9554]:0)
[junit4] > at junit.framework.Assert.fail(Assert.java:57)
[junit4] > at
org.apache.lucene.search.CheckHits.checkEqual(CheckHits.java:205)
[junit4] > at
org.apache.lucene.search.TestRegexpRandom2.assertSame(TestRegexpRandom2.java:178)
[junit4] > at
org.apache.lucene.search.TestRegexpRandom2.testRegexps(TestRegexpRandom2.java:164)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at
java.base/java.lang.reflect.Method.invoke(Method.java:567)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:835)
[junit4] 2> NOTE: test params are:
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
chunkSize=5, maxDocsPerChunk=8, blockSize=1),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY,
chunkSize=5, blockSize=1)),
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1c32fc08),
locale=rn, timezone=Africa/El_Aaiun
{noformat}
----
...note that in both of these builds, TestFieldCacheRewriteMethod (which
subclasses TestRegexpRandom2) also failed w/similar errors and the same master
seeds .. suggesting it's probably related to one of the persistent options
chosen by the random master seed (codec, similarity, locale, etc....)
/cc [~jpountz]
> Better Segment To Thread Mapping Algorithm
> ------------------------------------------
>
> Key: LUCENE-8757
> URL: https://issues.apache.org/jira/browse/LUCENE-8757
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Atri Sharma
> Assignee: Simon Willnauer
> Priority: Major
> Fix For: master (9.0), 8.2
>
> Attachments: LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch,
> LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch,
> LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch
>
>
> The current segments to threads allocation algorithm always allocates one
> thread per segment. This is detrimental to performance in case of skew in
> segment sizes since small segments also get their dedicated thread. This can
> lead to performance degradation due to context switching overheads.
>
> A better algorithm which is cognizant of size skew would have better
> performance for realistic scenarios
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
