Ha! Randomized testing FTW! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley
On Sat, Feb 28, 2015 at 10:29 AM, Michael McCandless < [email protected]> wrote: > I committed a fix .. this was a fun one: SimpleText had a bug where if > you indexed a SORTED doc value with the string value "END", its > checkIntegrity got confused and falsely detected corruption. > > It just took our random tests this long to index the string "END" ... > > Soon we will be indexing the full works of Shakespeare... > > Mike McCandless > > http://blog.mikemccandless.com > > > On Sat, Feb 28, 2015 at 7:28 AM, Policeman Jenkins Server > <[email protected]> wrote: > > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11897/ > > Java: 32bit/jdk1.8.0_40-ea-b22 -server -XX:+UseConcMarkSweepGC > > > > 1 tests failed. > > FAILED: > org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields > > > > Error Message: > > SimpleText failure: expected checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > > > > Stack Trace: > > org.apache.lucene.index.CorruptIndexException: SimpleText failure: > expected checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > > at > __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0) > > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90) > > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527) > > at > org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135) > > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143) > > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105) > > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928) > > at > org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509) > > at > org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40) > > at > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798) > > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733) > > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838) > > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805) > > at > org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252) > > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448) > > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:497) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) > > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) > > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) > > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) > > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) > > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) > > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) > > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) > > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > > at java.lang.Thread.run(Thread.java:745) > > Suppressed: java.lang.AssertionError > > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441) > > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144) > > ... 48 more > > > > > > > > > > Build Log: > > [...truncated 5611 lines...] > > [junit4] Suite: > org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat > > [junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=TestSimpleTextDocValuesFormat > -Dtests.method=testSortedFixedLengthVsStoredFields > -Dtests.seed=4879A5F99AD2035B -Dtests.multiplier=3 -Dtests.slow=true > -Dtests.locale=et -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true > -Dtests.file.encoding=UTF-8 > > [junit4] ERROR 1.68s J1 | > TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields <<< > > [junit4] > Throwable #1: > org.apache.lucene.index.CorruptIndexException: SimpleText failure: expected > checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > > [junit4] > at > __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0) > > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90) > > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527) > > [junit4] > at > org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135) > > [junit4] > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143) > > [junit4] > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105) > > [junit4] > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928) > > [junit4] > at > org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509) > > [junit4] > at > org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40) > > [junit4] > at > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798) > > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733) > > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838) > > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805) > > [junit4] > at > org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252) > > [junit4] > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448) > > [junit4] > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493) > > [junit4] > at java.lang.Thread.run(Thread.java:745) > > [junit4] > Suppressed: java.lang.AssertionError > > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441) > > [junit4] > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144) > > [junit4] > ... 48 more > > [junit4] 2> NOTE: leaving temporary files on disk at: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/test/J1/temp/lucene.codecs.simpletext.TestSimpleTextDocValuesFormat > 4879A5F99AD2035B-001 > > [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, > docValues:{}, sim=DefaultSimilarity, locale=et, timezone=Africa/Addis_Ababa > > [junit4] 2> NOTE: Linux 3.13.0-45-generic i386/Oracle Corporation > 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=27185056,total=64880640 > > [junit4] 2> NOTE: All tests run in this JVM: > [TestSimpleTextFieldInfoFormat, TestVarGapDocFreqIntervalPostingsFormat, > TestSimpleTextNormsFormat, TestBloomPostingsFormat, > TestSimpleTextPostingsFormat, TestSimpleTextDocValuesFormat] > > [junit4] Completed on J1 in 57.94s, 84 tests, 1 error <<< FAILURES! > > > > [...truncated 50 lines...] > > BUILD FAILED > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The > following error occurred while executing this line: > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The > following error occurred while executing this line: > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The > following error occurred while executing this line: > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: > The following error occurred while executing this line: > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:456: > The following error occurred while executing this line: > > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2081: > The following error occurred while executing this line: > > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:58: > The following error occurred while executing this line: > > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1351: > The following error occurred while executing this line: > > > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:958: > There were test failures: 19 suites, 501 tests, 1 error, 19 ignored (19 > assumptions) > > > > Total time: 27 minutes 47 seconds > > Build step 'Invoke Ant' marked build as failure > > [description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b22 > -server -XX:+UseConcMarkSweepGC > > Archiving artifacts > > Recording test results > > Email was triggered for: Failure - Any > > Sending email for trigger: Failure - Any > > > > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
