This test makes hundreds of thousands of small stored fields, and also a few large ones. But doesn't really index anything.
Add nightly, and add inefficient simpletext and it blows up NRTCachingDirectory (LUCENE-4484). I disabled nrtcachingdir in this test. On Mon, May 13, 2013 at 11:24 AM, Robert Muir <[email protected]> wrote: > I can reproduce this, ill try to see whats going on. > > On Mon, May 13, 2013 at 11:07 AM, Apache Jenkins Server < > [email protected]> wrote: > >> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/256/ >> >> 1 tests failed. >> REGRESSION: >> >> org.apache.lucene.codecs.simpletext.TestSimpleTextStoredFieldsFormat.testBigDocuments >> >> Error Message: >> GC overhead limit exceeded >> >> Stack Trace: >> java.lang.OutOfMemoryError: GC overhead limit exceeded >> at >> __randomizedtesting.SeedInfo.seed([D28C83E49F7A7B13:23A6D9BB2C56D534]:0) >> at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:75) >> at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:48) >> at >> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:152) >> at >> org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:127) >> at >> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:42) >> at >> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:33) >> at >> org.apache.lucene.codecs.simpletext.SimpleTextStoredFieldsWriter.write(SimpleTextStoredFieldsWriter.java:186) >> at >> org.apache.lucene.codecs.simpletext.SimpleTextStoredFieldsWriter.writeField(SimpleTextStoredFieldsWriter.java:98) >> at >> org.apache.lucene.index.StoredFieldsProcessor.finishDocument(StoredFieldsProcessor.java:125) >> at >> org.apache.lucene.index.TwoStoredFieldsConsumers.finishDocument(TwoStoredFieldsConsumers.java:65) >> at >> org.apache.lucene.index.DocFieldProcessor.finishDocument(DocFieldProcessor.java:273) >> at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:274) >> at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:376) >> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1508) >> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1183) >> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152) >> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:114) >> at >> org.apache.lucene.index.BaseStoredFieldsFormatTestCase.testBigDocuments(BaseStoredFieldsFormatTestCase.java:634) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) >> at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> at >> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) >> >> >> >> >> Build Log: >> [...truncated 6058 lines...] >> [junit4:junit4] Suite: >> org.apache.lucene.codecs.simpletext.TestSimpleTextStoredFieldsFormat >> [junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by >> running 'ant get-jenkins-line-docs' in the lucene directory. >> [junit4:junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestSimpleTextStoredFieldsFormat >> -Dtests.method=testBigDocuments -Dtests.seed=D28C83E49F7A7B13 >> -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true >> -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt >> -Dtests.locale=mt -Dtests.timezone=Asia/Dili -Dtests.file.encoding=UTF-8 >> [junit4:junit4] ERROR 19.1s J1 | >> TestSimpleTextStoredFieldsFormat.testBigDocuments <<< >> [junit4:junit4] > Throwable #1: java.lang.OutOfMemoryError: GC >> overhead limit exceeded >> [junit4:junit4] > at >> __randomizedtesting.SeedInfo.seed([D28C83E49F7A7B13:23A6D9BB2C56D534]:0) >> [junit4:junit4] > at >> org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:75) >> [junit4:junit4] > at >> org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:48) >> [junit4:junit4] > at >> org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:152) >> [junit4:junit4] > at >> org.apache.lucene.store.RAMOutputStream.writeByte(RAMOutputStream.java:127) >> [junit4:junit4] > at >> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:42) >> [junit4:junit4] > at >> org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:33) >> [junit4:junit4] > at >> org.apache.lucene.codecs.simpletext.SimpleTextStoredFieldsWriter.write(SimpleTextStoredFieldsWriter.java:186) >> [junit4:junit4] > at >> org.apache.lucene.codecs.simpletext.SimpleTextStoredFieldsWriter.writeField(SimpleTextStoredFieldsWriter.java:98) >> [junit4:junit4] > at >> org.apache.lucene.index.StoredFieldsProcessor.finishDocument(StoredFieldsProcessor.java:125) >> [junit4:junit4] > at >> org.apache.lucene.index.TwoStoredFieldsConsumers.finishDocument(TwoStoredFieldsConsumers.java:65) >> [junit4:junit4] > at >> org.apache.lucene.index.DocFieldProcessor.finishDocument(DocFieldProcessor.java:273) >> [junit4:junit4] > at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:274) >> [junit4:junit4] > at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:376) >> [junit4:junit4] > at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1508) >> [junit4:junit4] > at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1183) >> [junit4:junit4] > at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152) >> [junit4:junit4] > at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:114) >> [junit4:junit4] > at >> org.apache.lucene.index.BaseStoredFieldsFormatTestCase.testBigDocuments(BaseStoredFieldsFormatTestCase.java:634) >> [junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, >> sim=DefaultSimilarity, locale=mt, timezone=Asia/Dili >> [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems >> Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=226667592,total=308871168 >> [junit4:junit4] 2> NOTE: All tests run in this JVM: >> [TestSimpleTextPostingsFormat, Test10KPulsings, >> TestCheapBastardDocValuesFormat, TestBloomPostingsFormat, >> TestFixedIntBlockPostingsFormat, TestPulsingReuse, TestIntBlockCodec, >> TestSimpleTextStoredFieldsFormat] >> [junit4:junit4] Completed on J1 in 30.88s, 10 tests, 1 error <<< FAILURES! >> >> [...truncated 19 lines...] >> BUILD FAILED >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:390: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:363: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:39: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/build.xml:554: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1800: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/module-build.xml:61: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1243: >> The following error occurred while executing this line: >> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:887: >> There were test failures: 17 suites, 263 tests, 1 error >> >> Total time: 46 minutes 4 seconds >> Build step 'Invoke Ant' marked build as failure >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> > >
