this is unrelated to the clover problem. the problem is @RunWith(LuceneTestCase.LocalizedTestCaseRunner.class) as you can see, clover thinks we added 6210 core tests (see https://hudson.apache.org/hudson/view/Lucene/job/Lucene-3.x/115/testReport/)
We do not do many iterations, we run every test the same time. its not a parameter thing. try ant test -Dtestcase=TestQueryParser to see what i mean, then comment out that @RunWith On Wed, Sep 15, 2010 at 9:35 PM, Uwe Schindler <[email protected]> wrote: > Maybe we should reduce the iterations in the clover case. Clover should > only test coverage and that does not need to try all random variants. For > colverage a single run of each test should be fine. > > > > How about removing the –Dtests.XXXX from the clover part of the build file? > > > > ----- > > Uwe Schindler > > H.-H.-Meier-Allee 63, D-28213 Bremen > > http://www.thetaphi.de > > eMail: [email protected] > > > > *From:* Robert Muir [mailto:[email protected]] > *Sent:* Wednesday, September 15, 2010 5:44 PM > *To:* [email protected] > *Subject:* Re: Build failed in Hudson: Lucene-3.x #116 > > > > Hi, I think the switch of all tests to Junit4 may be causing a clover > issue. > > For example, TestQueryParser now thinks it has over 5000 tests. > > > > The reason is that it runs each test under every locale and junit4 counts > them this way. It does the same with MultiCodecRunner. > > I wonder if now that we vary these in the tests anyway, if we should > consider commenting out the Localized/MultiCodec runners? > > > > We could keep them available (but not used) in case you want to quickly run > a test under every single Locale/Codec > > > > On Wed, Sep 15, 2010 at 8:34 PM, Apache Hudson Server < > [email protected]> wrote: > > See <https://hudson.apache.org/hudson/job/Lucene-3.x/116/changes> > > Changes: > > [mikemccand] don't close reader prematurely > > [rmuir] LUCENE-2630: fix intl test bugs that rely on cldr version > > ------------------------------------------ > [...truncated 18329 lines...] > [junit] Testsuite: org.apache.lucene.search.TestTimeLimitingCollector > [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 2.721 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.TestTopDocsCollector > [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.016 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.TestTopScoreDocCollector > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.005 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.TestWildcard > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.037 sec > [junit] > [junit] Testsuite: > org.apache.lucene.search.function.TestCustomScoreQuery > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 8.241 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.function.TestDocValues > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.005 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.function.TestFieldScoreQuery > [junit] Tests run: 12, Failures: 0, Errors: 0, Time elapsed: 0.267 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.function.TestOrdValues > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.108 sec > [junit] > [junit] Testsuite: > org.apache.lucene.search.payloads.TestPayloadNearQuery > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.72 sec > [junit] > [junit] Testsuite: > org.apache.lucene.search.payloads.TestPayloadTermQuery > [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.973 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestBasics > [junit] Tests run: 20, Failures: 0, Errors: 0, Time elapsed: 12.966 sec > [junit] > [junit] Testsuite: > org.apache.lucene.search.spans.TestFieldMaskingSpanQuery > [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.667 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestNearSpansOrdered > [junit] Tests run: 10, Failures: 0, Errors: 0, Time elapsed: 0.073 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestPayloadSpans > [junit] Tests run: 10, Failures: 0, Errors: 0, Time elapsed: 1.4 sec > [junit] > [junit] ------------- Standard Output --------------- > [junit] > [junit] Spans Dump -- > [junit] payloads for span:2 > [junit] doc:0 s:3 e:6 three:Noise:5 > [junit] doc:0 s:3 e:6 one:Entity:3 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:0 s:0 e:3 xx:Entity:0 > [junit] doc:0 s:0 e:3 yy:Noise:2 > [junit] doc:0 s:0 e:3 rr:Noise:1 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:1 s:0 e:4 rr:Noise:3 > [junit] doc:1 s:0 e:4 xx:Entity:0 > [junit] doc:1 s:0 e:4 yy:Noise:1 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:0 s:0 e:3 rr:Noise:1 > [junit] doc:0 s:0 e:3 yy:Noise:2 > [junit] doc:0 s:0 e:3 xx:Entity:0 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:0 s:0 e:3 yy:Noise:2 > [junit] doc:0 s:0 e:3 xx:Entity:0 > [junit] doc:0 s:0 e:3 rr:Noise:1 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:1 s:0 e:4 xx:Entity:0 > [junit] doc:1 s:0 e:4 yy:Noise:1 > [junit] doc:1 s:0 e:4 rr:Noise:3 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:3 > [junit] doc:2 s:0 e:5 qq:Noise:1 > [junit] doc:2 s:0 e:5 pp:Noise:3 > [junit] doc:2 s:0 e:5 ss:Noise:2 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:8 > [junit] doc:3 s:0 e:11 one:Entity:0 > [junit] doc:3 s:0 e:11 six:Noise:5 > [junit] doc:3 s:0 e:11 nine:Noise:8 > [junit] doc:3 s:0 e:11 eleven:Noise:10 > [junit] doc:3 s:0 e:11 three:Noise:2 > [junit] doc:3 s:0 e:11 ten:Noise:9 > [junit] doc:3 s:0 e:11 five:Noise:4 > [junit] doc:3 s:0 e:11 two:Noise:1 > [junit] > [junit] Spans Dump -- > [junit] payloads for span:8 > [junit] doc:4 s:0 e:11 five:Noise:5 > [junit] doc:4 s:0 e:11 two:Noise:2 > [junit] doc:4 s:0 e:11 one:Entity:1 > [junit] doc:4 s:0 e:11 ten:Noise:10 > [junit] doc:4 s:0 e:11 six:Noise:6 > [junit] doc:4 s:0 e:11 nine:Noise:0 > [junit] doc:4 s:0 e:11 three:Noise:3 > [junit] doc:4 s:0 e:11 eleven:Noise:9 > [junit] match:a:Noise:10 > [junit] match:k:Noise:11 > [junit] Num payloads:1 > [junit] rr:Noise:1 > [junit] ------------- ---------------- --------------- > [junit] Testsuite: org.apache.lucene.search.spans.TestSpanExplanations > [junit] Tests run: 31, Failures: 0, Errors: 0, Time elapsed: 1.416 sec > [junit] > [junit] Testsuite: > org.apache.lucene.search.spans.TestSpanExplanationsOfNonMatches > [junit] Tests run: 31, Failures: 0, Errors: 0, Time elapsed: 0.094 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestSpans > [junit] Tests run: 25, Failures: 0, Errors: 0, Time elapsed: 0.564 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestSpansAdvanced > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.077 sec > [junit] > [junit] Testsuite: org.apache.lucene.search.spans.TestSpansAdvanced2 > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.13 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestBufferedIndexInput > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 3.11 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestDirectory > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 0.022 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestFileSwitchDirectory > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.027 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestHugeRamFile > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.995 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestLock > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.014 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestLockFactory > [junit] Tests run: 9, Failures: 0, Errors: 0, Time elapsed: 3.106 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestRAMDirectory > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.3 sec > [junit] > [junit] Testsuite: org.apache.lucene.store.TestWindowsMMap > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.098 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.ArrayUtilTest > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.003 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestAttributeSource > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.007 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestBitVector > [junit] Tests run: 7, Failures: 0, Errors: 0, Time elapsed: 9.016 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestCloseableThreadLocal > [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.006 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestFieldCacheSanityChecker > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.452 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestIndexableBinaryStringTools > [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 1.1 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestNumericUtils > [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.287 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestOpenBitSet > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 1.711 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestPriorityQueue > [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.028 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestRamUsageEstimator > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.004 sec > [junit] > [junit] ------------- Standard Output --------------- > [junit] size:56 > [junit] size:60 > [junit] size:48 > [junit] size:202 > [junit] ------------- ---------------- --------------- > [junit] Testsuite: org.apache.lucene.util.TestSmallFloat > [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.118 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestSortedVIntList > [junit] Tests run: 18, Failures: 0, Errors: 0, Time elapsed: 0.013 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestStringHelper > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.003 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestStringIntern > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 28.23 sec > [junit] > [junit] Testsuite: org.apache.lucene.util.TestVersion > [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.005 sec > [junit] > > junit-backwards-parallel: > > test-backwards: > > test: > > BUILD SUCCESSFUL > Total time: 60 minutes 42 seconds > RET=0 > + set -e > + /export/home/hudson/tools/ant/latest/bin/ant -lib > /export/home/hudson/tools/clover/clover2latest > -Dsvnversion.exe=/opt/subversion-1.6.9/bin/svnversion > -Dsvn.exe=/opt/subversion-1.6.9/bin/svn -Dversion=3.1-2010-09-15_23-04-37 > -Drun.clover=true generate-clover-reports > ANT_OPTS=-Xmx896M > Buildfile: build.xml > > clover.check: > > clover.setup: > [clover-setup] Clover Version 2.6.3, built on November 20 2009 (build-778) > [clover-setup] Loaded from: > /export/home/hudson/tools/clover/clover2latest/clover-2.6.3.jar > [clover-setup] Clover: Open Source License registered to Apache. > [clover-setup] Clover is enabled with initstring '< > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/db/lucene_coverage.db > '> > > clover.info: > > clover: > > generate-clover-reports: > [mkdir] Created dir: < > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/reports > > > [clover-report] Clover Version 2.6.3, built on November 20 2009 (build-778) > [clover-report] Loaded from: > /export/home/hudson/tools/clover/clover2latest/clover-2.6.3.jar > [clover-report] Clover: Open Source License registered to Apache. > [clover-report] Loading coverage database from: '< > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/db/lucene_coverage.db > '> > [clover-report] Loading coverage database from: '< > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/db/lucene_coverage.db > '> > [clover-report] Processed 25422 test case results from 400 results files. > [clover-report] Writing HTML report to '< > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/reports > '> > > BUILD FAILED > < > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/common-build.xml>:567: > java.lang.OutOfMemoryError: Java heap space > > Total time: 4 minutes 46 seconds > [TASKS] Skipping publisher since build result is FAILURE > Publishing Javadoc > Archiving artifacts > Recording test results > Publishing Clover coverage report... > Clover xml file does not exist in: < > https://hudson.apache.org/hudson/job/Lucene-3.x/ws/branch_3x/build/test/clover/reports> > called: clover.xml and will not be copied to: > /home/hudson/hudson/jobs/Lucene-3.x/builds/2010-09-15_23-04-37/clover.xml > Could not find 'branch_3x/build/test/clover/reports/clover.xml'. Did you > generate the XML report for Clover? > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > > > > > -- > Robert Muir > [email protected] > -- Robert Muir [email protected]
