I think Jenkins intends for you to capture successes in addition to failures. If you don't capture successes in addition to failures, then when a test fails, it appears in the Jenkins results as a "new test". When it is fixed, it disappears again. I think that will mislead your users and sacrifice usability.
I would be perplexed (personally) if Jenkins displayed the number of tests, but did not have test results to match that number of tests. That would be inconsistent (at least to me). Mark Waite On Wed, Nov 6, 2013 at 7:41 AM, Ruslan Zasukhin < ruslan_zasuk...@valentina-db.com> wrote: > Hi Guys, > > History of question is: > We have own system of tests for our C++ product, > which is in develop more of 10 years. > > Now we consider plug this under Jenkins, so we try > to generated minimal required XML file in JUNIT format. > > There was hope that may be, we can put into XML file only list of failed > tests, and avoid list successful tests. Something like this: > > ===================================================== > <?xml version="1.0" encoding="UTF-8"?> > <testsuites name="All Tests" tests="12345" failures="3" errors="0" > time="350"> > <testcase name="Addition" classname="" time="100"> > <failure message="Value of: add(1, 1); Actual: 1;Expected: 2" > type=""/> > <failure message="Value of: sin(0); Actual: 1;Expected: 0" > type=""/> > </testcase> > <testcase name="Zip Compresion" classname="" time="250"> > <failure message="Value of: zipme(); Actual: 1;Expected: 2" > type=""/> > </testcase> > </testsuites> > ===================================================== > > > But this not works .... > > Jenkins simply ignores attributes of line: > > <testsuites name="All Tests" tests="12345" failures="3" errors="0" > time="350"> > > > And simply try parse all existed tests in XML, and count self failed and > successful tests. > > Why is this? > > > > Above XML file is correct from any point of view. > And it is minimal to make Jenkins record results ... > > And lets assume, that for our team it is okay to see only list of failed > tests... No many sense to see 12500 successful tests on HTML pages of > Jenkins. We have for this own log file. > > > > -- > Best regards, > > Ruslan Zasukhin > VP Engineering and New Technology > Paradigma Software, Inc > > Valentina - Joining Worlds of Information > http://www.paradigmasoft.com > > [I feel the need: the need for speed] > > > -- > You received this message because you are subscribed to the Google Groups > "Jenkins Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jenkinsci-users+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
