Short version:  I'm considering dropping the exit code feature from the 
default behavior of Test::Builder and making it something you can turn on 
instead.  Does anyone find this feature useful or otherwise wish to
protest its removal in 0.50?


Long version:
Test::More (and, in fact, most any Test::Builder derived module) sets the
exit code to be the number of tests which failed.  This somewhat dubious
feature was meant to allow folks to determine if a test script passed or
failed without using Test::Harness.  It was also meant to make Test::More
easier to use with Aegis and other testing systems that use the exit code
of the test process.

It doesn't seem to be working out that way.

Very few Perl programmers use Aegis, you have to write your own custom 
harness anyway to make the output readable and Aegis wants a simple 0 or 1 
as the exit code.  So its not much help there.

Test::Harness is slowly becoming more flexible such that sometime RSN
we'll have custom formatters reducing the need to interpret tests outside
of T::H.

The exit code information adds unnecessary extra information to an already
crowded set of diagnostics.  Observe the difference.

With...
foo....NOK 3                                                                 
#     Failed test (foo.t at line 7)
#          got: '1'
#     expected: '2'
# Looks like you failed 1 test of 4.
foo....dubious                                                               
        Test returned status 1 (wstat 256, 0x100)
DIED. FAILED test 3
        Failed 1/4 tests, 75.00% okay
Failed Test Stat Wstat Total Fail  Failed  List of Failed
-------------------------------------------------------------------------------
foo.t          1   256     4    1  25.00%  3
Failed 1/1 test scripts, 0.00% okay. 1/4 subtests failed, 75.00% okay.

Without...
foo....NOK 3                                                                 
#     Failed test (foo.t at line 8)
#          got: '1'
#     expected: '2'
# Looks like you failed 1 test of 4.
foo....FAILED test 3                                                         
        Failed 1/4 tests, 75.00% okay
Failed Test Stat Wstat Total Fail  Failed  List of Failed
-------------------------------------------------------------------------------
foo.t                      4    1  25.00%  3
Failed 1/1 test scripts, 0.00% okay. 1/4 subtests failed, 75.00% okay.


-- 
Michael G Schwern        [EMAIL PROTECTED]  http://www.pobox.com/~schwern/
The key, my friend, is hash browns.
        http://www.goats.com/archive/980402.html

Reply via email to