Re: False Positives from Automated Testing at testers.cpan.org

2005-07-24 Thread _brian_d_foy
In article <[EMAIL PROTECTED]>, Michael G Schwern <[EMAIL PROTECTED]> wrote: > On Tue, Jul 19, 2005 at 10:49:12PM -0400, James E Keenan wrote: > > The inference I drew was that the four false positives I received for > > v0.35 came from automated testing in an environment where IO::Capture > > w

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Adam Kennedy
If I have somehow managed to imply I think we should junk the entire entire current testing infrastructure and force every tester in the world to move over to an image base testing system whether they want to or not, then "no I didn't mean that". But I figured that would be obvious... Adam K

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Michael G Schwern
On Thu, Jul 21, 2005 at 05:33:29AM +1000, Adam Kennedy wrote: > If I have somehow managed to imply I think we should junk the entire > entire current testing infrastructure and force every tester in the > world to move over to an image base testing system whether they want to > or not, then "no

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Sam Tregar
On Wed, 20 Jul 2005, Michael G Schwern wrote: > Also, it eliminates one of the valuable parts of CPAN testers: testing in the > wild. If you create an artificially clean environment (the clean image), > then install all the latest versions of dependent modules into it and then > run the tests you

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Michael G Schwern
On Wed, Jul 20, 2005 at 05:21:19PM +1000, Adam Kennedy wrote: > The image-based platforms would be able to implement a fresh > from-the-base-install install of each module. This would also greatly > help to focus attention on modules that many many others rely on as a > dep that don't install ri

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Geoffrey Young
> (I deliberately > did *not* list IO::Capture as a prerequisite in Makefile.PL because I > didn't want to force users to install that module. I simply wanted them > to use it during testing and then throw it away. this is the start of the right attitude I think - when your testing environment r

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Adam Kennedy
Michael G Schwern wrote: On Tue, Jul 19, 2005 at 10:49:12PM -0400, James E Keenan wrote: The inference I drew was that the four false positives I received for v0.35 came from automated testing in an environment where IO::Capture was already installed, so that the test script did not need to fi

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-20 Thread Nicholas Clark
On Tue, Jul 19, 2005 at 09:37:39PM -0700, Michael G Schwern wrote: > On Tue, Jul 19, 2005 at 10:49:12PM -0400, James E Keenan wrote: > > Am I correct in this inference and this judgment? Or is there something > > about the automated testing that I don't understand? > > If I understand correctly

Re: False Positives from Automated Testing at testers.cpan.org

2005-07-19 Thread Michael G Schwern
On Tue, Jul 19, 2005 at 10:49:12PM -0400, James E Keenan wrote: > The inference I drew was that the four false positives I received for > v0.35 came from automated testing in an environment where IO::Capture > was already installed, so that the test script did not need to find > IO::Capture in t

False Positives from Automated Testing at testers.cpan.org

2005-07-19 Thread James E Keenan
It's not unheard of for module authors to complain that the automated test reports posted on testers.cpan.org FAIL modules that ought to PASS. Tonight, I wish to make the opposite complaint: that one of my own modules garnered four PASSes when it should have FAILed! Je m'accuse: Two days ag