On Mon, May 26, 2008 at 4:29 PM, David Golden <[EMAIL PROTECTED]> wrote:
> On Mon, May 26, 2008 at 6:10 PM, Eric Wilhelm
> <[EMAIL PROTECTED]> wrote:
>> Forget about fairness... Can we please just have some way to adjust the
>> signal/noise ratio?
>
> Would you like to be copied on all PASS reports? That would improve
> your perception of the ratio. :-)
>
>> It's no different than requiring Extutils::MakeMaker to be installed, so
>> it's not really a bootstrapping problem as much as one of outdated
>> assumptions, but in either case it seems to be the norm to test with an
>> outdated (they call it "stock" toolchain), so the signal/noise ratio is
>> roughly zero.
>
> That's only a failing of CPANPLUS/CPAN::YACSmoke.
> CPAN::Reporter::Smoker requires Module::Build because I think a smoke
> test should assume a relatively modern toolchain. In my opinion,
> smoke testing "bare metal" installs of years-old Perl doesn't add a
> lot of value.
I figure a bare metal 5.8.{latest,latest-1} ought to be standard
PASS/FAIL targets. Requiring smokers to have upgraded toolchains means
you're not testing ordinary perl. I'm only guessing but I think it's
more common to have a stock toolchain than one that's been fully
patched.
Josh
