On Wed, Jul 20, 2005 at 10:32:29AM -0700, Donnie Berkholz wrote: > Duncan wrote: > | The AT guidelines (available for amd64 ATs here: > | http://www.gentoo.org/proj/en/base/amd64/tests/index.xml ) specifically > | mention testing "every conceivable permutation", > That's an absolute joke for reasonably large packages with say, >=10 USE > flags. I had to look up my combinations math, but it looks like you're > already into thousands of possibilities with even 10 flags. For PHP with 41 flags (98 in current revisions of PHP5), the numbers make it simply impossible to test every combination.
I'm perfectly fine with looking at it via coverage tests instead. "Do our tests cover a large part of the source base (say 80%) and all critical functionality?" Im this case it's clear that ~5 specific cases of building dev-php/php would ensure sufficient testing. Automated code-coverage tools would probably go a long way in this. -- Robin Hugh Johnson E-Mail : [EMAIL PROTECTED] Home Page : http://www.orbis-terrarum.net/?l=people.robbat2 ICQ# : 30269588 or 41961639 GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85
pgpUPHyKn3mDW.pgp
Description: PGP signature
