Branch: refs/heads/yves/harden_runenv_hashseed
Home: https://github.com/Perl/perl5
Commit: e596c748b07e3f7ba5b45f9391e22edf92f4af5d
https://github.com/Perl/perl5/commit/e596c748b07e3f7ba5b45f9391e22edf92f4af5d
Author: Yves Orton <[email protected]>
Date: 2022-03-14 (Mon, 14 Mar 2022)
Changed paths:
M t/run/runenv_hashseed.t
Log Message:
-----------
runenv_hashseed.t - rework to deal with probabilistic failures
The old version of this test had a 1/128 chance of failing the
RANDOM key change test each time we try it. We run it 50 times, so
there is a %39 chance of failing it at least once. It is actually
surprising we haven't seen test fails before today. The key change
test also has a similar problem, albeit with a much lower
probability of failing the test.
Today I got the first report of a failed test from Tux.
This patch reworks the test to reduce the odds of both tests to
50/131072 (across all runs). Which is about 0.03%, while low this
is still non-zero and since we cant have a fractional number of
test fails we allow for each type of test to fail once before we
consider it a true failure.
