Branch: refs/heads/yves/harden_runenv_hashseed
Home: https://github.com/Perl/perl5
Commit: 35120748d49ef42a0304c187b5f07069d199dba9
https://github.com/Perl/perl5/commit/35120748d49ef42a0304c187b5f07069d199dba9
Author: Yves Orton <[email protected]>
Date: 2022-03-13 (Sun, 13 Mar 2022)
Changed paths:
M t/run/runenv_hashseed.t
Log Message:
-----------
runenv_hashseed.t - rework to deal with probabilistic failures
The old version of this test had a 1/128 chance of failing the
RANDOM key change test each time we try it. We run it 50 times, so
there is a %39 chance of failing it at least once. It is actually
surprising we haven't seen test fails before today. The key change
test also has a similar problem, albeit with a much lower
probability of failing the test.
Today I got the first report of a failed test from Tux.
This patch reworks the test to reduce the odds of both tests to
50/131072 (across all runs). Which is about 0.03%, while low this
is still non-zero and since we cant have a fractional number of
test fails we allow for each type of test to fail once before we
consider it a true failure.
