On Nov 16, 2003, at 7:44 PM, Christian Schneider wrote:
Mike Robinson wrote:The benchmark provides insight into changes in PHP speed between versions, major and minor. IMHO that's useful information, nice
It tackles very little of PHP. One of the main changes of PHP5 (object references vs. copying) is missing for example.
You can always add that. It doesn't at all invalidate the results. Thats why they are broken into individual tests instead of being a single monolithic benchmark (which would in fact tell you almost nothing).
Of course it could be extended to contain more tests. But you'd also have to make sure that the test environment is always the same (that's why it's nonsense to post individual benchmark results here).
Welcome to the wonderful world of statistics. I agree posting individual benchmarks is useless (though I can understand the appeal - sorta like posting mips numbers).
Running the benchmark twice will give differing results, even if my quick test showed only around 0.35% difference on a completely idle machine, it's still there.
Welcome to the wonderful world of statistics. Thats why you ensure that you create a consistent environment and use a large enough sample space that your number are statistically significant.
George
-- PHP Internals - PHP Runtime Development Mailing List To unsubscribe, visit: http://www.php.net/unsub.php
