On Wed 25 Apr 2012 16:10, l...@gnu.org (Ludovic Courtès) writes: >> I don't think it's useful to run srfi-1 and vlist tests the same number >> of times when their complexity varies, as in the assoc case. > > Right, and the ‘vhash’ bench is too short to draw any sort of conclusion. > > Could you try with an appropriate value of ‘--iteration-factor’?
What is an appropriate value? If I did 100, for example, then the srfi-1 alist test would take 350 seconds. Why not take this opportunity to adjust the iterations specified in the benchmarks, as I proposed in my mail "our benchmarking suite"? We could also make the benchmarking suite automatically set the iteration-factor to an appropriate value based on the calibration. WDYT? Andy -- http://wingolog.org/
