> From: Don Dailey <[EMAIL PROTECTED]>
> ...
> > Rémi Coulom wrote:
> > ...
> > Instead of playing UCT bot vs UCT bot, I am thinking about running a
> > scaling experiment against humans on KGS. I'll probably start with 2k,
> > 8k, 16k, and 32k playouts.

> That would be a great experiment.   There is only 1 issue here and
> that's time control.   I would suggest the test is more meaningful if
> you use the same time-control for all play-out levels, even if Crazy
> Stone plays really fast.    This is because the ELO curve for humans is
> also based on thinking time.  

> If you set the time control at just the rate the program needs to use
> all it's time,    you might very well find the program plays better at
> fast time controls, it would be meaningless even as a rough measurement
> of ELO strength.


In addition to having all versions of the program use the same time control, I 
think it would be best if they all made their moves at the same rate. When 
humans play against a bot playing at a fast tempo, they tend to speed up 
themselves regardless of the time limits. The human's pondering is also a 
factor.

I've noticed this in games on KGS; a lot of people lose games with generous 
time limits because they, rashly, try to keep up with my dumb but very fast bot 
and make blunders.

- Dave Hillis



________________________________________________________________________
More new features than ever.  Check out the new AIM(R) Mail ! - 
http://webmail.aim.com
_______________________________________________
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/

Reply via email to