>> It would have been much more persuasive if you had simply run a 5K
>> playout bot against a 100K bot and see which wins more. ...
> 
> I may do that, although personally I would be far more cautious about
> drawing conclusions from those matches, as compared to ones played
> against a strong reference opponent.  ...

The thing is, the 100K bot should either win more, or be the same
strength. If you can show, with statistical confidence, that it is
actually weaker then people have to sit up and pay attention.

(If not you may still be on to something, but it will be harder to prove.)

I'd also like to second Mark Boon's statement that Gnugo is not an
expert judge, especially not after only 10 moves. One experiment I did,
a couple of years ago, was scoring lots of terminal or almost-terminal
9x9 positions with gnugo and crazy stone, and they disagreed a lot of
the time. (Sorry, I don't remember what "a lot" was, maybe 10% or so.)

Darren

_______________________________________________
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/

Reply via email to