Rémi Coulom wrote: > Don Dailey wrote: >> They seem under-rated to me also. Bayeselo pushes the ratings together >> because that is apparently a valid initial assumption. With enough >> games I believe that effect goes away. >> >> I could test that theory with some work. Unless there is a way to >> turn that off in bayelo (I don't see it) I could rate them with my own >> program. >> >> Perhaps I will do that test. >> >> - Don > The factor that pushes ratings together is the prior virtual draws > between opponents. You can remove or reduce this factor with the > "prior" command. (before the "mm" command, you can run "prior 0" or > "prior 0.1"). This command indicates the number of virtual draws. If I > remember correctly, the default is 3. You may get convergence problem > if you set the prior to 0 and one player has 100% wins. Oh, I didn't know that. I will change it so that it uses something like 0.5 or so.
> > The effect of the prior should vanish as the number of games grows. > But if the winning rate is close to 100%, it may take a lot of games > before the effect of these 3 virtual draws becomes small. It is not > possible to reasonably measure rating differences when the winning > rate is close to 100% anyway. > > Instead of playing UCT bot vs UCT bot, I am thinking about running a > scaling experiment against humans on KGS. I'll probably start with 2k, > 8k, 16k, and 32k playouts. That would be a great experiment. There is only 1 issue here and that's time control. I would suggest the test is more meaningful if you use the same time-control for all play-out levels, even if Crazy Stone plays really fast. This is because the ELO curve for humans is also based on thinking time. If you set the time control at just the rate the program needs to use all it's time, you might very well find the program plays better at fast time controls, it would be meaningless even as a rough measurement of ELO strength. - Don > > Rémi > _______________________________________________ > computer-go mailing list > computer-go@computer-go.org > http://www.computer-go.org/mailman/listinfo/computer-go/ > _______________________________________________ computer-go mailing list computer-go@computer-go.org http://www.computer-go.org/mailman/listinfo/computer-go/
