----- Original Message ----

> What's the point of getting a stable ranking which is more or less 
> meaningless?



> If someone want to debug or test their programs, they could easily use the 
> publicaly available version of MoGo or GnuGo. The purpose > of the 19x19 CGOS 
> is to compare strength between serious programs in a meaningful way. By 
> meaningful, I refer to the human play. 


I suspect that developers do use those publicly available versions for testing, 
but the 19x19 server allows 
several things:


-- testing against a broader range of programs
-- publicly accountable results
-- game records


Tuning against just one or two programs can lead to brittle programs. Sluggo 
reports that it did very well against GnuGo, for instance, but not nearly so 
well against many other programs, due to the "evil twin effect" -- Sluggo knew 
exactly what GnuGo would probably do in a given situation, so could find moves 
which GnuGo was blind to.
It was effectively tuned to exploit weaknesses in GnuGo's engine, which can 
lead to improper play which can be exploited by others.





      
____________________________________________________________________________________
Never miss a thing.  Make Yahoo your home page. 
http://www.yahoo.com/r/hs
_______________________________________________
computer-go mailing list
computer-go@computer-go.org
http://www.computer-go.org/mailman/listinfo/computer-go/

Reply via email to