Re: [computer-go] Rating variability on CGOS

2009-10-09 Thread David Ongaro
ithout standard deviation is useless. For good reasons. David -Original Message- From: computer-go-boun...@computer-go.org [mailto:computer-go- boun...@computer-go.org] On Behalf Of Brian Sheppard Sent: Thursday, October 08, 2009 12:48 PM To: computer-go@computer-go.org Subject: [comp

RE: [computer-go] Rating variability on CGOS

2009-10-08 Thread David Fotland
go.org [mailto:computer-go- > boun...@computer-go.org] On Behalf Of Brian Sheppard > Sent: Thursday, October 08, 2009 12:48 PM > To: computer-go@computer-go.org > Subject: [computer-go] Rating variability on CGOS > > About two weeks ago I took Pebbles offline for an extensive o

Re: [computer-go] Rating variability on CGOS

2009-10-08 Thread Petri Pitkanen
All rating model assume tha If A cab B B easily and B can beat C easily then A can beat C easily as well. As we all know this is ususally true but no always. I know I cannot handle AyaMC in KGS although rating of KgS indicate that I should be favorite. I assume that these sort wrong skill set agai

[computer-go] Rating variability on CGOS

2009-10-08 Thread Brian Sheppard
>One must be very careful about proclaiming wild transitivity issues. I'm >not saying it's not an issue, there is some going on with every program on >CGOS, but with less than 500 games between any two players you are going >to get error margins of +/- 30-50 ELO or something like that. Actually w

Re: [computer-go] Rating variability on CGOS

2009-10-08 Thread Don Dailey
One must be very careful about proclaiming wild transitivity issues. I'm not saying it's not an issue, there is some going on with every program on CGOS, but with less than 500 games between any two players you are going to get error margins of +/- 30-50 ELO or something like that. And CGOS r

Re: [computer-go] Rating variability on CGOS

2009-10-08 Thread Magnus Persson
When I get more time to work on Valkyria again maybe I should look closely at the games against Pachi... -Magnus Quoting Brian Sheppard : About two weeks ago I took Pebbles offline for an extensive overhaul of its board representation. At that time Valkyria 3.3.4 had a 9x9 CGOS rating of rou

Re: [computer-go] Rating variability on CGOS

2009-10-08 Thread Petr Baudis
On Thu, Oct 08, 2009 at 01:48:05PM -0600, Brian Sheppard wrote: > About two weeks ago I took Pebbles offline for an extensive overhaul of its > board representation. At that time Valkyria 3.3.4 had a 9x9 CGOS rating of > roughly 2475. > > When I looked today, I saw Valkyria 3.3.4 rated at roughly

[computer-go] Rating variability on CGOS

2009-10-08 Thread Brian Sheppard
About two weeks ago I took Pebbles offline for an extensive overhaul of its board representation. At that time Valkyria 3.3.4 had a 9x9 CGOS rating of roughly 2475. When I looked today, I saw Valkyria 3.3.4 rated at roughly 2334, so I wondered what was going on. I found a contributing factor: Val