Re: [computer-go] Scalability study request

2008-04-12 Thread Don Dailey
playouts, you will tend to explore more lines less deep. - Don > DL > > > -Original Message- > From: Gian-Carlo Pascutto <[EMAIL PROTECTED]> > To: computer-go > Sent: Fri, 11 Apr 2008 10:01 am > Subject: [computer-go] Scalability study request > > >

Re: [computer-go] Scalability study request

2008-04-12 Thread Gian-Carlo Pascutto
[EMAIL PROTECTED] wrote: Doesn't the total number of playout simply relates to the search ply depth? I have no idea what you mean or what the relevance is in the discussion. -- GCP ___ computer-go mailing list computer-go@computer-go.org http://www.

Re: [computer-go] Scalability study request

2008-04-12 Thread compgo123
Doesn't the total number of playout simply relates to the search ply depth? DL -Original Message- From: Gian-Carlo Pascutto <[EMAIL PROTECTED]> To: computer-go Sent: Fri, 11 Apr 2008 10:01 am Subject: [computer-go] Scalability study request Hi all,? ? the result of the

Re: [computer-go] Scalability study request

2008-04-12 Thread Gian-Carlo Pascutto
Don Dailey wrote: Gian-Carlo, We could probably add this new version to the mix and extend the study.But what kind of data has your own testing produced? Do you have an indication that it is roughly as strong at the same basic time setting (because of it's being 3X faster or so?) It is d

Re: [computer-go] Scalability study request

2008-04-11 Thread Don Dailey
Gian-Carlo, We could probably add this new version to the mix and extend the study.But what kind of data has your own testing produced? Do you have an indication that it is roughly as strong at the same basic time setting (because of it's being 3X faster or so?) Even if it isn't, it would

Re: [computer-go] Scalability study request

2008-04-11 Thread Don Dailey
If we can get some consensus on what to test, we can do more.Or we can add 1 program version to the current study. Any ideas?(Or we could do a 19x19 study.) - Don terry mcintyre wrote: > If we start up another scalability test, I'd be > delighted to offer up a few computer cores. >

Re: [computer-go] Scalability study request

2008-04-11 Thread Gian-Carlo Pascutto
Olivier Teytaud wrote: light-playout variant of leela, but perhaps the nakade-patch version of mogo and maybe even some third no problem for the nakade-patch version of mogo, but results are only known in 9x9, no idea for 13x13. Maybe it is better, maybe it is worse :-) At 9x9 you see a dimin

Re: [computer-go] Scalability study request

2008-04-11 Thread Olivier Teytaud
Good to find out, no? we have validated that: - it is good in 9x9; - it is bad in 19x19 (unless perhaps for very large number of simulations). we did not have a look at 13x13. ___ computer-go mailing list computer-go@computer-go.org http://www.compu

Re: [computer-go] Scalability study request

2008-04-11 Thread terry mcintyre
--- Olivier Teytaud <[EMAIL PROTECTED]> wrote: > > light-playout variant of leela, but perhaps the > > nakade-patch version of mogo and maybe even some > third > > no problem for the nakade-patch version of mogo, but > results > are only known in 9x9, no idea for 13x13. Maybe it > is better, > m

Re: [computer-go] Scalability study request

2008-04-11 Thread Olivier Teytaud
simulations is perhaps not always a good idea.) Is the "patch" in some way parameterized by the number of simulations? No. Perhaps it should :-) ___ computer-go mailing list computer-go@computer-go.org http://www.computer-go.org/mailman/listinfo/comp

Re: [computer-go] Scalability study request

2008-04-11 Thread Gian-Carlo Pascutto
Olivier Teytaud wrote: I am now wondering if scalability could be unaffected by playouts (just adding a constant offset) and only depend on the UCT/search implementation. From the publications of the MoGo team it seems likely that the programs are very similar there. Leela and mogo are probab

Re: [computer-go] Scalability study request

2008-04-11 Thread Olivier Teytaud
light-playout variant of leela, but perhaps the nakade-patch version of mogo and maybe even some third no problem for the nakade-patch version of mogo, but results are only known in 9x9, no idea for 13x13. Maybe it is better, maybe it is worse :-) ___

Re: [computer-go] Scalability study request

2008-04-11 Thread terry mcintyre
If we start up another scalability test, I'd be delighted to offer up a few computer cores. It would be real nice to not only have the light-playout variant of leela, but perhaps the nakade-patch version of mogo and maybe even some third program. ( if wishes were horses ... ) Terry McIntyre <[E

Re: [computer-go] Scalability study request

2008-04-11 Thread Olivier Teytaud
I am now wondering if scalability could be unaffected by playouts (just adding a constant offset) and only depend on the UCT/search implementation. From the publications of the MoGo team it seems likely that the programs are very similar there. Leela and mogo are probably quite similar. On the

[computer-go] Scalability study request

2008-04-11 Thread Gian-Carlo Pascutto
Hi all, the result of the scalability study at http://cgos.boardspace.net/study/13/index.html seems to look a lot like 2 parallel lines over the entire range, which I find very surprising, since I'd have expected at least some differences caused by different playout strategies. I am now won

Re: [computer-go] Scalability study suggestion

2008-02-02 Thread Don Dailey
Hi Chuck, Thank you for your interesting suggestions.I have previously considered a system where the distribution is based on how many contestants. For instance if there are hundreds of players you would want to generate best of 5 or 6 or more, but if there were only 3 or 4 you might want be

Re: [computer-go] Scalability study suggestion

2008-02-02 Thread steve uurtamo
ssage From: Chuck Paulson <[EMAIL PROTECTED]> To: computer-go Sent: Saturday, February 2, 2008 1:02:15 PM Subject: [computer-go] Scalability study suggestion I have been following the scaling study closely. Thanks for everyone for gathering such interesting data and espec

[computer-go] Scalability study suggestion

2008-02-02 Thread Chuck Paulson
I have been following the scaling study closely. Thanks for everyone for gathering such interesting data and especially to Don and the people donating computers. I have 2 suggestions that could help increase the amount of information gathered from all the CPU hours being used to play these game

Re: [computer-go] scalability study

2008-02-01 Thread Alain Baeckeroot
Le vendredi 1 février 2008, terry mcintyre a écrit : > Regarding the scalability study, ... > I'm very curious about that flat spot for > Mogo-16, 17, and 18. ( http://cgos.boardspace.net/study/index.html ) > I think its just lack of data Mogo_16 = 2958+47 / -45 Mo

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Darren Cook
>>> ... it would explain the scaling curve flattening out. >>> >> Though the curve can also be flattened/made-curvier by changing the base >> of the x-axis. Currently it is log-2. Proportional to actual playouts >> would make it appear flatter. >> > No, that would make it appear more curved

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread terry mcintyre
May I suggest a fundamental limit to the utility of this scalability study? We are comparing three programs to each other, IIRC - Fatman, Mogo, and Gnugo. All three are known to have certain odd little quirks. The two MC programs, in particular, are known to be deficient when addressing certain

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Don Dailey
Just cool it. We intend to add 3 more mogo levels soon. - Don Christoph Birk wrote: > On Wed, 23 Jan 2008, Don Dailey wrote: >> This bias was clear in 7x7 - I don't expect to see it here but I will >> check when there are enough games at the upper levels. > > I beg you ... add Mogo_14 to

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Don Dailey
Darren Cook wrote: >> ... it would explain the scaling curve flattening out. >> > > Though the curve can also be flattened/made-curvier by changing the base > of the x-axis. Currently it is log-2. Proportional to actual playouts > would make it appear flatter. > No, that would make it app

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Christoph Birk
On Wed, 23 Jan 2008, Don Dailey wrote: This bias was clear in 7x7 - I don't expect to see it here but I will check when there are enough games at the upper levels. I beg you ... add Mogo_14 to the study, please. Christoph ___ computer-go mailing lis

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Don Dailey
This bias was clear in 7x7 - I don't expect to see it here but I will check when there are enough games at the upper levels. - Don David Fotland wrote: > Since the komi contains a half point, there should be almost no ties, and > between two perfect players, one color will always win by half a p

Re: [computer-go] scalability study - how close to perfection?

2008-01-23 Thread Nick Wedd
In message <[EMAIL PROTECTED]>, Russ Williams <[EMAIL PROTECTED]> writes A couple of technical nitpick questions: On Jan 23, 2008 5:57 AM, David Fotland <[EMAIL PROTECTED]> wrote: Since the komi contains a half point, there should be almost no ties, How should there be "almost no" ties, inst

Re: [computer-go] scalability study - how close to perfection?

2008-01-22 Thread Russ Williams
A couple of technical nitpick questions: On Jan 23, 2008 5:57 AM, David Fotland <[EMAIL PROTECTED]> wrote: > Since the komi contains a half point, there should be almost no ties, How should there be "almost no" ties, instead of "no" ties, with the half point in the komi? (Or are you thinking of

Re: [computer-go] scalability study - how close to perfection?

2008-01-22 Thread Darren Cook
> ... it would explain the scaling curve flattening out. Though the curve can also be flattened/made-curvier by changing the base of the x-axis. Currently it is log-2. Proportional to actual playouts would make it appear flatter. Darren ___ computer-

[computer-go] scalability study - how close to perfection?

2008-01-22 Thread David Fotland
Since the komi contains a half point, there should be almost no ties, and between two perfect players, one color will always win by half a point. In your scalability study, as the number of playouts goes up, is there a bias toward one color winning more than half the games? If so, it would show t

Re: [computer-go] scalability study - final results

2007-07-07 Thread compgo123
One way to estimate the scalability against human players is to start with a program with a well established raking in with human games. Then reduce the simulation time and see how the ranking drops. AOL now offers fr

Re: [computer-go] scalability study - final results

2007-06-28 Thread Don Dailey
On Thu, 2007-06-28 at 18:38 +0100, Jacques Basaldúa wrote: > I am afraid today a postal chess game is a computer analyst > against another computer analyst. An interesting challenge, > no doubt, but that has little to do with chess. I don't agree with this. I have heard it can improve your real

Re: [computer-go] scalability study - final results

2007-06-28 Thread Jacques Basaldúa
Don Dailey wrote: > I don't know if this is very popular any longer due to the > Internet but I'm going back a few years. I am afraid today a postal chess game is a computer analyst against another computer analyst. An interesting challenge, no doubt, but that has little to do with chess. Anoth

Re: [computer-go] scalability study - final results

2007-06-27 Thread steve uurtamo
some dame are actually outside liberties, so it's important to be careful with them as well. s. - Original Message From: Chris Fant <[EMAIL PROTECTED]> To: computer-go Sent: Wednesday, June 27, 2007 6:41:23 PM Subject: Re: [computer-go] scalability study - final results &

Re: [computer-go] scalability study - final results

2007-06-27 Thread Chris Fant
That still doesn't deal with dame though. Dame points always come out as not owned much by either side.The algorithm might be to do a simple test for dame and if it looks like a dame point and the ownership map is close to neutral, then it's probably a dame point. Maybe dame isn't that har

Re: [computer-go] scalability study - final results

2007-06-27 Thread Don Dailey
On Wed, 2007-06-27 at 17:52 -0400, Chris Fant wrote: > I think the correct solution would probably have something to do with > generating an expected teritory map during your UCT simulations and > then prunning moves from the root that are in strongly owned enemy > territory (and you would also som

Re: [computer-go] scalability study - final results

2007-06-27 Thread Chris Fant
It's an interesting problem - how to make a Chinese based UCT program play by Japanese rules.I don't think it would be very easy to do that well. I would think you would need a separate system (with perhaps some support from UCT) which could identify moves that should be avoided. Without hav

Re: [computer-go] scalability study - final results

2007-06-27 Thread Don Dailey
On Wed, 2007-06-27 at 13:58 -0700, terry mcintyre wrote: > If I recall correctly, Chinese rules encourage you to fill dame, since > stones on the board are counted; Japanese rules exact no penalty > either way since dame are not territory. > > Under Chinese rules, it would be foolish to pass so lo

Re: [computer-go] scalability study - final results

2007-06-27 Thread terry mcintyre
Subject: Re: [computer-go] scalability study - final results On Wed, Jun 27, 2007 at 04:03:09PM -0400, Don Dailey wrote: > My program wouldn't do well as it would not understand dame and other > Japanese complexities. It should not do too badly - if you play by the chinese rules, you wi

Re: [computer-go] scalability study - final results

2007-06-27 Thread Heikki Levanto
On Wed, Jun 27, 2007 at 04:03:09PM -0400, Don Dailey wrote: > My program wouldn't do well as it would not understand dame and other > Japanese complexities. It should not do too badly - if you play by the chinese rules, you will do quite well by the japanese as well. Perhaps some of the opponents

Re: [computer-go] scalability study - final results

2007-06-27 Thread Don Dailey
I noticed there was a robot interface of some kind too. My program wouldn't do well as it would not understand dame and other Japanese complexities. For a long time I have considered trying to have a Japanese mode but I'm not yet motivated enough to do this. I might consider it if I ever get it

Re: [computer-go] scalability study - final results

2007-06-27 Thread terry mcintyre
l; but they mean to govern. They promise to be kind masters; but they mean to be masters. -- Daniel Webster - Original Message From: Christoph Birk <[EMAIL PROTECTED]> To: computer-go Sent: Wednesday, June 27, 2007 12:33:59 PM Subject: Re: [computer-go] scalability study - final res

Re: [computer-go] scalability study - final results

2007-06-27 Thread Christoph Birk
On Wed, 27 Jun 2007, steve uurtamo wrote: uucgs. could probably be written as a small wrapper around uucp over ethernet. :) At that pace you may just do it by hand ... sending the move by email. Christoph ___ computer-go mailing list computer-go@c

Re: [computer-go] scalability study - final results

2007-06-27 Thread steve uurtamo
uucgs. could probably be written as a small wrapper around uucp over ethernet. :) s. - Original Message From: Don Dailey <[EMAIL PROTECTED]> To: computer-go Sent: Wednesday, June 27, 2007 1:59:12 PM Subject: Re: [computer-go] scalability study - final results On Wed, 2007-06

Re: [computer-go] scalability study - final results

2007-06-27 Thread Don Dailey
On Wed, 2007-06-27 at 10:37 -0700, terry mcintyre wrote: > From my experience, DGS is not comparable to correspondence chess; it > isn't anywhere near that competivive. It is generally a way to play a > casual game over a longish period of time. So it might be interesting to use a monte-carlo e

Re: [computer-go] scalability study - final results

2007-06-27 Thread terry mcintyre
. They promise to be kind masters; but they mean to be masters. -- Daniel Webster - Original Message From: Don Dailey <[EMAIL PROTECTED]> To: Nick Wedd <[EMAIL PROTECTED]> Cc: computer-go Sent: Wednesday, June 27, 2007 10:14:49 AM Subject: Re: [computer-go] scalability study - f

Re: [computer-go] scalability study - final results

2007-06-27 Thread Don Dailey
On Wed, 2007-06-27 at 17:25 +0100, Nick Wedd wrote: > In message <[EMAIL PROTECTED]>, Don > Dailey <[EMAIL PROTECTED]> writes > > >I believe humans play much stronger too at those time controls. Unless > >of course they are playing many games and are not really focused on any > >particular game.

Re: [computer-go] scalability study - final results

2007-06-27 Thread Nick Wedd
In message <[EMAIL PROTECTED]>, Don Dailey <[EMAIL PROTECTED]> writes I believe humans play much stronger too at those time controls. Unless of course they are playing many games and are not really focused on any particular game. The "unless" above is very important. When I play on a turn-b

Re: [computer-go] scalability study - final results

2007-06-26 Thread Don Dailey
On Tue, 2007-06-26 at 10:45 +0900, Darren Cook wrote: > > After throwing out the low and high ratings the top 5 players average > > about 132 ELO per doubling and the bottom 5 average an increase of > > about 210 per doubling. > > ... > > I suspect Lazarus at > > the highest level I tested is wi

Re: [computer-go] scalability study - final results

2007-06-25 Thread Chris Fant
You're suggesting that it would be practically perfect with say three more doublings (another 132*3=400 ELO points), which is "only" 32 hours per game. At that level play should be relatively stable (statistically) and it would be great to run just 2 games of self-play (128 hours = 5 days?), and s

Re: [computer-go] scalability study - final results

2007-06-25 Thread Darren Cook
> After throwing out the low and high ratings the top 5 players average > about 132 ELO per doubling and the bottom 5 average an increase of > about 210 per doubling. > ... > I suspect Lazarus at > the highest level I tested is within a few hundred ELO points of > perfect play. It's still a lon

Re: [computer-go] scalability study - final results

2007-06-25 Thread Don Dailey
On Tue, 2007-06-26 at 06:50 +0800, elife wrote: > Hi Don, > > Thanks for doing this valueable work. > Where can we get the data? I am interested with it. > > Cai Qiang I put everything on that web site: Just go to http://www.greencheeks.homelinux.org:8015/ and you can get the games from

Re: [computer-go] scalability study - final results

2007-06-25 Thread Don Dailey
On Mon, 2007-06-25 at 15:07 -0700, terry mcintyre wrote: > Don, > > That's exciting! If Lazarus with heavy playouts can achieve "within a > few hundred points of perfect play" on a 9x9 board, in less than 4 > hours total game time, then it should do rather well on such > turn-based servers as the

Re: [computer-go] scalability study - final results

2007-06-25 Thread elife
Hi Don, Thanks for doing this valueable work. Where can we get the data? I am interested with it. Cai Qiang ___ computer-go mailing list computer-go@computer-go.org http://www.computer-go.org/mailman/listinfo/computer-go/

Re: [computer-go] scalability study - final results

2007-06-25 Thread terry mcintyre
Don, That's exciting! If Lazarus with heavy playouts can achieve "within a few hundred points of perfect play" on a 9x9 board, in less than 4 hours total game time, then it should do rather well on such turn-based servers as the Dragon Go Server. A 30-day clock should be more than adequate. Th

Re: [spam probable] [computer-go] scalability study - final results

2007-06-25 Thread Sylvain Gelly
Hi Don, This is a very interesting study! Sylvain 2007/6/25, Don Dailey <[EMAIL PROTECTED]>: Someone just reminded me of the scalability study I did a few months back and I reported that I would continue to run it for perhaps a few more weeks. I did run about 20% more games, but the data was

Re: [computer-go] scalability study - final results

2007-06-25 Thread dhillismail
These are very interesting results. Thanks for doing all this work. - Dave Hillis -Original Message- From: Don Dailey <[EMAIL PROTECTED]> To: computer-go Sent: Mon, 25 Jun 2007 12:34 pm Subject: [computer-go] scalability study - final results Someone just reminded me

[computer-go] scalability study - final results

2007-06-25 Thread Don Dailey
Someone just reminded me of the scalability study I did a few months back and I reported that I would continue to run it for perhaps a few more weeks. I did run about 20% more games, but the data was quite useful because it increased the number of games sampled for the highest levels. I had start

Re: [computer-go] scalability study

2007-01-29 Thread Don Dailey
Steve Uurtamo is helping me with this, he has access to several computers he is throwing at the study. But another fast computer wouldn't hurt. We have to coordinate with Steve because I don't know what he is running. If you want to help I will send you a tarball with everything you need.

Re: [computer-go] scalability study

2007-01-29 Thread Heikki Levanto
On Sat, Jan 27, 2007 at 05:13:44PM -0500, Don Dailey wrote: > With help from other I will extend this as > much as possible to much higher levels. Someone > is helping me run games even now as I write > this at higher levels - but the rate of play is > quite slow, so it will be some time until we

[computer-go] scalability study

2007-01-29 Thread Don Dailey
So far, each doubling has produced extremely lopsided scores in 19x19 Go. In fact, the superiority of the higher level has increased with each doubling - but I think that is a temporary phenomenon that will eventually turn around. I think this also happened in 9x9 go at really low levels.

Re: [computer-go] scalability study

2007-01-29 Thread Łukasz Lew
On 1/29/07, Don Dailey <[EMAIL PROTECTED]> wrote: I don't understand what you are saying here. Here is what I THINK you are saying ... simple MC with all as first beats "standard" UCT at 19x19 go. Is that what you mean? Yes, That is what I meant. I.e. Noise is so high on 19x19, that You need

Re: [computer-go] scalability study

2007-01-28 Thread Don Dailey
I don't understand what you are saying here. Here is what I THINK you are saying ... simple MC with all as first beats "standard" UCT at 19x19 go. Is that what you mean? My experience with simple MC is that it does beat UCT at really fast time controls in 9x9 and I believe, although I haven't t

Re: [computer-go] scalability study

2007-01-28 Thread Łukasz Lew
Try simple MC with all as first :) I guess it beat any UCT totally. ( one playout here will be as 200-300 in UCT) On 1/27/07, Don Dailey <[EMAIL PROTECTED]> wrote: Below is the current results (in progress) of my UCT 19x19 GO scalability study. This is going to take a lot of time, but the resul

[computer-go] scalability study

2007-01-27 Thread Don Dailey
Below is the current results (in progress) of my UCT 19x19 GO scalability study. This is going to take a lot of time, but the results should be useful and I want to make them a matter of public record. Each person will interpret the data however he/she chooses. The data below contains the fol