-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
What are you using for loss?
this:
layers {
name: "loss4"
type: EUCLIDEAN_LOSS
loss_weight: 2.0
bottom: "vvv"
bottom: "pool2"
top: "accloss4"
}
?
Am 04.03.2016 um 16:23 schrieb Hiroshi Yamashita:
> Hi,
>
> I tried to make Value network.
>
> "Policy network + Value network" vs "Policy network" Winrate
> Wins/Games 70.7% 322 / 455, 1000 playouts/move 76.6% 141 /
> 184, 10000 playouts/move
>
> It seems more playouts, more Value network is effetctive. Games is
> not enough though. Search is similar to AlphaGo. Mixing parameter
> lambda is 0.5. Search is synchronous. Using one GTX 980. In 10000
> playouts/move, Policy network is called 175 times, Value network is
> called 786 times. Node Expansion threshold is 33.
>
>
> Value network is 13 layers, 128 filters. (5x5_128, 3x3_128 x10,
> 1x1_1, fully connect, tanh) Policy network is 12 layers, 256
> filters. (5x5_256, 3x3_256 x10, 3x3_1), Accuracy is 50.1%
>
> For Value network, I collected 15804400 positions from 987775
> games. Games are from GoGoD, tygem 9d, 22477 games
> http://baduk.sourceforge.net/TygemAmateur.7z KGS 4d over, 1450946
> games http://www.u-go.net/gamerecords-4d/ (except handicaps
> games). And select 16 positions randomly from one game. One game is
> divided 16 game stage, and select one of each. 1st and 9th position
> are rotated in same symmetry. Then Aya searches with 500 playouts,
> with Policy network. And store winrate (-1 to +1). Komi is 7.5.
> This 500 playouts is around 2730 BayesElo on CGOS.
>
> I did some of this on Amazon EC2 g2.2xlarge, 11 instances. It took
> 2 days, and costed $54. Spot instance is reasonable. However
> g2.2xlarge(GRID K520), is 3x slower than GTX 980. My Pocicy
> network(12L 256F) takes 5.37ms(GTX 980), and 15.0ms(g2.2xlarge).
> Test and Traing loss are 0.00923 and 0.00778. I think there is no
> big overfitting.
>
> Value network is effective, but Aya has still fatal semeai
> weakness.
>
> Regards, Hiroshi Yamashita
>
> _______________________________________________ Computer-go mailing
> list Computer-go@computer-go.org
> http://computer-go.org/mailman/listinfo/computer-go
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)
iQIcBAEBAgAGBQJW7SzYAAoJEInWdHg+Znf4gV8P/jylYxgTHDY/i2RdGy4TaviL
sL7M2y1d/7xpcUYZHmCBV32jhDfoIEh3hzW9ZYIVylak6JJgwy+czDVbCy30akZL
MMLKYUjtcHrQJphOXcYMsBJ/CYgsRVO45AAUgFXiHRlXuCs9LVrB41QjjQ291Cph
sTgNOUaxa62CHT85eKFWGfyKNIRo4p0uWQhnen2ZCrrVyaghV8Iqzjcjgxotlzuf
Ur2bwBb3SlkE31x9slQYpiFJ+jkfTDLqF0Z2gFqiZTf+sUxA03LP+j64+3cMaMou
kyHizVJMGk+JOg2z4cdIVFoLkT4FdrmD5R7zpv5RLQ6Q9r7wOLE5Ptho6fxkRShU
d0qofNnEQwIKz48knqBdPVuo+yZlv8b/JopyVaPEN1isq0Hab0I2ASCMWAAZRbeF
5xdCP2MdvMoSuDSSBTeZRQnLCAntGZ5O+PDYbGVqVaperDSeqszSdXQ+DrhpkGwm
uWT2D3YYO0/P9ovdTd0NEf11A+PlOF/CfGbdOfCbjxOT9cE2WyZOpy2hPu2SMj8d
2cgt36FVD+1lQueaWiJlTa6Q/8mehBCgLJLNHMuF3v8TTCUP2ofwWr1eZ5Y7T1DU
D2xX2eVo6HUdaehwjc9X8Gsa37nJIYtEAHm2BFxzlASdntj9eMgbg3GNYtSwr/2r
T6QqYjbRQJO6+mw0iU0t
=S3fg
-----END PGP SIGNATURE-----
_______________________________________________
Computer-go mailing list
Computer-go@computer-go.org
http://computer-go.org/mailman/listinfo/computer-go
