LCZero impressions

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Guenther
Posts: 4606
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

LCZero impressions

Post by Guenther »

disclaimer: statistically insignificant # of games

Last week I started some test games with an opening suite with 70 pos., but the changes come so quick and I needed my pc for other things
Therefore I had to stop halfway through the first match and meanwhile version 0.5 plus a newer and increased NN are running in a rematch.

Some add. info:
Due to my very slow gpu the first match was done with time odds of 8:1
to reach some meaningful nps.
For match 2 which just started today I used now only time odds of 2:1!

What some already saw in traing matches and probably was expected seems to be quite an increase of the draw rate.

Anechka_008 is around 2230 in the 40/4 list at CCRL.

Code: Select all

LCZero-Test2018 TimeOdds 40/1200:40/150
RWBC::CAPPUCCINO_Q8200, 2018.04.08 - 2018.04.10
                      Score                         
-------------------------------------------------------------------------------------------------------
 1: Anechka_008     38.5 / 70   11101==11001=0101=110111111000110000111=100=10=001010=01111001=1010100  (+34 -27 =9)
 2: LCZero_04ID107  31.5 / 70   00010==00110=1010=001000000111001111000=011=01=110101=10000110=0101011  (+27 -34 =9)
-------------------------------------------------------------------------------------------------------
70 games: +31 -30 =9

###################################################################################################################

LCZero-Test2018
RWBC::CAPPUCCINO_Q8200, 2018.04.13
                      Score     
----------------------------------------------
 1: LCZero_05ID123   7.0 / 13   0====0=1=1101  (+4 -3 =6)
 2: Anechka_008      6.0 / 13   1====1=0=0010  (+3 -4 =6)
----------------------------------------------
13 games: +4 -3 =6

Example game - #12 of the current match2
[pgn][Event "LCZeroTest_2018"]
[Site "RWBC::CAPPUCCINO_Q8200"]
[Date "2018.04.13"]
[Round "1"]
[White "LCZero_05ID123"]
[Black "Anechka_008"]
[Result "1-0"]
[BlackTimeControl "40/180"]
[ECO "A22"]
[Opening "English"]
[PlyCount "72"]
[Termination "adjudication"]
[Variation "Bremen, Smyslov system"]
[WhiteTimeControl "40/360"]

1. c4 {book} e5 {book} 2. Nc3 {book} Nf6 {book} 3. g3 {book} Bb4 {book}
4. Bg2 {book} O-O {book} 5. Nf3 {book} Nc6 {book} 6. O-O {book} d6 {book}
7. d3 {+0.12/18 8.1s} Bxc3 {+0.08/9 7.6s} 8. bxc3 {+0.15/18 4.5s}
e4 {+0.10/9 5.3s} 9. Nd4 {+0.23/18 6.7s} Ne5 {+0.10/10 12s}
10. dxe4 {+0.21/19 10s} Nfd7 {+0.14/10 4.7s} 11. Nf5 {+0.39/18 7.5s}
a6 {-0.16/9 13s} 12. f4 {+0.53/18 10.0s} Nc6 {-0.08/10 4.2s}
13. g4 {+0.49/18 6.0s} Qf6 {+0.14/8 4.9s} 14. g5 {+0.58/18 10s}
Qxc3 {+0.84/10 3.4s} 15. Rb1 {+0.55/18 5.9s} Qxc4 {+0.92/10 7.8s}
16. Bb2 {+0.56/18 5.6s} Nc5 {+0.76/9 3.0s} 17. Nxg7 {+0.63/18 6.2s}
Qxa2 {+0.67/9 8.9s} 18. Qe1 {+1.22/19 11s} Bg4 {+0.93/8 3.2s}
19. h3 {+1.55/18 6.7s} Na4 {-0.28/9 5.9s} 20. hxg4 {+1.79/18 6.9s}
Nxb2 {-1.65/9 4.6s} 21. Nh5 {+1.91/18 5.4s} f6 {-2.65/8 5.4s}
22. Nxf6+ {+1.83/19 11s} Kh8 {-3.20/10 7.0s} 23. Qd2 {+2.04/19 8.9s}
h6 {-3.24/9 3.7s} 24. Rxb2 {+1.97/18 9.6s} Qa3 {-3.94/9 7.1s}
25. Rxb7 {+1.98/19 9.3s} hxg5 {-4.20/9 10s} 26. fxg5 {+2.15/18 8.3s}
Qc5+ {-4.64/9 8.0s} 27. Kh1 {+2.25/19 9.5s} Ne5 {-6.39/9 8.2s}
28. Qf4 {+2.30/19 11s} Kg7 {-7.28/9 3.7s} 29. Rc1 {+2.36/19 12s}
Nc4 {-8.31/9 5.0s} 30. e5 {+2.44/19 15s} d5 {-6.86/8 2.3s} 31. e6 {+2.69/19 16s}
Rac8 {-8.44/8 3.0s} 32. Qf5 {+2.61/18 12s} Rh8+ {-9.20/9 2.6s}
33. Nh5+ {+2.69/18 6.3s} Rxh5+ {-10.11/10 6.2s} 34. gxh5 {+2.53/18 4.4s}
Qf8 {-12.48/10 5.0s} 35. Qxd5 {+2.62/19 16s} Kh8 {-12.50/9 2.2s}
36. Rxc4 {+2.97/19 16s} Qg7 {-23.33/8 1.5s, White wins by adjudication} 1-0[/pgn]

some (compressed) output for nps visualisation and speed comparison between versions 0.4/0.5 and new NN size: (fed the debug through a macro)

Code: Select all

game;1;of;140;(LCZero_05ID123;vs;Anechka_008)
depth;18;nodes;1975;nps;208;winrate;55.67%;time;9493;bestmove;c2c4
depth;18;nodes;1974;nps;197;winrate;56.65%;time;9947;bestmove;e1g1
depth;18;nodes;1795;nps;197;winrate;58.06%;time;9034;bestmove;b1c3
depth;18;nodes;1692;nps;188;winrate;58.48%;time;8801;bestmove;h2h3
depth;18;nodes;1458;nps;192;winrate;60.29%;time;7456;bestmove;a1c1
depth;18;nodes;1746;nps;196;winrate;60.98%;time;8865;bestmove;d3d4
depth;18;nodes;2031;nps;195;winrate;59.73%;time;9580;bestmove;f3d2
depth;19;nodes;2152;nps;194;winrate;58.62%;time;10132;bestmove;e2g4
depth;19;nodes;2248;nps;234;winrate;60.54%;time;9542;bestmove;f2f4
depth;18;nodes;1544;nps;189;winrate;61.72%;time;4754;bestmove;g4f3
depth;18;nodes;1906;nps;191;winrate;61.08%;time;9307;bestmove;d2e4
depth;18;nodes;1679;nps;187;winrate;60.18%;time;7434;bestmove;f3e4
depth;18;nodes;1945;nps;186;winrate;60.18%;time;9841;bestmove;d1f3
depth;19;nodes;2256;nps;189;winrate;56.13%;time;10916;bestmove;c1e1
depth;18;nodes;1812;nps;181;winrate;59.54%;time;9757;bestmove;e1e2
depth;19;nodes;2186;nps;190;winrate;62.49%;time;11478;bestmove;c4d5
depth;19;nodes;2297;nps;209;winrate;56.95%;time;10982;bestmove;e4f5
depth;18;nodes;1631;nps;190;winrate;55.75%;time;3381;bestmove;b2c3
depth;18;nodes;1326;nps;186;winrate;55.05%;time;5406;bestmove;f3f5
depth;18;nodes;2148;nps;188;winrate;57.16%;time;5003;bestmove;g1h1
depth;18;nodes;1548;nps;172;winrate;57.68%;time;8931;bestmove;c3b4
depth;18;nodes;1519;nps;163;winrate;60.80%;time;6422;bestmove;e2e6
depth;18;nodes;1738;nps;166;winrate;65.51%;time;6070;bestmove;f5e4
depth;18;nodes;1660;nps;180;winrate;67.64%;time;7547;bestmove;h3h4
depth;19;nodes;3435;nps;173;winrate;67.26%;time;11821;bestmove;g2g4
depth;19;nodes;2383;nps;178;winrate;79.83%;time;13147;bestmove;b4c5
depth;18;nodes;1580;nps;178;winrate;75.98%;time;8814;bestmove;g4g5
depth;18;nodes;2201;nps;184;winrate;76.75%;time;11235;bestmove;c5a3
depth;18;nodes;2376;nps;191;winrate;74.37%;time;7838;bestmove;a3b4
depth;19;nodes;4343;nps;202;winrate;76.23%;time;10771;bestmove;h4h5
depth;19;nodes;4476;nps;212;winrate;77.78%;time;10286;bestmove;e4e5
depth;19;nodes;4297;nps;201;winrate;76.57%;time;21001;bestmove;g5g6
depth;19;nodes;5259;nps;241;winrate;74.62%;time;10911;bestmove;h5g6
depth;21;nodes;16985;nps;310;winrate;72.40%;time;40076;bestmove;f1f3
depth;21;nodes;19067;nps;742;winrate;70.36%;time;17221;bestmove;h1g2
depth;18;nodes;3171;nps;343;winrate;81.98%;time;9177;bestmove;e6e7
depth;20;nodes;8534;nps;829;winrate;78.73%;time;7498;bestmove;f3f2
depth;20;nodes;13126;nps;1028;winrate;78.44%;time;4669;bestmove;g2f2
depth;22;nodes;44397;nps;2195;winrate;77.78%;time;14425;bestmove;f2e1
depth;22;nodes;30891;nps;2357;winrate;71.46%;time;9235;bestmove;e1e2
depth;22;nodes;38676;nps;2051;winrate;66.12%;time;7202;bestmove;e2e1
depth;21;nodes;17079;nps;1593;winrate;77.61%;time;10674;bestmove;e1d2
depth;22;nodes;37161;nps;3191;winrate;77.90%;time;11608;bestmove;d2c1
depth;23;nodes;80933;nps;3962;winrate;75.87%;time;15428;bestmove;c1d2
depth;23;nodes;53615;nps;2393;winrate;74.74%;time;6007;bestmove;d2d1
depth;22;nodes;53379;nps;1496;winrate;71.62%;time;13146;bestmove;d1d2
depth;21;nodes;22617;nps;1279;winrate;69.28%;time;3222;bestmove;d2d1
depth;20;nodes;16470;nps;823;winrate;66.95%;time;1017;bestmove;d1c1
depth;20;nodes;7569;nps;530;winrate;47.23%;time;14265;bestmove;c1b2
depth;19;nodes;3564;nps;180;winrate;46.30%;time;1010;bestmove;b2b3
depth;20;nodes;6389;nps;269;winrate;44.45%;time;12359;bestmove;e5c7
depth;18;nodes;3284;nps;225;winrate;43.87%;time;2242;bestmove;d5d6
depth;17;nodes;1702;nps;223;winrate;51.85%;time;6754;bestmove;d6d7
depth;18;nodes;3494;nps;263;winrate;42.29%;time;12725;bestmove;b3b2
depth;18;nodes;2829;nps;250;winrate;42.21%;time;10805;bestmove;e7g7
depth;18;nodes;4083;nps;357;winrate;44.19%;time;7115;bestmove;d7d8q
depth;18;nodes;35310;nps;4033;winrate;2.82%;time;8749;bestmove;b2c2
depth;18;nodes;357784;nps;37388;winrate;0.38%;time;8875;bestmove;c2d3
depth;19;nodes;540805;nps;42285;winrate;0.10%;time;7531;bestmove;d3e4

Code: Select all

game;1;of;140;(LCZero_04ID107;vs;Anechka_008)
depth;20;nodes;4799;nps;144;winrate;49.62%;time;33402;bestmove;b1d2
depth;20;nodes;4412;nps;131;winrate;52.51%;time;33519;bestmove;e1g1
depth;20;nodes;4617;nps;130;winrate;52.46%;time;33650;bestmove;h2h3
depth;20;nodes;4908;nps;137;winrate;52.05%;time;33782;bestmove;a2a3
depth;19;nodes;4172;nps;122;winrate;52.90%;time;33926;bestmove;b3b4
depth;20;nodes;4350;nps;127;winrate;53.32%;time;34035;bestmove;b4b5
depth;20;nodes;5474;nps;131;winrate;52.70%;time;34202;bestmove;a3a4
depth;20;nodes;6689;nps;133;winrate;51.79%;time;34332;bestmove;f1e1
depth;20;nodes;4184;nps;110;winrate;50.18%;time;34501;bestmove;c2c4
depth;20;nodes;4843;nps;113;winrate;50.43%;time;34646;bestmove;b5c6
depth;20;nodes;4838;nps;119;winrate;50.25%;time;34811;bestmove;c4d5
depth;20;nodes;5105;nps;125;winrate;51.84%;time;34979;bestmove;a1b1
depth;20;nodes;3375;nps;96;winrate;53.31%;time;35159;bestmove;b2a1
depth;19;nodes;3010;nps;76;winrate;53.61%;time;35332;bestmove;e1f1
depth;20;nodes;3509;nps;96;winrate;57.88%;time;35515;bestmove;b1b2
depth;20;nodes;5626;nps;96;winrate;57.50%;time;35682;bestmove;f3g5
depth;20;nodes;3500;nps;87;winrate;58.54%;time;35847;bestmove;d2e4
depth;20;nodes;4018;nps;108;winrate;57.49%;time;36016;bestmove;g5e4
depth;20;nodes;4014;nps;109;winrate;59.27%;time;36171;bestmove;d1b1
depth;20;nodes;4025;nps;108;winrate;58.82%;time;36302;bestmove;f1d1
depth;20;nodes;4850;nps;106;winrate;56.95%;time;36420;bestmove;e2f1
depth;20;nodes;4480;nps;112;winrate;54.46%;time;36475;bestmove;b2a2
depth;21;nodes;6259;nps;171;winrate;56.22%;time;36502;bestmove;a2b2
depth;20;nodes;4126;nps;110;winrate;56.31%;time;36470;bestmove;b2a2
depth;20;nodes;4025;nps;109;winrate;57.18%;time;36375;bestmove;d1c1
depth;21;nodes;7074;nps;120;winrate;56.08%;time;36200;bestmove;c1c8
depth;21;nodes;8870;nps;126;winrate;56.14%;time;35968;bestmove;d3d4
depth;22;nodes;12999;nps;160;winrate;55.31%;time;35664;bestmove;a1d4
depth;22;nodes;13741;nps;156;winrate;53.76%;time;35361;bestmove;d4e5
depth;20;nodes;3960;nps;113;winrate;58.59%;time;35064;bestmove;h3h4
depth;20;nodes;3828;nps;109;winrate;50.48%;time;34860;bestmove;g2g3
depth;20;nodes;4047;nps;115;winrate;47.82%;time;34891;bestmove;e5d4
depth;21;nodes;5927;nps;110;winrate;46.64%;time;35527;bestmove;h4h5
depth;20;nodes;3802;nps;92;winrate;41.56%;time;38265;bestmove;h5h6
depth;20;nodes;5859;nps;98;winrate;45.58%;time;59635;bestmove;b1e1
depth;20;nodes;7023;nps;118;winrate;34.31%;time;57354;bestmove;e1e2
depth;21;nodes;9130;nps;107;winrate;34.23%;time;55044;bestmove;f2f3
depth;20;nodes;5930;nps;110;winrate;34.79%;time;52830;bestmove;d4f6
depth;20;nodes;6598;nps;123;winrate;43.03%;time;50677;bestmove;e4f6
depth;20;nodes;5994;nps;112;winrate;39.85%;time;48596;bestmove;e2d2
depth;21;nodes;8978;nps;115;winrate;40.86%;time;46580;bestmove;d2e2
depth;20;nodes;7287;nps;112;winrate;41.00%;time;44640;bestmove;e2f2
depth;20;nodes;5324;nps;123;winrate;49.17%;time;42786;bestmove;a2a6
depth;19;nodes;4102;nps;100;winrate;48.34%;time;40988;bestmove;a6a7
depth;20;nodes;7219;nps;93;winrate;47.84%;time;39304;bestmove;g1h2
depth;19;nodes;3266;nps;87;winrate;25.27%;time;37640;bestmove;f1e2
depth;19;nodes;5167;nps;94;winrate;21.69%;time;36067;bestmove;f3f4
depth;20;nodes;8282;nps;124;winrate;21.53%;time;34581;bestmove;f2e2
depth;18;nodes;4097;nps;123;winrate;12.57%;time;33173;bestmove;h2g1
depth;20;nodes;8567;nps;146;winrate;7.60%;time;31793;bestmove;g1f2
depth;20;nodes;11307;nps;125;winrate;6.18%;time;30461;bestmove;f2f3
depth;21;nodes;14699;nps;131;winrate;5.84%;time;29213;bestmove;f3e4
depth;21;nodes;18218;nps;136;winrate;5.23%;time;28082;bestmove;e4e5
depth;19;nodes;4249;nps;146;winrate;6.52%;time;26866;bestmove;e5d4
depth;20;nodes;7599;nps;161;winrate;4.80%;time;25787;bestmove;d4e5
depth;18;nodes;3599;nps;118;winrate;4.85%;time;24772;bestmove;e5d6
depth;19;nodes;4711;nps;108;winrate;4.03%;time;23753;bestmove;g3g4
depth;18;nodes;2845;nps;123;winrate;3.93%;time;22831;bestmove;d6e7
depth;18;nodes;3445;nps;127;winrate;3.66%;time;21929;bestmove;e7f8
depth;18;nodes;4575;nps;90;winrate;3.62%;time;21083;bestmove;f8e8
depth;17;nodes;1798;nps;86;winrate;3.99%;time;20284;bestmove;e8f7
depth;16;nodes;1445;nps;72;winrate;3.49%;time;19528;bestmove;f7e8
depth;17;nodes;4056;nps;209;winrate;1.64%;time;18778;bestmove;f4f5
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy