LCZero progress

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                  :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30    :  1077.6  178.9    97.0     100    97
   2 Stockfish 130418 D15    :   467.8   68.9   551.5     700    79
   3 LC0 173_101eeb41 N4k    :   105.3   85.0    22.5     200    11
   4 LC0 173_101eeb41 N2k    :    39.2   96.5    16.0     200     8
   5 LC0 173_101eeb41 N1k    :     0.0   ----    13.0     200     7

White advantage = 15.53 +/- 14.63
Draw rate (equal opponents) = 50.00 % +/- 0.00
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Small update:

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30     :  1096.6  153.6   134.0     138    97
   2 Stockfish 130418 D15     :   473.9   64.2   629.0     826    76
   3 LC0 173_101eeb41 N16k    :   244.3  217.4     2.0       9    22
   4 LC0 173_101eeb41 N8k     :   118.7  116.3     9.5      79    12
   5 LC0 173_101eeb41 N4k     :   106.0   86.0    22.5     200    11
   6 LC0 173_101eeb41 N2k     :    39.4   95.6    16.0     200     8
   7 LC0 173_101eeb41 N1k     :     0.0   ----    13.0     200     7

White advantage = 52.22 +/- 17.27
Draw rate (equal opponents) = 50.00 % +/- 0.00
Top
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: LCZero progress

Post by Albert Silver »

Edsel Apostol wrote:Interesting! I would be curious to see a match with SF searching the same number of fixed nodes as well.
You cannot compare. For Stockfish, a node is a single board position, while for Leela a node is a full game.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
Top
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: LCZero progress

Post by Gian-Carlo Pascutto »

Albert Silver wrote:while for Leela a node is a full game.
She doesn't play out games (there's no actual Monte Carlo simulation in the MCTS search).

But yes, obviously the amount of processing done per node is not comparable at all.
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30     :  1059.4  127.3   172.5     179    96
   2 Stockfish 130418 D15     :   475.9   67.6   688.0     937    73
   3 LC0 173_101eeb41 N16k    :   193.7  148.2     4.0      23    17
   4 LC0 173_101eeb41 N8k     :   172.1   89.2    21.0     135    16
   5 LC0 173_101eeb41 N4k     :   106.2   86.0    22.5     200    11
   6 LC0 173_101eeb41 N2k     :    39.5   93.9    16.0     200     8
   7 LC0 173_101eeb41 N1k     :     0.0   ----    13.0     200     7

White advantage = 59.62 +/- 12.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

[pgn][Event "?"]
[Site "?"]
[Date "2018.04.25"]
[Round "9"]
[White "LC0 173_101eeb41 N16k"]
[Black "Stockfish 130418 D15"]
[Result "1-0"]
[BlackTimeControl "inf"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
[GameEndTime "2018-04-25T23:40:26.329 RTZ 2 (зима)"]
[GameStartTime "2018-04-25T21:56:06.066 RTZ 2 (зима)"]
[PlyCount "121"]
[SetUp "1"]
[WhiteTimeControl "inf"]

1. e4 {book} e5 {book} 2. Bc4 {book} d6 {book} 3. Nf3 {book} Be7 {book}
4. Nc3 {+0.14/22 170s} Nf6 {-0.33/15 0.49s} 5. d4 {+0.13/22 130s}
exd4 {-0.31/15 0.27s} 6. Nxd4 {+0.11/21 90s} O-O {-0.13/15 0.31s}
7. Bf4 {+0.08/22 187s} a6 {-0.48/15 0.81s} 8. Qd2 {+0.16/22 240s}
c5 {+0.10/15 0.63s} 9. Nf5 {+0.36/21 130s} Bxf5 {-0.14/15 0.40s}
10. exf5 {+0.37/21 8.6s} Nc6 {+0.01/15 0.30s} 11. O-O-O {+0.40/21 52s}
Rc8 {-0.19/15 0.48s} 12. Bd5 {+0.37/21 150s} Nd4 {-0.31/15 0.78s}
13. g4 {+0.44/21 54s} Nxg4 {-0.36/15 0.53s} 14. Rhg1 {+0.73/21 62s}
Nf6 {-0.36/15 0.19s} 15. Bh6 {+0.78/21 49s} Nh5 {-0.40/15 0.26s}
16. Bxg7 {+3.25/21 97s} Nxg7 {-5.22/15 0.15s} 17. Qh6 {+4.19/20 6.9s}
Bf6 {-5.38/15 0.049s} 18. Ne4 {+4.53/21 84s} Be5 {-5.44/15 0.043s}
19. Rxd4 {+5.11/21 82s} Kh8 {-6.34/15 0.059s} 20. Ng5 {+6.31/20 25s}
Qxg5+ {-6.35/15 0.037s} 21. Qxg5 {+6.72/20 16s} Bxd4 {-6.06/15 0.072s}
22. f6 {+6.69/20 50s} Ne6 {-5.24/15 0.059s} 23. Bxe6 {+7.57/20 69s}
Rg8 {-5.65/15 0.074s} 24. Bxc8 {+7.62/20 9.7s} Rxg5 {-6.02/15 0.075s}
25. Rxg5 {+8.40/20 23s} Bxf6 {-6.14/15 0.059s} 26. Rg2 {+8.97/21 103s}
b6 {-6.38/15 0.14s} 27. Bxa6 {+9.94/20 117s} h6 {-6.29/15 0.058s}
28. a4 {+10.41/21 186s} Bg5+ {-5.77/15 0.087s} 29. Kb1 {+10.96/21 126s}
d5 {-6.45/15 0.097s} 30. Bb7 {+11.50/21 171s} d4 {-6.62/15 0.059s}
31. Be4 {+11.94/21 158s} Be7 {-7.01/15 0.16s} 32. Bd5 {+12.75/21 124s}
Bg5 {-7.23/15 0.066s} 33. f4 {+12.16/21 150s} Bxf4 {-7.02/15 0.068s}
34. Rf2 {+12.56/21 138s} Bg5 {-7.21/15 0.052s} 35. Rxf7 {+14.16/20 88s}
Bd2 {-6.68/15 0.041s} 36. Rb7 {+14.72/21 155s} Ba5 {-7.25/15 0.032s}
37. Be4 {+15.18/21 188s} Kg8 {-6.57/15 0.047s} 38. Bd5+ {+14.30/21 138s}
Kf8 {-6.57/15 0.030s} 39. Ka2 {+13.45/21 125s} Ke8 {-7.45/15 0.093s}
40. Kb3 {+14.73/21 144s} Kf8 {-7.50/15 0.19s} 41. Kc4 {+15.76/20 116s}
h5 {-7.95/15 0.089s} 42. Be6 {+16.15/21 155s} h4 {-7.74/15 0.13s}
43. Kd5 {+17.29/20 124s} Bd2 {-7.85/15 0.15s} 44. Ke5 {+18.80/20 126s}
Ke8 {-8.30/15 0.28s} 45. Kf6 {+18.92/21 141s} Bf4 {-8.39/15 0.073s}
46. Rxb6 {+18.54/20 97s} Bc7 {-8.49/15 0.007s} 47. Rc6 {+18.12/21 153s}
Bd8+ {-8.87/15 0.10s} 48. Ke5 {+16.58/20 71s} h3 {-9.06/15 0.12s}
49. Kd6 {+17.44/20 145s} Be7+ {-9.00/15 0.092s} 50. Ke5 {+16.95/20 71s}
Kf8 {-9.19/15 0.052s} 51. Rc8+ {+19.65/21 177s} Kg7 {-9.20/15 0.013s}
52. Rg8+ {+20.79/21 132s} Kh7 {-9.77/15 0.082s} 53. Re8 {+21.86/20 118s}
Bg5 {-13.34/15 0.25s} 54. Kf5 {+22.27/21 149s} Bh4 {-9.08/15 0.071s}
55. a5 {+23.49/21 141s} c4 {-16.28/15 0.047s} 56. a6 {+26.20/20 111s}
Kh6 {-M10/15 0.035s} 57. a7 {+37.91/20 100s} c3 {-M8/15 0.005s}
58. a8=Q {+50.75/20 103s} Bd8 {-M6/15 0.002s} 59. Rh8+ {+68.79/20 90s}
Kg7 {-M4/15 0.001s} 60. Qxd8 {+76.96/19 24s} d3 {-M2/15 0.001s}
61. Qg8# {+113.82/17 10s, White mates} 1-0
[/pgn]
Top
User avatar
Rubinus
Posts: 1161
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: LCZero progress

Post by Rubinus »

majortom wrote:[pgn][Event "?"]
[Site "?"]
[Date "2018.04.25"]
[Round "9"]
[White "LC0 173_101eeb41 N16k"]
[Black "Stockfish 130418 D15"]
[Result "1-0"]
[BlackTimeControl "inf"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
[GameEndTime "2018-04-25T23:40:26.329 RTZ 2 (зима)"]
[GameStartTime "2018-04-25T21:56:06.066 RTZ 2 (зима)"]
[PlyCount "121"]
[SetUp "1"]
[WhiteTimeControl "inf"]

1. e4 {book} e5 {book} 2. Bc4 {book} d6 {book} 3. Nf3 {book} Be7 {book}
4. Nc3 {+0.14/22 170s} Nf6 {-0.33/15 0.49s} 5. d4 {+0.13/22 130s}
exd4 {-0.31/15 0.27s} 6. Nxd4 {+0.11/21 90s} O-O {-0.13/15 0.31s}
7. Bf4 {+0.08/22 187s} a6 {-0.48/15 0.81s} 8. Qd2 {+0.16/22 240s}
c5 {+0.10/15 0.63s} 9. Nf5 {+0.36/21 130s} Bxf5 {-0.14/15 0.40s}
10. exf5 {+0.37/21 8.6s} Nc6 {+0.01/15 0.30s} 11. O-O-O {+0.40/21 52s}
Rc8 {-0.19/15 0.48s} 12. Bd5 {+0.37/21 150s} Nd4 {-0.31/15 0.78s}
13. g4 {+0.44/21 54s} Nxg4 {-0.36/15 0.53s} 14. Rhg1 {+0.73/21 62s}
Nf6 {-0.36/15 0.19s} 15. Bh6 {+0.78/21 49s} Nh5 {-0.40/15 0.26s}
16. Bxg7 {+3.25/21 97s} Nxg7 {-5.22/15 0.15s} 17. Qh6 {+4.19/20 6.9s}
Bf6 {-5.38/15 0.049s} 18. Ne4 {+4.53/21 84s} Be5 {-5.44/15 0.043s}
19. Rxd4 {+5.11/21 82s} Kh8 {-6.34/15 0.059s} 20. Ng5 {+6.31/20 25s}
Qxg5+ {-6.35/15 0.037s} 21. Qxg5 {+6.72/20 16s} Bxd4 {-6.06/15 0.072s}
22. f6 {+6.69/20 50s} Ne6 {-5.24/15 0.059s} 23. Bxe6 {+7.57/20 69s}
Rg8 {-5.65/15 0.074s} 24. Bxc8 {+7.62/20 9.7s} Rxg5 {-6.02/15 0.075s}
25. Rxg5 {+8.40/20 23s} Bxf6 {-6.14/15 0.059s} 26. Rg2 {+8.97/21 103s}
b6 {-6.38/15 0.14s} 27. Bxa6 {+9.94/20 117s} h6 {-6.29/15 0.058s}
28. a4 {+10.41/21 186s} Bg5+ {-5.77/15 0.087s} 29. Kb1 {+10.96/21 126s}
d5 {-6.45/15 0.097s} 30. Bb7 {+11.50/21 171s} d4 {-6.62/15 0.059s}
31. Be4 {+11.94/21 158s} Be7 {-7.01/15 0.16s} 32. Bd5 {+12.75/21 124s}
Bg5 {-7.23/15 0.066s} 33. f4 {+12.16/21 150s} Bxf4 {-7.02/15 0.068s}
34. Rf2 {+12.56/21 138s} Bg5 {-7.21/15 0.052s} 35. Rxf7 {+14.16/20 88s}
Bd2 {-6.68/15 0.041s} 36. Rb7 {+14.72/21 155s} Ba5 {-7.25/15 0.032s}
37. Be4 {+15.18/21 188s} Kg8 {-6.57/15 0.047s} 38. Bd5+ {+14.30/21 138s}
Kf8 {-6.57/15 0.030s} 39. Ka2 {+13.45/21 125s} Ke8 {-7.45/15 0.093s}
40. Kb3 {+14.73/21 144s} Kf8 {-7.50/15 0.19s} 41. Kc4 {+15.76/20 116s}
h5 {-7.95/15 0.089s} 42. Be6 {+16.15/21 155s} h4 {-7.74/15 0.13s}
43. Kd5 {+17.29/20 124s} Bd2 {-7.85/15 0.15s} 44. Ke5 {+18.80/20 126s}
Ke8 {-8.30/15 0.28s} 45. Kf6 {+18.92/21 141s} Bf4 {-8.39/15 0.073s}
46. Rxb6 {+18.54/20 97s} Bc7 {-8.49/15 0.007s} 47. Rc6 {+18.12/21 153s}
Bd8+ {-8.87/15 0.10s} 48. Ke5 {+16.58/20 71s} h3 {-9.06/15 0.12s}
49. Kd6 {+17.44/20 145s} Be7+ {-9.00/15 0.092s} 50. Ke5 {+16.95/20 71s}
Kf8 {-9.19/15 0.052s} 51. Rc8+ {+19.65/21 177s} Kg7 {-9.20/15 0.013s}
52. Rg8+ {+20.79/21 132s} Kh7 {-9.77/15 0.082s} 53. Re8 {+21.86/20 118s}
Bg5 {-13.34/15 0.25s} 54. Kf5 {+22.27/21 149s} Bh4 {-9.08/15 0.071s}
55. a5 {+23.49/21 141s} c4 {-16.28/15 0.047s} 56. a6 {+26.20/20 111s}
Kh6 {-M10/15 0.035s} 57. a7 {+37.91/20 100s} c3 {-M8/15 0.005s}
58. a8=Q {+50.75/20 103s} Bd8 {-M6/15 0.002s} 59. Rh8+ {+68.79/20 90s}
Kg7 {-M4/15 0.001s} 60. Qxd8 {+76.96/19 24s} d3 {-M2/15 0.001s}
61. Qg8# {+113.82/17 10s, White mates} 1-0
[/pgn]
Some handicap time? Time LCO-SF cca 200:1.
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Image
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Rubinus wrote:Some handicap time? Time LCO-SF cca 200:1.
LCZero ID173 - 16000 nodes per move vs. SF 130418 at 15 depth, and, of course, time per move is not equal.

BTW, about test conditions you can read on the first page.
Top
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                  :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30    :   581.4   92.2   193.0     200    97
   2 Stockfish 130418 D15    :     0.0   ----     7.0     200     4

White advantage = 7.01 +/- 12.78
Draw rate (equal opponents) = 50.00 % +/- 0.00
Games

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30     :  1066.8  127.3   193.0     200    97
   2 Stockfish 130418 D15     :   476.1   69.2   724.5    1002    72
   3 LC0 173_101eeb41 N16k    :   217.8  128.6     6.0      31    19
   4 LC0 173_101eeb41 N8k     :   175.4   85.7    27.0     171    16
   5 LC0 173_101eeb41 N4k     :   106.2   87.8    22.5     200    11
   6 LC0 173_101eeb41 N2k     :    39.5   97.9    16.0     200     8
   7 LC0 173_101eeb41 N1k     :     0.0   ----    13.0     200     7

White advantage = 60.22 +/- 14.13
Draw rate (equal opponents) = 50.00 % +/- 0.00
Top

Return to “Computer Chess Club: Tournaments and Matches”