Lc0 v18 rc2 for 2080 Syzygy implementation

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Laskos »

jkiliani wrote: ↑Tue Oct 02, 2018 12:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 10:41 am
crem wrote: ↑Tue Oct 02, 2018 8:48 am
Laskos wrote: ↑Mon Oct 01, 2018 11:16 pm
can00336 wrote: ↑Mon Oct 01, 2018 10:47 pm Thanks for finding a bug in the implementation. A proposed fix is available here: https://github.com/LeelaChessZero/lc0/pull/408
You can download a CUDA binary to try the fix here: https://ci.appveyor.com/api/buildjobs/g ... %2Flc0.exe
No, still misses wins as 3-fold rep. at steady rate.
Hi Laskos,

We have a fix for that https://github.com/LeelaChessZero/lc0/pull/410, which we have no way to check currently. Would it be possible for you to test it? The deadline for CCCC binary submission is today, and we'll have to release v0.18.1 today with a fix.
As a last resort we can push this patch blindly, but it would be nice to have it tested. :D
The CUDA build of Lc0 with this patch is https://ci.appveyor.com/api/buildjobs/3 ... %2Flc0.exe

Thanks!
Sill misses by 3-fold, seems at lower rate, only 3 misses out of 100 positions. Time control for Lc0 is 0.5s/move, but as I already wrote, it seems to not matter, and even on easy 6-men wins it misses at pretty much the same rate. Here is the PGN of misses:

[pgn] [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "49"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:04"] [GameEndTime "2018-10-02T10:33:45.395 GTB Daylight Time"] [GameStartTime "2018-10-02T10:33:41.026 GTB Daylight Time"] [PlyCount "20"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/1pk5/K7/8/8/Qr6/4Q3 w - - 0 1"] 1. Ka4 Rxa2+ {-128.51/35 0.20s} 2. Kb3 {+7.20/5 0.50s} 2. ... Ra6 { -128.51/31 0.20s} 3. Kb4 {+7.91/5 0.49s} 3. ... Ra7 {-128.51/33 0.20s} 4. Kc3 {+5.36/4 0.027s} 4. ... Ra3+ {-128.51/33 0.20s} 5. Kb4 {+8.56/5 0.50s} 5. ... Ra7 {-128.51/127 0.002s} 6. Kc3 {+4.75/3 0.022s} 6. ... Ra3+ { -128.51/127 0.001s} 7. Kd2 {+5.06/2 0.016s} 7. ... Ra2+ {-128.51/30 0.20s} 8. Kd3 {+5.39/5 0.50s} 8. ... Ra3+ {-128.51/34 0.20s} 9. Kc2 {+5.71/6 0.52s} 9. ... Ra2+ {-128.51/38 0.20s} 10. Kc3 {+0.63/3 0.041s} 10. ... Ra3+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "145"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:01:27"] [GameEndTime "2018-10-02T11:17:06.373 GTB Daylight Time"] [GameStartTime "2018-10-02T11:15:39.176 GTB Daylight Time"] [PlyCount "270"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/8/Q7/8/8/1Pp1P3/1k1K4 w - - 0 1"] 1. Kd2 c1=Q+ {-128.51/15 0.20s} 2. Kd3 Qc2+ {-128.51/17 0.20s} 3. Ke3 Qc1+ {-128.51/19 0.20s} 4. Ke4 {+4.30/5 0.44s} 4. ... Qc4+ {-128.51/15 0.20s} 5. Kf3 {+4.44/6 0.047s} 5. ... Qf7+ {-128.51/16 0.20s} 6. Kg3 {+3.85/6 0.50s} 6. ... Qg7+ {-128.51/17 0.20s} 7. Kf4 {+3.88/6 0.50s} 7. ... Qd4+ { -128.51/18 0.20s} 8. Kf3 {+4.42/7 0.096s} 8. ... Qf6+ {-128.51/20 0.20s} 9. Ke4 {+5.22/6 0.54s} 9. ... Qxb2 {-128.51/20 0.20s} 10. Qa6 Kc1 { -128.51/22 0.20s} 11. Kd5 Kd1 {-128.51/18 0.20s} 12. Qd3+ Ke1 {-128.51/22 0.20s} 13. e4 {+128.00/2 0.46s} 13. ... Qb7+ {-128.51/20 0.20s} 14. Ke6 { +3.34/5 0.50s} 14. ... Qc6+ {-128.51/21 0.20s} 15. Kf7 {+3.44/6 0.52s} 15. ... Qb7+ {-128.51/20 0.20s} 16. Kg6 {+3.67/6 0.50s} 16. ... Qc6+ { -128.51/21 0.20s} 17. Kg5 {+3.75/6 0.47s} 17. ... Qc5+ {-128.51/21 0.20s} 18. Qd5 {+7.17/5 0.51s} 18. ... Qe7+ {-128.51/22 0.20s} 19. Kg6 {+6.02/6 0.50s} 19. ... Qe8+ {-128.51/21 0.20s} 20. Kf6 {+4.76/6 0.50s} 20. ... Qf8+ {-128.51/19 0.20s} 21. Kg5 {+4.43/6 0.51s} 21. ... Qe7+ {-128.51/41 0.20s} 22. Kg4 {+4.01/6 0.083s} 22. ... Qg7+ {-128.51/19 0.20s} 23. Kf5 { +4.55/6 0.50s} 23. ... Qf8+ {-128.51/19 0.20s} 24. Ke5 {+4.02/6 0.50s} 24. ... Qh8+ {-128.51/17 0.20s} 25. Ke6 {+4.58/5 0.47s} 25. ... Qh6+ { -128.51/22 0.20s} 26. Kd7 {+6.04/6 0.50s} 26. ... Qg7+ {-128.51/21 0.20s} 27. Kc8 {+6.48/6 0.50s} 27. ... Qc3+ {-128.51/23 0.20s} 28. Kb7 {+6.52/6 0.50s} 28. ... Qg7+ {-128.51/22 0.20s} 29. Ka6 {+7.96/6 0.54s} 29. ... Qf6+ {-128.51/19 0.20s} 30. Kb5 {+7.47/6 0.51s} 30. ... Qb2+ {-128.51/21 0.20s} 31. Ka4 {+7.65/5 0.48s} 31. ... Qc2+ {-128.51/17 0.20s} 32. Ka5 { +8.57/6 0.50s} 32. ... Qc3+ {-128.51/23 0.20s} 33. Ka4 {+6.60/6 0.51s} 33. ... Qc2+ {-128.51/39 0.20s} 34. Kb5 {+4.34/7 0.058s} 34. ... Qb2+ { -128.51/127 0.002s} 35. Kc6 {+2.17/3 0.036s} 35. ... Qh8 {-128.51/16 0.20s } 36. Qe6 {+4.63/5 0.51s} 36. ... Qc3+ {-128.51/19 0.20s} 37. Kd7 {+4.47/6 0.51s} 37. ... Qg7+ {-128.51/19 0.20s} 38. Kd6 {+4.51/7 0.50s} 38. ... Qd4+ {-128.51/20 0.20s} 39. Qd5 {+3.89/6 0.57s} 39. ... Qf6+ {-128.51/24 0.20s} 40. Kc7 {+3.61/6 0.56s} 40. ... Qc3+ {-128.51/22 0.20s} 41. Kb8 { +3.29/6 0.50s} 41. ... Qb2+ {-128.51/24 0.20s} 42. Kc8 {+3.22/6 0.50s} 42. ... Qc3+ {-128.51/48 0.20s} 43. Kd7 {+2.39/7 0.12s} 43. ... Qg7+ { -128.51/127 0.002s} 44. Kc6 {+1.70/4 0.069s} 44. ... Qh8 {-128.51/59 0.20s } 45. Qf5 {+1.92/2 0.026s} 45. ... Qa8+ {-128.51/16 0.20s} 46. Kb5 { +2.54/5 0.50s} 46. ... Qb7+ {-128.51/20 0.20s} 47. Kc5 {+1.57/6 0.078s} 47. ... Qc7+ {-128.51/19 0.20s} 48. Kd5 {+1.44/5 0.026s} 48. ... Qb7+ { -128.51/19 0.20s} 49. Ke6 {+1.83/6 0.46s} 49. ... Qb3+ {-128.51/19 0.20s} 50. Kf6 {+2.35/6 0.50s} 50. ... Qb6+ {-128.51/20 0.20s} 51. Kg5 {+2.17/6 0.47s} 51. ... Qd8+ {-128.51/18 0.20s} 52. Qf6 {+1.94/6 0.048s} 52. ... Qd2+ {-128.51/17 0.20s} 53. Qf4 {+1.32/6 0.022s} 53. ... Qd8+ {-128.51/18 0.20s} 54. Kh5 {+1.13/5 0.034s} 54. ... Qe8+ {-128.51/19 0.20s} 55. Kh4 { +1.07/4 0.026s} 55. ... Qd8+ {-128.51/20 0.20s} 56. Kh3 {+1.42/4 0.026s} 56. ... Qd7+ {-128.51/21 0.20s} 57. Kh2 {+0.77/2 0.018s} 57. ... Qh7+ { -128.51/20 0.20s} 58. Kg2 Qb7 {-128.51/22 0.20s} 59. Kf3 Qc6 {-128.51/20 0.20s} 60. Qg5 Qc3+ {-128.51/15 0.20s} 61. Qe3+ Kd1 {-128.51/17 0.20s} 62. e5 {+128.00/1 0.061s} 62. ... Qc6+ {-128.51/15 0.20s} 63. Qe4 {+12.25/5 0.45s} 63. ... Qe6 {-128.51/15 0.20s} 64. Kf4 {+10.02/5 0.50s} 64. ... Qf7+ {-128.51/16 0.20s} 65. Qf5 {+15.41/5 0.54s} 65. ... Qc7 {-128.51/17 0.20s} 66. Kg5 {+14.04/5 0.51s} 66. ... Qd8+ {-128.51/17 0.20s} 67. Qf6 { +19.64/5 0.50s} 67. ... Qd2+ {-128.51/15 0.20s} 68. Kg6 {+15.87/5 0.50s} 68. ... Qg2+ {-128.51/15 0.20s} 69. Kf7 {+13.02/5 0.46s} 69. ... Qb7+ { -128.51/18 0.20s} 70. Qe7 {+12.94/5 0.52s} 70. ... Qf3+ {-128.51/17 0.20s} 71. Ke8 {+16.37/5 0.50s} 71. ... Qh5+ {-128.51/18 0.20s} 72. Kd8 {+23.68/5 0.50s} 72. ... Qh1 {-128.51/20 0.20s} 73. Qd6+ {+27.20/4 0.50s} 73. ... Ke2 {-128.51/21 0.20s} 74. e6 {+128.00/2 0.50s} 74. ... Qa8+ {-128.51/21 0.20s} 75. Kd7 {+13.64/5 0.50s} 75. ... Qa4+ {-128.51/19 0.20s} 76. Qc6 { +16.29/5 0.50s} 76. ... Qd4+ {-128.51/18 0.20s} 77. Ke8 {+14.46/5 0.50s} 77. ... Qh8+ {-128.51/15 0.20s} 78. Kd7 {+12.86/6 0.49s} 78. ... Qd4+ { -128.51/40 0.20s} 79. Kc8 {+12.21/5 0.51s} 79. ... Qh8+ {-128.51/17 0.20s} 80. Kc7 {+12.02/5 0.50s} 80. ... Qg7+ {-128.51/16 0.20s} 81. Qd7 {+13.17/5 0.54s} 81. ... Qc3+ {-128.51/17 0.20s} 82. Kb6 {+16.91/5 0.50s} 82. ... Qe3+ {-128.51/18 0.20s} 83. Kb7 {+15.93/5 0.50s} 83. ... Qb3+ {-128.51/18 0.20s} 84. Kc7 {+12.30/5 0.50s} 84. ... Qc3+ {-128.51/42 0.20s} 85. Qc6 { +6.62/6 0.050s} 85. ... Qg7+ {-128.51/42 0.20s} 86. Kb6 {+10.55/3 0.024s} 86. ... Qd4+ {-128.51/16 0.20s} 87. Qc5 {+15.59/5 0.55s} 87. ... Qf6 { -128.51/17 0.20s} 88. Qd6 {+17.49/5 0.50s} 88. ... Qb2+ {-128.51/17 0.20s} 89. Kc7 {+19.47/5 0.51s} 89. ... Qc2+ {-128.51/17 0.20s} 90. Kd8 {+25.03/4 0.50s} 90. ... Qe4 {-128.51/17 0.20s} 91. e7 {+128.00/2 0.52s} 91. ... Qa8+ {-128.51/17 0.20s} 92. Kd7 {+18.34/5 0.50s} 92. ... Qb7+ {-128.51/13 0.20s} 93. Ke6 {+19.35/5 0.50s} 93. ... Qc8+ {-128.51/14 0.20s} 94. Kf7 { +17.35/5 0.50s} 94. ... Qf5+ {-128.51/13 0.20s} 95. Qf6 {+26.58/5 0.50s} 95. ... Qh5+ {-M112/14 0.20s} 96. Kf8 {+30.26/5 0.53s} 96. ... Qc5 { -128.51/17 0.20s} 97. Kg7 {+22.48/5 0.50s} 97. ... Qc7 {-128.51/13 0.20s} 98. Kf8 {+26.23/4 0.51s} 98. ... Qc5 {-128.51/61 0.20s} 99. Kf7 {+12.66/2 0.026s} 99. ... Qh5+ {-128.51/60 0.20s} 100. Kg7 {+7.38/3 0.026s} 100. ... Qg4+ {-M70/17 0.20s} 101. Kf8 {+28.90/4 0.51s} 101. ... Qb4 {-M60/20 0.20s} 102. Kf7 {+27.49/5 0.51s} 102. ... Qb7 {-128.51/15 0.20s} 103. Qe6+ {+15.65/4 0.51s} 103. ... Kd2 {-128.51/15 0.20s} 104. Kg6 {+20.09/4 0.49s} 104. ... Qg2+ {-128.51/16 0.20s} 105. Kh7 {+26.29/5 0.50s} 105. ... Qb7 { -128.51/15 0.20s} 106. Kh6 {+21.40/4 0.52s} 106. ... Qh1+ {-128.51/14 0.20s} 107. Kg7 {+19.46/5 0.50s} 107. ... Qg1+ {-128.51/14 0.20s} 108. Qg6 {+15.46/5 0.50s} 108. ... Qd4+ {-128.51/16 0.20s} 109. Qf6 {+18.71/5 0.48s } 109. ... Qg4+ {-128.51/17 0.20s} 110. Kf8 {+21.29/4 0.47s} 110. ... Qb4 {-128.51/17 0.20s} 111. Qe5 {+19.28/5 0.51s} 111. ... Kc2 {-128.51/18 0.20s} 112. Kf7 {+14.70/4 0.52s} 112. ... Qc4+ {-128.51/17 0.20s} 113. Qe6 {+16.22/5 0.50s} 113. ... Qf4+ {-128.51/15 0.20s} 114. Qf6 {+20.87/5 0.50s } 114. ... Qc7 {-128.51/18 0.20s} 115. Kf8 {+27.60/4 0.51s} 115. ... Qc5 { -128.51/19 0.20s} 116. Kg7 {+25.79/4 0.51s} 116. ... Qc7 {-128.51/19 0.20s } 117. Kh6 {+16.18/4 0.53s} 117. ... Qh2+ {-128.51/14 0.20s} 118. Kg7 { +14.99/5 0.47s} 118. ... Qc7 {-128.51/54 0.20s} 119. Kf7 {+7.68/6 0.15s} 119. ... Kd3 {-128.51/16 0.20s} 120. Kf8 {+18.85/4 0.51s} 120. ... Qc5 { -128.51/15 0.20s} 121. Kg7 {+13.07/5 0.51s} 121. ... Qc7 {-128.51/16 0.20s } 122. Kg6 {+8.85/4 0.53s} 122. ... Qg3+ {-M82/15 0.20s} 123. Kf7 { +10.67/5 0.51s} 123. ... Qc7 {-128.51/67 0.20s} 124. Qa6+ {+5.65/6 0.51s} 124. ... Kd4 {-128.51/15 0.20s} 125. Qa1+ {+5.98/5 0.54s} 125. ... Ke3 { -128.51/16 0.20s} 126. Qa3+ {+4.64/5 0.55s} 126. ... Ke2 {-128.51/17 0.20s } 127. Qa6+ {+3.75/5 0.51s} 127. ... Kf2 {-128.51/15 0.20s} 128. Qf6+ { +3.52/5 0.53s} 128. ... Ke1 {-M76/19 0.20s} 129. Kf8 {+4.14/5 0.51s} 129. ... Qc5 {-M74/21 0.20s} 130. Kf7 {+3.84/5 0.50s} 130. ... Qc7 { -128.51/51 0.20s} 131. Qd4 {+1.24/5 0.037s} 131. ... Qb7 {-M60/21 0.20s} 132. Qe5+ {+2.01/5 0.53s} 132. ... Kd1 {-128.51/15 0.20s} 133. Qa1+ { +1.71/5 0.50s} 133. ... Ke2 {-128.51/16 0.20s} 134. Qd4 {+1.25/5 0.031s} 134. ... Qf3+ {-128.51/27 0.20s} 135. Qf6 Qh5+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "163"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:07"] [GameEndTime "2018-10-02T11:23:43.490 GTB Daylight Time"] [GameStartTime "2018-10-02T11:23:36.381 GTB Daylight Time"] [PlyCount "35"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "b7/8/6B1/3K4/8/8/2P5/Bk6 w - - 0 1"] 1. Kd4 Bc6 {-128.51/24 0.20s} 2. Kc5 Ba4 {-128.51/26 0.20s} 3. c4+ { +128.00/1 0.052s} 3. ... Kxa1 {-128.51/32 0.20s} 4. Kb4 Bc6 {-128.51/36 0.20s} 5. Ka3 Bh1 {-128.51/38 0.20s} 6. c5 {+128.00/2 0.42s} 6. ... Bg2 { -128.51/38 0.20s} 7. Bf7 {+5.56/5 0.47s} 7. ... Bc6 {-128.51/34 0.20s} 8. Kb3 {+6.24/5 0.49s} 8. ... Kb1 {-128.51/37 0.20s} 9. Kc3 {+5.66/6 0.47s} 9. ... Kc1 {-128.51/34 0.20s} 10. Bh5 {+5.79/6 0.50s} 10. ... Kb1 { -128.51/26 0.20s} 11. Bf7 {+5.32/5 0.039s} 11. ... Kc1 {-128.51/55 0.20s} 12. Bc4 {+4.86/5 0.031s} 12. ... Kd1 {-128.51/31 0.20s} 13. Ba6 {+5.76/2 0.018s} 13. ... Bg2 {-128.51/32 0.20s} 14. Bd3 {+6.96/5 0.50s} 14. ... Bc6 {-128.51/34 0.20s} 15. Ba6 {+5.30/4 0.021s} 15. ... Bg2 {-128.51/62 0.20s} 16. Bb5 {+4.25/4 0.024s} 16. ... Bf3 {-128.51/30 0.20s} 17. Bd3 {+5.92/5 0.52s} 17. ... Bc6 {-128.51/95 0.20s} 18. Ba6 {0.00/2 0.025s, Draw by 3-fold repetition} 1/2-1/2 [/pgn]
Hi, thanks a lot for testing! The dev team found another bug in the tablebase implementation, where only repeats from the current position but not from all positions since the last zeroing move were considered. There is now a fix for this: https://github.com/LeelaChessZero/lc0/pull/412, with compiled binary https://ci.appveyor.com/api/buildjobs/5 ... %2Flc0.exe. If you could run your testing suite with the new build again this would be great :D Thanks again!
The result on 100 positions in an hour or so. At short time control, as it seems to not matter.
Top
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Laskos »

Laskos wrote: ↑Tue Oct 02, 2018 12:16 pm
jkiliani wrote: ↑Tue Oct 02, 2018 12:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 10:41 am
crem wrote: ↑Tue Oct 02, 2018 8:48 am
Laskos wrote: ↑Mon Oct 01, 2018 11:16 pm
can00336 wrote: ↑Mon Oct 01, 2018 10:47 pm Thanks for finding a bug in the implementation. A proposed fix is available here: https://github.com/LeelaChessZero/lc0/pull/408
You can download a CUDA binary to try the fix here: https://ci.appveyor.com/api/buildjobs/g ... %2Flc0.exe
No, still misses wins as 3-fold rep. at steady rate.
Hi Laskos,

We have a fix for that https://github.com/LeelaChessZero/lc0/pull/410, which we have no way to check currently. Would it be possible for you to test it? The deadline for CCCC binary submission is today, and we'll have to release v0.18.1 today with a fix.
As a last resort we can push this patch blindly, but it would be nice to have it tested. :D
The CUDA build of Lc0 with this patch is https://ci.appveyor.com/api/buildjobs/3 ... %2Flc0.exe

Thanks!
Sill misses by 3-fold, seems at lower rate, only 3 misses out of 100 positions. Time control for Lc0 is 0.5s/move, but as I already wrote, it seems to not matter, and even on easy 6-men wins it misses at pretty much the same rate. Here is the PGN of misses:

[pgn] [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "49"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:04"] [GameEndTime "2018-10-02T10:33:45.395 GTB Daylight Time"] [GameStartTime "2018-10-02T10:33:41.026 GTB Daylight Time"] [PlyCount "20"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/1pk5/K7/8/8/Qr6/4Q3 w - - 0 1"] 1. Ka4 Rxa2+ {-128.51/35 0.20s} 2. Kb3 {+7.20/5 0.50s} 2. ... Ra6 { -128.51/31 0.20s} 3. Kb4 {+7.91/5 0.49s} 3. ... Ra7 {-128.51/33 0.20s} 4. Kc3 {+5.36/4 0.027s} 4. ... Ra3+ {-128.51/33 0.20s} 5. Kb4 {+8.56/5 0.50s} 5. ... Ra7 {-128.51/127 0.002s} 6. Kc3 {+4.75/3 0.022s} 6. ... Ra3+ { -128.51/127 0.001s} 7. Kd2 {+5.06/2 0.016s} 7. ... Ra2+ {-128.51/30 0.20s} 8. Kd3 {+5.39/5 0.50s} 8. ... Ra3+ {-128.51/34 0.20s} 9. Kc2 {+5.71/6 0.52s} 9. ... Ra2+ {-128.51/38 0.20s} 10. Kc3 {+0.63/3 0.041s} 10. ... Ra3+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "145"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:01:27"] [GameEndTime "2018-10-02T11:17:06.373 GTB Daylight Time"] [GameStartTime "2018-10-02T11:15:39.176 GTB Daylight Time"] [PlyCount "270"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/8/Q7/8/8/1Pp1P3/1k1K4 w - - 0 1"] 1. Kd2 c1=Q+ {-128.51/15 0.20s} 2. Kd3 Qc2+ {-128.51/17 0.20s} 3. Ke3 Qc1+ {-128.51/19 0.20s} 4. Ke4 {+4.30/5 0.44s} 4. ... Qc4+ {-128.51/15 0.20s} 5. Kf3 {+4.44/6 0.047s} 5. ... Qf7+ {-128.51/16 0.20s} 6. Kg3 {+3.85/6 0.50s} 6. ... Qg7+ {-128.51/17 0.20s} 7. Kf4 {+3.88/6 0.50s} 7. ... Qd4+ { -128.51/18 0.20s} 8. Kf3 {+4.42/7 0.096s} 8. ... Qf6+ {-128.51/20 0.20s} 9. Ke4 {+5.22/6 0.54s} 9. ... Qxb2 {-128.51/20 0.20s} 10. Qa6 Kc1 { -128.51/22 0.20s} 11. Kd5 Kd1 {-128.51/18 0.20s} 12. Qd3+ Ke1 {-128.51/22 0.20s} 13. e4 {+128.00/2 0.46s} 13. ... Qb7+ {-128.51/20 0.20s} 14. Ke6 { +3.34/5 0.50s} 14. ... Qc6+ {-128.51/21 0.20s} 15. Kf7 {+3.44/6 0.52s} 15. ... Qb7+ {-128.51/20 0.20s} 16. Kg6 {+3.67/6 0.50s} 16. ... Qc6+ { -128.51/21 0.20s} 17. Kg5 {+3.75/6 0.47s} 17. ... Qc5+ {-128.51/21 0.20s} 18. Qd5 {+7.17/5 0.51s} 18. ... Qe7+ {-128.51/22 0.20s} 19. Kg6 {+6.02/6 0.50s} 19. ... Qe8+ {-128.51/21 0.20s} 20. Kf6 {+4.76/6 0.50s} 20. ... Qf8+ {-128.51/19 0.20s} 21. Kg5 {+4.43/6 0.51s} 21. ... Qe7+ {-128.51/41 0.20s} 22. Kg4 {+4.01/6 0.083s} 22. ... Qg7+ {-128.51/19 0.20s} 23. Kf5 { +4.55/6 0.50s} 23. ... Qf8+ {-128.51/19 0.20s} 24. Ke5 {+4.02/6 0.50s} 24. ... Qh8+ {-128.51/17 0.20s} 25. Ke6 {+4.58/5 0.47s} 25. ... Qh6+ { -128.51/22 0.20s} 26. Kd7 {+6.04/6 0.50s} 26. ... Qg7+ {-128.51/21 0.20s} 27. Kc8 {+6.48/6 0.50s} 27. ... Qc3+ {-128.51/23 0.20s} 28. Kb7 {+6.52/6 0.50s} 28. ... Qg7+ {-128.51/22 0.20s} 29. Ka6 {+7.96/6 0.54s} 29. ... Qf6+ {-128.51/19 0.20s} 30. Kb5 {+7.47/6 0.51s} 30. ... Qb2+ {-128.51/21 0.20s} 31. Ka4 {+7.65/5 0.48s} 31. ... Qc2+ {-128.51/17 0.20s} 32. Ka5 { +8.57/6 0.50s} 32. ... Qc3+ {-128.51/23 0.20s} 33. Ka4 {+6.60/6 0.51s} 33. ... Qc2+ {-128.51/39 0.20s} 34. Kb5 {+4.34/7 0.058s} 34. ... Qb2+ { -128.51/127 0.002s} 35. Kc6 {+2.17/3 0.036s} 35. ... Qh8 {-128.51/16 0.20s } 36. Qe6 {+4.63/5 0.51s} 36. ... Qc3+ {-128.51/19 0.20s} 37. Kd7 {+4.47/6 0.51s} 37. ... Qg7+ {-128.51/19 0.20s} 38. Kd6 {+4.51/7 0.50s} 38. ... Qd4+ {-128.51/20 0.20s} 39. Qd5 {+3.89/6 0.57s} 39. ... Qf6+ {-128.51/24 0.20s} 40. Kc7 {+3.61/6 0.56s} 40. ... Qc3+ {-128.51/22 0.20s} 41. Kb8 { +3.29/6 0.50s} 41. ... Qb2+ {-128.51/24 0.20s} 42. Kc8 {+3.22/6 0.50s} 42. ... Qc3+ {-128.51/48 0.20s} 43. Kd7 {+2.39/7 0.12s} 43. ... Qg7+ { -128.51/127 0.002s} 44. Kc6 {+1.70/4 0.069s} 44. ... Qh8 {-128.51/59 0.20s } 45. Qf5 {+1.92/2 0.026s} 45. ... Qa8+ {-128.51/16 0.20s} 46. Kb5 { +2.54/5 0.50s} 46. ... Qb7+ {-128.51/20 0.20s} 47. Kc5 {+1.57/6 0.078s} 47. ... Qc7+ {-128.51/19 0.20s} 48. Kd5 {+1.44/5 0.026s} 48. ... Qb7+ { -128.51/19 0.20s} 49. Ke6 {+1.83/6 0.46s} 49. ... Qb3+ {-128.51/19 0.20s} 50. Kf6 {+2.35/6 0.50s} 50. ... Qb6+ {-128.51/20 0.20s} 51. Kg5 {+2.17/6 0.47s} 51. ... Qd8+ {-128.51/18 0.20s} 52. Qf6 {+1.94/6 0.048s} 52. ... Qd2+ {-128.51/17 0.20s} 53. Qf4 {+1.32/6 0.022s} 53. ... Qd8+ {-128.51/18 0.20s} 54. Kh5 {+1.13/5 0.034s} 54. ... Qe8+ {-128.51/19 0.20s} 55. Kh4 { +1.07/4 0.026s} 55. ... Qd8+ {-128.51/20 0.20s} 56. Kh3 {+1.42/4 0.026s} 56. ... Qd7+ {-128.51/21 0.20s} 57. Kh2 {+0.77/2 0.018s} 57. ... Qh7+ { -128.51/20 0.20s} 58. Kg2 Qb7 {-128.51/22 0.20s} 59. Kf3 Qc6 {-128.51/20 0.20s} 60. Qg5 Qc3+ {-128.51/15 0.20s} 61. Qe3+ Kd1 {-128.51/17 0.20s} 62. e5 {+128.00/1 0.061s} 62. ... Qc6+ {-128.51/15 0.20s} 63. Qe4 {+12.25/5 0.45s} 63. ... Qe6 {-128.51/15 0.20s} 64. Kf4 {+10.02/5 0.50s} 64. ... Qf7+ {-128.51/16 0.20s} 65. Qf5 {+15.41/5 0.54s} 65. ... Qc7 {-128.51/17 0.20s} 66. Kg5 {+14.04/5 0.51s} 66. ... Qd8+ {-128.51/17 0.20s} 67. Qf6 { +19.64/5 0.50s} 67. ... Qd2+ {-128.51/15 0.20s} 68. Kg6 {+15.87/5 0.50s} 68. ... Qg2+ {-128.51/15 0.20s} 69. Kf7 {+13.02/5 0.46s} 69. ... Qb7+ { -128.51/18 0.20s} 70. Qe7 {+12.94/5 0.52s} 70. ... Qf3+ {-128.51/17 0.20s} 71. Ke8 {+16.37/5 0.50s} 71. ... Qh5+ {-128.51/18 0.20s} 72. Kd8 {+23.68/5 0.50s} 72. ... Qh1 {-128.51/20 0.20s} 73. Qd6+ {+27.20/4 0.50s} 73. ... Ke2 {-128.51/21 0.20s} 74. e6 {+128.00/2 0.50s} 74. ... Qa8+ {-128.51/21 0.20s} 75. Kd7 {+13.64/5 0.50s} 75. ... Qa4+ {-128.51/19 0.20s} 76. Qc6 { +16.29/5 0.50s} 76. ... Qd4+ {-128.51/18 0.20s} 77. Ke8 {+14.46/5 0.50s} 77. ... Qh8+ {-128.51/15 0.20s} 78. Kd7 {+12.86/6 0.49s} 78. ... Qd4+ { -128.51/40 0.20s} 79. Kc8 {+12.21/5 0.51s} 79. ... Qh8+ {-128.51/17 0.20s} 80. Kc7 {+12.02/5 0.50s} 80. ... Qg7+ {-128.51/16 0.20s} 81. Qd7 {+13.17/5 0.54s} 81. ... Qc3+ {-128.51/17 0.20s} 82. Kb6 {+16.91/5 0.50s} 82. ... Qe3+ {-128.51/18 0.20s} 83. Kb7 {+15.93/5 0.50s} 83. ... Qb3+ {-128.51/18 0.20s} 84. Kc7 {+12.30/5 0.50s} 84. ... Qc3+ {-128.51/42 0.20s} 85. Qc6 { +6.62/6 0.050s} 85. ... Qg7+ {-128.51/42 0.20s} 86. Kb6 {+10.55/3 0.024s} 86. ... Qd4+ {-128.51/16 0.20s} 87. Qc5 {+15.59/5 0.55s} 87. ... Qf6 { -128.51/17 0.20s} 88. Qd6 {+17.49/5 0.50s} 88. ... Qb2+ {-128.51/17 0.20s} 89. Kc7 {+19.47/5 0.51s} 89. ... Qc2+ {-128.51/17 0.20s} 90. Kd8 {+25.03/4 0.50s} 90. ... Qe4 {-128.51/17 0.20s} 91. e7 {+128.00/2 0.52s} 91. ... Qa8+ {-128.51/17 0.20s} 92. Kd7 {+18.34/5 0.50s} 92. ... Qb7+ {-128.51/13 0.20s} 93. Ke6 {+19.35/5 0.50s} 93. ... Qc8+ {-128.51/14 0.20s} 94. Kf7 { +17.35/5 0.50s} 94. ... Qf5+ {-128.51/13 0.20s} 95. Qf6 {+26.58/5 0.50s} 95. ... Qh5+ {-M112/14 0.20s} 96. Kf8 {+30.26/5 0.53s} 96. ... Qc5 { -128.51/17 0.20s} 97. Kg7 {+22.48/5 0.50s} 97. ... Qc7 {-128.51/13 0.20s} 98. Kf8 {+26.23/4 0.51s} 98. ... Qc5 {-128.51/61 0.20s} 99. Kf7 {+12.66/2 0.026s} 99. ... Qh5+ {-128.51/60 0.20s} 100. Kg7 {+7.38/3 0.026s} 100. ... Qg4+ {-M70/17 0.20s} 101. Kf8 {+28.90/4 0.51s} 101. ... Qb4 {-M60/20 0.20s} 102. Kf7 {+27.49/5 0.51s} 102. ... Qb7 {-128.51/15 0.20s} 103. Qe6+ {+15.65/4 0.51s} 103. ... Kd2 {-128.51/15 0.20s} 104. Kg6 {+20.09/4 0.49s} 104. ... Qg2+ {-128.51/16 0.20s} 105. Kh7 {+26.29/5 0.50s} 105. ... Qb7 { -128.51/15 0.20s} 106. Kh6 {+21.40/4 0.52s} 106. ... Qh1+ {-128.51/14 0.20s} 107. Kg7 {+19.46/5 0.50s} 107. ... Qg1+ {-128.51/14 0.20s} 108. Qg6 {+15.46/5 0.50s} 108. ... Qd4+ {-128.51/16 0.20s} 109. Qf6 {+18.71/5 0.48s } 109. ... Qg4+ {-128.51/17 0.20s} 110. Kf8 {+21.29/4 0.47s} 110. ... Qb4 {-128.51/17 0.20s} 111. Qe5 {+19.28/5 0.51s} 111. ... Kc2 {-128.51/18 0.20s} 112. Kf7 {+14.70/4 0.52s} 112. ... Qc4+ {-128.51/17 0.20s} 113. Qe6 {+16.22/5 0.50s} 113. ... Qf4+ {-128.51/15 0.20s} 114. Qf6 {+20.87/5 0.50s } 114. ... Qc7 {-128.51/18 0.20s} 115. Kf8 {+27.60/4 0.51s} 115. ... Qc5 { -128.51/19 0.20s} 116. Kg7 {+25.79/4 0.51s} 116. ... Qc7 {-128.51/19 0.20s } 117. Kh6 {+16.18/4 0.53s} 117. ... Qh2+ {-128.51/14 0.20s} 118. Kg7 { +14.99/5 0.47s} 118. ... Qc7 {-128.51/54 0.20s} 119. Kf7 {+7.68/6 0.15s} 119. ... Kd3 {-128.51/16 0.20s} 120. Kf8 {+18.85/4 0.51s} 120. ... Qc5 { -128.51/15 0.20s} 121. Kg7 {+13.07/5 0.51s} 121. ... Qc7 {-128.51/16 0.20s } 122. Kg6 {+8.85/4 0.53s} 122. ... Qg3+ {-M82/15 0.20s} 123. Kf7 { +10.67/5 0.51s} 123. ... Qc7 {-128.51/67 0.20s} 124. Qa6+ {+5.65/6 0.51s} 124. ... Kd4 {-128.51/15 0.20s} 125. Qa1+ {+5.98/5 0.54s} 125. ... Ke3 { -128.51/16 0.20s} 126. Qa3+ {+4.64/5 0.55s} 126. ... Ke2 {-128.51/17 0.20s } 127. Qa6+ {+3.75/5 0.51s} 127. ... Kf2 {-128.51/15 0.20s} 128. Qf6+ { +3.52/5 0.53s} 128. ... Ke1 {-M76/19 0.20s} 129. Kf8 {+4.14/5 0.51s} 129. ... Qc5 {-M74/21 0.20s} 130. Kf7 {+3.84/5 0.50s} 130. ... Qc7 { -128.51/51 0.20s} 131. Qd4 {+1.24/5 0.037s} 131. ... Qb7 {-M60/21 0.20s} 132. Qe5+ {+2.01/5 0.53s} 132. ... Kd1 {-128.51/15 0.20s} 133. Qa1+ { +1.71/5 0.50s} 133. ... Ke2 {-128.51/16 0.20s} 134. Qd4 {+1.25/5 0.031s} 134. ... Qf3+ {-128.51/27 0.20s} 135. Qf6 Qh5+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "163"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:07"] [GameEndTime "2018-10-02T11:23:43.490 GTB Daylight Time"] [GameStartTime "2018-10-02T11:23:36.381 GTB Daylight Time"] [PlyCount "35"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "b7/8/6B1/3K4/8/8/2P5/Bk6 w - - 0 1"] 1. Kd4 Bc6 {-128.51/24 0.20s} 2. Kc5 Ba4 {-128.51/26 0.20s} 3. c4+ { +128.00/1 0.052s} 3. ... Kxa1 {-128.51/32 0.20s} 4. Kb4 Bc6 {-128.51/36 0.20s} 5. Ka3 Bh1 {-128.51/38 0.20s} 6. c5 {+128.00/2 0.42s} 6. ... Bg2 { -128.51/38 0.20s} 7. Bf7 {+5.56/5 0.47s} 7. ... Bc6 {-128.51/34 0.20s} 8. Kb3 {+6.24/5 0.49s} 8. ... Kb1 {-128.51/37 0.20s} 9. Kc3 {+5.66/6 0.47s} 9. ... Kc1 {-128.51/34 0.20s} 10. Bh5 {+5.79/6 0.50s} 10. ... Kb1 { -128.51/26 0.20s} 11. Bf7 {+5.32/5 0.039s} 11. ... Kc1 {-128.51/55 0.20s} 12. Bc4 {+4.86/5 0.031s} 12. ... Kd1 {-128.51/31 0.20s} 13. Ba6 {+5.76/2 0.018s} 13. ... Bg2 {-128.51/32 0.20s} 14. Bd3 {+6.96/5 0.50s} 14. ... Bc6 {-128.51/34 0.20s} 15. Ba6 {+5.30/4 0.021s} 15. ... Bg2 {-128.51/62 0.20s} 16. Bb5 {+4.25/4 0.024s} 16. ... Bf3 {-128.51/30 0.20s} 17. Bd3 {+5.92/5 0.52s} 17. ... Bc6 {-128.51/95 0.20s} 18. Ba6 {0.00/2 0.025s, Draw by 3-fold repetition} 1/2-1/2 [/pgn]
Hi, thanks a lot for testing! The dev team found another bug in the tablebase implementation, where only repeats from the current position but not from all positions since the last zeroing move were considered. There is now a fix for this: https://github.com/LeelaChessZero/lc0/pull/412, with compiled binary https://ci.appveyor.com/api/buildjobs/5 ... %2Flc0.exe. If you could run your testing suite with the new build again this would be great :D Thanks again!
The result on 100 positions in an hour or so. At short time control, as it seems to not matter.
No misses this time on 100 hard 6-men wins.
Maybe I will check on say 200 other 6-men won positions, but it seems fine now.
Top
jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 1:26 pm

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by jkiliani »

Laskos wrote: ↑Tue Oct 02, 2018 1:09 pm No misses this time on 100 hard 6-men wins.
Maybe I will check on say 200 other 6-men won positions, but it seems fine now.
Great, thank you for the whole Leela Dev team! Do you have any testing suites about holding difficult draws, or avoiding losses on TB lost positions against opponents without TB?
Top
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Laskos »

jkiliani wrote: ↑Tue Oct 02, 2018 1:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 1:09 pm No misses this time on 100 hard 6-men wins.
Maybe I will check on say 200 other 6-men won positions, but it seems fine now.
Great, thank you! Do you have any testing suites about holding difficult draws, or avoiding losses on TB lost positions against opponents without TB?
I tested yesterday on 100 long 6-men draws (not sure if they are exactly hard, but many of them are), no losses. Avoiding TB losses against non-TB engine needs comparison with another Syzygy-enabled engine against that non-TB engine. Might compare Lc0_Syzygy against SF8_no_TB compared to SF8_Syzygy against SF8_no_TB on 6-men hard wins. Will depend on time control used too.
Top
Javier Ros
Posts: 200
Joined: Fri Oct 12, 2012 12:48 pm
Location: Seville (SPAIN)
Full name: Javier Ros

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Javier Ros »

Very interesting experiment and great work! :D
Top
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Laskos »

Laskos wrote: ↑Tue Oct 02, 2018 1:22 pm
jkiliani wrote: ↑Tue Oct 02, 2018 1:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 1:09 pm No misses this time on 100 hard 6-men wins.
Maybe I will check on say 200 other 6-men won positions, but it seems fine now.
Great, thank you! Do you have any testing suites about holding difficult draws, or avoiding losses on TB lost positions against opponents without TB?
I tested yesterday on 100 long 6-men draws (not sure if they are exactly hard, but many of them are), no losses. Avoiding TB losses against non-TB engine needs comparison with another Syzygy-enabled engine against that non-TB engine. Might compare Lc0_Syzygy against SF8_no_TB compared to SF8_Syzygy against SF8_no_TB on 6-men hard wins. Will depend on time control used too.
Out of 50 6-men TB losses, Lc0_Syzygy (the fixed one) saves 13 against SF8_no_TB, SF8_Syzygy saves 15 against SF8_no_TB. So, behaves similarly to SF8, which has a good TB implementation (and good endgame eval, which Lc0 doesn't). Might check how many saves SF dev.
Top
Damir
Posts: 2801
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Damir »

jkiliani wrote: ↑Tue Oct 02, 2018 12:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 10:41 am
crem wrote: ↑Tue Oct 02, 2018 8:48 am
Laskos wrote: ↑Mon Oct 01, 2018 11:16 pm
can00336 wrote: ↑Mon Oct 01, 2018 10:47 pm Thanks for finding a bug in the implementation. A proposed fix is available here: https://github.com/LeelaChessZero/lc0/pull/408
You can download a CUDA binary to try the fix here: https://ci.appveyor.com/api/buildjobs/g ... %2Flc0.exe
No, still misses wins as 3-fold rep. at steady rate.
Hi Laskos,

We have a fix for that https://github.com/LeelaChessZero/lc0/pull/410, which we have no way to check currently. Would it be possible for you to test it? The deadline for CCCC binary submission is today, and we'll have to release v0.18.1 today with a fix.
As a last resort we can push this patch blindly, but it would be nice to have it tested. :D
The CUDA build of Lc0 with this patch is https://ci.appveyor.com/api/buildjobs/3 ... %2Flc0.exe

Thanks!
Sill misses by 3-fold, seems at lower rate, only 3 misses out of 100 positions. Time control for Lc0 is 0.5s/move, but as I already wrote, it seems to not matter, and even on easy 6-men wins it misses at pretty much the same rate. Here is the PGN of misses:

[pgn] [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "49"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:04"] [GameEndTime "2018-10-02T10:33:45.395 GTB Daylight Time"] [GameStartTime "2018-10-02T10:33:41.026 GTB Daylight Time"] [PlyCount "20"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/1pk5/K7/8/8/Qr6/4Q3 w - - 0 1"] 1. Ka4 Rxa2+ {-128.51/35 0.20s} 2. Kb3 {+7.20/5 0.50s} 2. ... Ra6 { -128.51/31 0.20s} 3. Kb4 {+7.91/5 0.49s} 3. ... Ra7 {-128.51/33 0.20s} 4. Kc3 {+5.36/4 0.027s} 4. ... Ra3+ {-128.51/33 0.20s} 5. Kb4 {+8.56/5 0.50s} 5. ... Ra7 {-128.51/127 0.002s} 6. Kc3 {+4.75/3 0.022s} 6. ... Ra3+ { -128.51/127 0.001s} 7. Kd2 {+5.06/2 0.016s} 7. ... Ra2+ {-128.51/30 0.20s} 8. Kd3 {+5.39/5 0.50s} 8. ... Ra3+ {-128.51/34 0.20s} 9. Kc2 {+5.71/6 0.52s} 9. ... Ra2+ {-128.51/38 0.20s} 10. Kc3 {+0.63/3 0.041s} 10. ... Ra3+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "145"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:01:27"] [GameEndTime "2018-10-02T11:17:06.373 GTB Daylight Time"] [GameStartTime "2018-10-02T11:15:39.176 GTB Daylight Time"] [PlyCount "270"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/8/Q7/8/8/1Pp1P3/1k1K4 w - - 0 1"] 1. Kd2 c1=Q+ {-128.51/15 0.20s} 2. Kd3 Qc2+ {-128.51/17 0.20s} 3. Ke3 Qc1+ {-128.51/19 0.20s} 4. Ke4 {+4.30/5 0.44s} 4. ... Qc4+ {-128.51/15 0.20s} 5. Kf3 {+4.44/6 0.047s} 5. ... Qf7+ {-128.51/16 0.20s} 6. Kg3 {+3.85/6 0.50s} 6. ... Qg7+ {-128.51/17 0.20s} 7. Kf4 {+3.88/6 0.50s} 7. ... Qd4+ { -128.51/18 0.20s} 8. Kf3 {+4.42/7 0.096s} 8. ... Qf6+ {-128.51/20 0.20s} 9. Ke4 {+5.22/6 0.54s} 9. ... Qxb2 {-128.51/20 0.20s} 10. Qa6 Kc1 { -128.51/22 0.20s} 11. Kd5 Kd1 {-128.51/18 0.20s} 12. Qd3+ Ke1 {-128.51/22 0.20s} 13. e4 {+128.00/2 0.46s} 13. ... Qb7+ {-128.51/20 0.20s} 14. Ke6 { +3.34/5 0.50s} 14. ... Qc6+ {-128.51/21 0.20s} 15. Kf7 {+3.44/6 0.52s} 15. ... Qb7+ {-128.51/20 0.20s} 16. Kg6 {+3.67/6 0.50s} 16. ... Qc6+ { -128.51/21 0.20s} 17. Kg5 {+3.75/6 0.47s} 17. ... Qc5+ {-128.51/21 0.20s} 18. Qd5 {+7.17/5 0.51s} 18. ... Qe7+ {-128.51/22 0.20s} 19. Kg6 {+6.02/6 0.50s} 19. ... Qe8+ {-128.51/21 0.20s} 20. Kf6 {+4.76/6 0.50s} 20. ... Qf8+ {-128.51/19 0.20s} 21. Kg5 {+4.43/6 0.51s} 21. ... Qe7+ {-128.51/41 0.20s} 22. Kg4 {+4.01/6 0.083s} 22. ... Qg7+ {-128.51/19 0.20s} 23. Kf5 { +4.55/6 0.50s} 23. ... Qf8+ {-128.51/19 0.20s} 24. Ke5 {+4.02/6 0.50s} 24. ... Qh8+ {-128.51/17 0.20s} 25. Ke6 {+4.58/5 0.47s} 25. ... Qh6+ { -128.51/22 0.20s} 26. Kd7 {+6.04/6 0.50s} 26. ... Qg7+ {-128.51/21 0.20s} 27. Kc8 {+6.48/6 0.50s} 27. ... Qc3+ {-128.51/23 0.20s} 28. Kb7 {+6.52/6 0.50s} 28. ... Qg7+ {-128.51/22 0.20s} 29. Ka6 {+7.96/6 0.54s} 29. ... Qf6+ {-128.51/19 0.20s} 30. Kb5 {+7.47/6 0.51s} 30. ... Qb2+ {-128.51/21 0.20s} 31. Ka4 {+7.65/5 0.48s} 31. ... Qc2+ {-128.51/17 0.20s} 32. Ka5 { +8.57/6 0.50s} 32. ... Qc3+ {-128.51/23 0.20s} 33. Ka4 {+6.60/6 0.51s} 33. ... Qc2+ {-128.51/39 0.20s} 34. Kb5 {+4.34/7 0.058s} 34. ... Qb2+ { -128.51/127 0.002s} 35. Kc6 {+2.17/3 0.036s} 35. ... Qh8 {-128.51/16 0.20s } 36. Qe6 {+4.63/5 0.51s} 36. ... Qc3+ {-128.51/19 0.20s} 37. Kd7 {+4.47/6 0.51s} 37. ... Qg7+ {-128.51/19 0.20s} 38. Kd6 {+4.51/7 0.50s} 38. ... Qd4+ {-128.51/20 0.20s} 39. Qd5 {+3.89/6 0.57s} 39. ... Qf6+ {-128.51/24 0.20s} 40. Kc7 {+3.61/6 0.56s} 40. ... Qc3+ {-128.51/22 0.20s} 41. Kb8 { +3.29/6 0.50s} 41. ... Qb2+ {-128.51/24 0.20s} 42. Kc8 {+3.22/6 0.50s} 42. ... Qc3+ {-128.51/48 0.20s} 43. Kd7 {+2.39/7 0.12s} 43. ... Qg7+ { -128.51/127 0.002s} 44. Kc6 {+1.70/4 0.069s} 44. ... Qh8 {-128.51/59 0.20s } 45. Qf5 {+1.92/2 0.026s} 45. ... Qa8+ {-128.51/16 0.20s} 46. Kb5 { +2.54/5 0.50s} 46. ... Qb7+ {-128.51/20 0.20s} 47. Kc5 {+1.57/6 0.078s} 47. ... Qc7+ {-128.51/19 0.20s} 48. Kd5 {+1.44/5 0.026s} 48. ... Qb7+ { -128.51/19 0.20s} 49. Ke6 {+1.83/6 0.46s} 49. ... Qb3+ {-128.51/19 0.20s} 50. Kf6 {+2.35/6 0.50s} 50. ... Qb6+ {-128.51/20 0.20s} 51. Kg5 {+2.17/6 0.47s} 51. ... Qd8+ {-128.51/18 0.20s} 52. Qf6 {+1.94/6 0.048s} 52. ... Qd2+ {-128.51/17 0.20s} 53. Qf4 {+1.32/6 0.022s} 53. ... Qd8+ {-128.51/18 0.20s} 54. Kh5 {+1.13/5 0.034s} 54. ... Qe8+ {-128.51/19 0.20s} 55. Kh4 { +1.07/4 0.026s} 55. ... Qd8+ {-128.51/20 0.20s} 56. Kh3 {+1.42/4 0.026s} 56. ... Qd7+ {-128.51/21 0.20s} 57. Kh2 {+0.77/2 0.018s} 57. ... Qh7+ { -128.51/20 0.20s} 58. Kg2 Qb7 {-128.51/22 0.20s} 59. Kf3 Qc6 {-128.51/20 0.20s} 60. Qg5 Qc3+ {-128.51/15 0.20s} 61. Qe3+ Kd1 {-128.51/17 0.20s} 62. e5 {+128.00/1 0.061s} 62. ... Qc6+ {-128.51/15 0.20s} 63. Qe4 {+12.25/5 0.45s} 63. ... Qe6 {-128.51/15 0.20s} 64. Kf4 {+10.02/5 0.50s} 64. ... Qf7+ {-128.51/16 0.20s} 65. Qf5 {+15.41/5 0.54s} 65. ... Qc7 {-128.51/17 0.20s} 66. Kg5 {+14.04/5 0.51s} 66. ... Qd8+ {-128.51/17 0.20s} 67. Qf6 { +19.64/5 0.50s} 67. ... Qd2+ {-128.51/15 0.20s} 68. Kg6 {+15.87/5 0.50s} 68. ... Qg2+ {-128.51/15 0.20s} 69. Kf7 {+13.02/5 0.46s} 69. ... Qb7+ { -128.51/18 0.20s} 70. Qe7 {+12.94/5 0.52s} 70. ... Qf3+ {-128.51/17 0.20s} 71. Ke8 {+16.37/5 0.50s} 71. ... Qh5+ {-128.51/18 0.20s} 72. Kd8 {+23.68/5 0.50s} 72. ... Qh1 {-128.51/20 0.20s} 73. Qd6+ {+27.20/4 0.50s} 73. ... Ke2 {-128.51/21 0.20s} 74. e6 {+128.00/2 0.50s} 74. ... Qa8+ {-128.51/21 0.20s} 75. Kd7 {+13.64/5 0.50s} 75. ... Qa4+ {-128.51/19 0.20s} 76. Qc6 { +16.29/5 0.50s} 76. ... Qd4+ {-128.51/18 0.20s} 77. Ke8 {+14.46/5 0.50s} 77. ... Qh8+ {-128.51/15 0.20s} 78. Kd7 {+12.86/6 0.49s} 78. ... Qd4+ { -128.51/40 0.20s} 79. Kc8 {+12.21/5 0.51s} 79. ... Qh8+ {-128.51/17 0.20s} 80. Kc7 {+12.02/5 0.50s} 80. ... Qg7+ {-128.51/16 0.20s} 81. Qd7 {+13.17/5 0.54s} 81. ... Qc3+ {-128.51/17 0.20s} 82. Kb6 {+16.91/5 0.50s} 82. ... Qe3+ {-128.51/18 0.20s} 83. Kb7 {+15.93/5 0.50s} 83. ... Qb3+ {-128.51/18 0.20s} 84. Kc7 {+12.30/5 0.50s} 84. ... Qc3+ {-128.51/42 0.20s} 85. Qc6 { +6.62/6 0.050s} 85. ... Qg7+ {-128.51/42 0.20s} 86. Kb6 {+10.55/3 0.024s} 86. ... Qd4+ {-128.51/16 0.20s} 87. Qc5 {+15.59/5 0.55s} 87. ... Qf6 { -128.51/17 0.20s} 88. Qd6 {+17.49/5 0.50s} 88. ... Qb2+ {-128.51/17 0.20s} 89. Kc7 {+19.47/5 0.51s} 89. ... Qc2+ {-128.51/17 0.20s} 90. Kd8 {+25.03/4 0.50s} 90. ... Qe4 {-128.51/17 0.20s} 91. e7 {+128.00/2 0.52s} 91. ... Qa8+ {-128.51/17 0.20s} 92. Kd7 {+18.34/5 0.50s} 92. ... Qb7+ {-128.51/13 0.20s} 93. Ke6 {+19.35/5 0.50s} 93. ... Qc8+ {-128.51/14 0.20s} 94. Kf7 { +17.35/5 0.50s} 94. ... Qf5+ {-128.51/13 0.20s} 95. Qf6 {+26.58/5 0.50s} 95. ... Qh5+ {-M112/14 0.20s} 96. Kf8 {+30.26/5 0.53s} 96. ... Qc5 { -128.51/17 0.20s} 97. Kg7 {+22.48/5 0.50s} 97. ... Qc7 {-128.51/13 0.20s} 98. Kf8 {+26.23/4 0.51s} 98. ... Qc5 {-128.51/61 0.20s} 99. Kf7 {+12.66/2 0.026s} 99. ... Qh5+ {-128.51/60 0.20s} 100. Kg7 {+7.38/3 0.026s} 100. ... Qg4+ {-M70/17 0.20s} 101. Kf8 {+28.90/4 0.51s} 101. ... Qb4 {-M60/20 0.20s} 102. Kf7 {+27.49/5 0.51s} 102. ... Qb7 {-128.51/15 0.20s} 103. Qe6+ {+15.65/4 0.51s} 103. ... Kd2 {-128.51/15 0.20s} 104. Kg6 {+20.09/4 0.49s} 104. ... Qg2+ {-128.51/16 0.20s} 105. Kh7 {+26.29/5 0.50s} 105. ... Qb7 { -128.51/15 0.20s} 106. Kh6 {+21.40/4 0.52s} 106. ... Qh1+ {-128.51/14 0.20s} 107. Kg7 {+19.46/5 0.50s} 107. ... Qg1+ {-128.51/14 0.20s} 108. Qg6 {+15.46/5 0.50s} 108. ... Qd4+ {-128.51/16 0.20s} 109. Qf6 {+18.71/5 0.48s } 109. ... Qg4+ {-128.51/17 0.20s} 110. Kf8 {+21.29/4 0.47s} 110. ... Qb4 {-128.51/17 0.20s} 111. Qe5 {+19.28/5 0.51s} 111. ... Kc2 {-128.51/18 0.20s} 112. Kf7 {+14.70/4 0.52s} 112. ... Qc4+ {-128.51/17 0.20s} 113. Qe6 {+16.22/5 0.50s} 113. ... Qf4+ {-128.51/15 0.20s} 114. Qf6 {+20.87/5 0.50s } 114. ... Qc7 {-128.51/18 0.20s} 115. Kf8 {+27.60/4 0.51s} 115. ... Qc5 { -128.51/19 0.20s} 116. Kg7 {+25.79/4 0.51s} 116. ... Qc7 {-128.51/19 0.20s } 117. Kh6 {+16.18/4 0.53s} 117. ... Qh2+ {-128.51/14 0.20s} 118. Kg7 { +14.99/5 0.47s} 118. ... Qc7 {-128.51/54 0.20s} 119. Kf7 {+7.68/6 0.15s} 119. ... Kd3 {-128.51/16 0.20s} 120. Kf8 {+18.85/4 0.51s} 120. ... Qc5 { -128.51/15 0.20s} 121. Kg7 {+13.07/5 0.51s} 121. ... Qc7 {-128.51/16 0.20s } 122. Kg6 {+8.85/4 0.53s} 122. ... Qg3+ {-M82/15 0.20s} 123. Kf7 { +10.67/5 0.51s} 123. ... Qc7 {-128.51/67 0.20s} 124. Qa6+ {+5.65/6 0.51s} 124. ... Kd4 {-128.51/15 0.20s} 125. Qa1+ {+5.98/5 0.54s} 125. ... Ke3 { -128.51/16 0.20s} 126. Qa3+ {+4.64/5 0.55s} 126. ... Ke2 {-128.51/17 0.20s } 127. Qa6+ {+3.75/5 0.51s} 127. ... Kf2 {-128.51/15 0.20s} 128. Qf6+ { +3.52/5 0.53s} 128. ... Ke1 {-M76/19 0.20s} 129. Kf8 {+4.14/5 0.51s} 129. ... Qc5 {-M74/21 0.20s} 130. Kf7 {+3.84/5 0.50s} 130. ... Qc7 { -128.51/51 0.20s} 131. Qd4 {+1.24/5 0.037s} 131. ... Qb7 {-M60/21 0.20s} 132. Qe5+ {+2.01/5 0.53s} 132. ... Kd1 {-128.51/15 0.20s} 133. Qa1+ { +1.71/5 0.50s} 133. ... Ke2 {-128.51/16 0.20s} 134. Qd4 {+1.25/5 0.031s} 134. ... Qf3+ {-128.51/27 0.20s} 135. Qf6 Qh5+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "163"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:07"] [GameEndTime "2018-10-02T11:23:43.490 GTB Daylight Time"] [GameStartTime "2018-10-02T11:23:36.381 GTB Daylight Time"] [PlyCount "35"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "b7/8/6B1/3K4/8/8/2P5/Bk6 w - - 0 1"] 1. Kd4 Bc6 {-128.51/24 0.20s} 2. Kc5 Ba4 {-128.51/26 0.20s} 3. c4+ { +128.00/1 0.052s} 3. ... Kxa1 {-128.51/32 0.20s} 4. Kb4 Bc6 {-128.51/36 0.20s} 5. Ka3 Bh1 {-128.51/38 0.20s} 6. c5 {+128.00/2 0.42s} 6. ... Bg2 { -128.51/38 0.20s} 7. Bf7 {+5.56/5 0.47s} 7. ... Bc6 {-128.51/34 0.20s} 8. Kb3 {+6.24/5 0.49s} 8. ... Kb1 {-128.51/37 0.20s} 9. Kc3 {+5.66/6 0.47s} 9. ... Kc1 {-128.51/34 0.20s} 10. Bh5 {+5.79/6 0.50s} 10. ... Kb1 { -128.51/26 0.20s} 11. Bf7 {+5.32/5 0.039s} 11. ... Kc1 {-128.51/55 0.20s} 12. Bc4 {+4.86/5 0.031s} 12. ... Kd1 {-128.51/31 0.20s} 13. Ba6 {+5.76/2 0.018s} 13. ... Bg2 {-128.51/32 0.20s} 14. Bd3 {+6.96/5 0.50s} 14. ... Bc6 {-128.51/34 0.20s} 15. Ba6 {+5.30/4 0.021s} 15. ... Bg2 {-128.51/62 0.20s} 16. Bb5 {+4.25/4 0.024s} 16. ... Bf3 {-128.51/30 0.20s} 17. Bd3 {+5.92/5 0.52s} 17. ... Bc6 {-128.51/95 0.20s} 18. Ba6 {0.00/2 0.025s, Draw by 3-fold repetition} 1/2-1/2 [/pgn]
Hi, thanks a lot for testing! The dev team found another bug in the tablebase implementation, where only repeats from the current position but not from all positions since the last zeroing move were considered. There is now a fix for this: https://github.com/LeelaChessZero/lc0/pull/412, with compiled binary https://ci.appveyor.com/api/buildjobs/5 ... %2Flc0.exe. If you could run your testing suite with the new build again this would be great :D Thanks again!
How about fixing a bug where engine will suddenly resign during the game out of nowhere? This happens during draw or won game, and especially in long games...
Top
jkiliani
Posts: 143
Joined: Wed Jan 17, 2018 1:26 pm

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by jkiliani »

Damir wrote: ↑Tue Oct 02, 2018 3:03 pm How about fixing a bug where engine will suddenly resign during the game out of nowhere? This happens during draw or won game, and especially in long games...
To fix bugs, we need to first reproduce them. Can you give a .pgn file where this happened for you, as well as specifics about the binary you used and your command line parameters?
Top
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by Laskos »

Laskos wrote: ↑Tue Oct 02, 2018 2:33 pm
Laskos wrote: ↑Tue Oct 02, 2018 1:22 pm
jkiliani wrote: ↑Tue Oct 02, 2018 1:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 1:09 pm No misses this time on 100 hard 6-men wins.
Maybe I will check on say 200 other 6-men won positions, but it seems fine now.
Great, thank you! Do you have any testing suites about holding difficult draws, or avoiding losses on TB lost positions against opponents without TB?
I tested yesterday on 100 long 6-men draws (not sure if they are exactly hard, but many of them are), no losses. Avoiding TB losses against non-TB engine needs comparison with another Syzygy-enabled engine against that non-TB engine. Might compare Lc0_Syzygy against SF8_no_TB compared to SF8_Syzygy against SF8_no_TB on 6-men hard wins. Will depend on time control used too.
Out of 50 6-men TB losses, Lc0_Syzygy (the fixed one) saves 13 against SF8_no_TB, SF8_Syzygy saves 15 against SF8_no_TB. So, behaves similarly to SF8, which has a good TB implementation (and good endgame eval, which Lc0 doesn't). Might check how many saves SF dev.
SF_dev_Syzygy saves 23 out of 50 TB losses. Might be due to different Syzygy implementation, stronger play, etc., I don't know.
Top
nabildanial
Posts: 126
Joined: Thu Jun 05, 2014 5:29 am
Location: Malaysia

Re: Lc0 v18 rc2 for 2080 Syzygy implementation

Post by nabildanial »

Damir wrote: ↑Tue Oct 02, 2018 3:03 pm
jkiliani wrote: ↑Tue Oct 02, 2018 12:12 pm
Laskos wrote: ↑Tue Oct 02, 2018 10:41 am
crem wrote: ↑Tue Oct 02, 2018 8:48 am
Laskos wrote: ↑Mon Oct 01, 2018 11:16 pm
can00336 wrote: ↑Mon Oct 01, 2018 10:47 pm Thanks for finding a bug in the implementation. A proposed fix is available here: https://github.com/LeelaChessZero/lc0/pull/408
You can download a CUDA binary to try the fix here: https://ci.appveyor.com/api/buildjobs/g ... %2Flc0.exe
No, still misses wins as 3-fold rep. at steady rate.
Hi Laskos,

We have a fix for that https://github.com/LeelaChessZero/lc0/pull/410, which we have no way to check currently. Would it be possible for you to test it? The deadline for CCCC binary submission is today, and we'll have to release v0.18.1 today with a fix.
As a last resort we can push this patch blindly, but it would be nice to have it tested. :D
The CUDA build of Lc0 with this patch is https://ci.appveyor.com/api/buildjobs/3 ... %2Flc0.exe

Thanks!
Sill misses by 3-fold, seems at lower rate, only 3 misses out of 100 positions. Time control for Lc0 is 0.5s/move, but as I already wrote, it seems to not matter, and even on easy 6-men wins it misses at pretty much the same rate. Here is the PGN of misses:

[pgn] [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "49"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:04"] [GameEndTime "2018-10-02T10:33:45.395 GTB Daylight Time"] [GameStartTime "2018-10-02T10:33:41.026 GTB Daylight Time"] [PlyCount "20"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/1pk5/K7/8/8/Qr6/4Q3 w - - 0 1"] 1. Ka4 Rxa2+ {-128.51/35 0.20s} 2. Kb3 {+7.20/5 0.50s} 2. ... Ra6 { -128.51/31 0.20s} 3. Kb4 {+7.91/5 0.49s} 3. ... Ra7 {-128.51/33 0.20s} 4. Kc3 {+5.36/4 0.027s} 4. ... Ra3+ {-128.51/33 0.20s} 5. Kb4 {+8.56/5 0.50s} 5. ... Ra7 {-128.51/127 0.002s} 6. Kc3 {+4.75/3 0.022s} 6. ... Ra3+ { -128.51/127 0.001s} 7. Kd2 {+5.06/2 0.016s} 7. ... Ra2+ {-128.51/30 0.20s} 8. Kd3 {+5.39/5 0.50s} 8. ... Ra3+ {-128.51/34 0.20s} 9. Kc2 {+5.71/6 0.52s} 9. ... Ra2+ {-128.51/38 0.20s} 10. Kc3 {+0.63/3 0.041s} 10. ... Ra3+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "145"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:01:27"] [GameEndTime "2018-10-02T11:17:06.373 GTB Daylight Time"] [GameStartTime "2018-10-02T11:15:39.176 GTB Daylight Time"] [PlyCount "270"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "8/8/8/Q7/8/8/1Pp1P3/1k1K4 w - - 0 1"] 1. Kd2 c1=Q+ {-128.51/15 0.20s} 2. Kd3 Qc2+ {-128.51/17 0.20s} 3. Ke3 Qc1+ {-128.51/19 0.20s} 4. Ke4 {+4.30/5 0.44s} 4. ... Qc4+ {-128.51/15 0.20s} 5. Kf3 {+4.44/6 0.047s} 5. ... Qf7+ {-128.51/16 0.20s} 6. Kg3 {+3.85/6 0.50s} 6. ... Qg7+ {-128.51/17 0.20s} 7. Kf4 {+3.88/6 0.50s} 7. ... Qd4+ { -128.51/18 0.20s} 8. Kf3 {+4.42/7 0.096s} 8. ... Qf6+ {-128.51/20 0.20s} 9. Ke4 {+5.22/6 0.54s} 9. ... Qxb2 {-128.51/20 0.20s} 10. Qa6 Kc1 { -128.51/22 0.20s} 11. Kd5 Kd1 {-128.51/18 0.20s} 12. Qd3+ Ke1 {-128.51/22 0.20s} 13. e4 {+128.00/2 0.46s} 13. ... Qb7+ {-128.51/20 0.20s} 14. Ke6 { +3.34/5 0.50s} 14. ... Qc6+ {-128.51/21 0.20s} 15. Kf7 {+3.44/6 0.52s} 15. ... Qb7+ {-128.51/20 0.20s} 16. Kg6 {+3.67/6 0.50s} 16. ... Qc6+ { -128.51/21 0.20s} 17. Kg5 {+3.75/6 0.47s} 17. ... Qc5+ {-128.51/21 0.20s} 18. Qd5 {+7.17/5 0.51s} 18. ... Qe7+ {-128.51/22 0.20s} 19. Kg6 {+6.02/6 0.50s} 19. ... Qe8+ {-128.51/21 0.20s} 20. Kf6 {+4.76/6 0.50s} 20. ... Qf8+ {-128.51/19 0.20s} 21. Kg5 {+4.43/6 0.51s} 21. ... Qe7+ {-128.51/41 0.20s} 22. Kg4 {+4.01/6 0.083s} 22. ... Qg7+ {-128.51/19 0.20s} 23. Kf5 { +4.55/6 0.50s} 23. ... Qf8+ {-128.51/19 0.20s} 24. Ke5 {+4.02/6 0.50s} 24. ... Qh8+ {-128.51/17 0.20s} 25. Ke6 {+4.58/5 0.47s} 25. ... Qh6+ { -128.51/22 0.20s} 26. Kd7 {+6.04/6 0.50s} 26. ... Qg7+ {-128.51/21 0.20s} 27. Kc8 {+6.48/6 0.50s} 27. ... Qc3+ {-128.51/23 0.20s} 28. Kb7 {+6.52/6 0.50s} 28. ... Qg7+ {-128.51/22 0.20s} 29. Ka6 {+7.96/6 0.54s} 29. ... Qf6+ {-128.51/19 0.20s} 30. Kb5 {+7.47/6 0.51s} 30. ... Qb2+ {-128.51/21 0.20s} 31. Ka4 {+7.65/5 0.48s} 31. ... Qc2+ {-128.51/17 0.20s} 32. Ka5 { +8.57/6 0.50s} 32. ... Qc3+ {-128.51/23 0.20s} 33. Ka4 {+6.60/6 0.51s} 33. ... Qc2+ {-128.51/39 0.20s} 34. Kb5 {+4.34/7 0.058s} 34. ... Qb2+ { -128.51/127 0.002s} 35. Kc6 {+2.17/3 0.036s} 35. ... Qh8 {-128.51/16 0.20s } 36. Qe6 {+4.63/5 0.51s} 36. ... Qc3+ {-128.51/19 0.20s} 37. Kd7 {+4.47/6 0.51s} 37. ... Qg7+ {-128.51/19 0.20s} 38. Kd6 {+4.51/7 0.50s} 38. ... Qd4+ {-128.51/20 0.20s} 39. Qd5 {+3.89/6 0.57s} 39. ... Qf6+ {-128.51/24 0.20s} 40. Kc7 {+3.61/6 0.56s} 40. ... Qc3+ {-128.51/22 0.20s} 41. Kb8 { +3.29/6 0.50s} 41. ... Qb2+ {-128.51/24 0.20s} 42. Kc8 {+3.22/6 0.50s} 42. ... Qc3+ {-128.51/48 0.20s} 43. Kd7 {+2.39/7 0.12s} 43. ... Qg7+ { -128.51/127 0.002s} 44. Kc6 {+1.70/4 0.069s} 44. ... Qh8 {-128.51/59 0.20s } 45. Qf5 {+1.92/2 0.026s} 45. ... Qa8+ {-128.51/16 0.20s} 46. Kb5 { +2.54/5 0.50s} 46. ... Qb7+ {-128.51/20 0.20s} 47. Kc5 {+1.57/6 0.078s} 47. ... Qc7+ {-128.51/19 0.20s} 48. Kd5 {+1.44/5 0.026s} 48. ... Qb7+ { -128.51/19 0.20s} 49. Ke6 {+1.83/6 0.46s} 49. ... Qb3+ {-128.51/19 0.20s} 50. Kf6 {+2.35/6 0.50s} 50. ... Qb6+ {-128.51/20 0.20s} 51. Kg5 {+2.17/6 0.47s} 51. ... Qd8+ {-128.51/18 0.20s} 52. Qf6 {+1.94/6 0.048s} 52. ... Qd2+ {-128.51/17 0.20s} 53. Qf4 {+1.32/6 0.022s} 53. ... Qd8+ {-128.51/18 0.20s} 54. Kh5 {+1.13/5 0.034s} 54. ... Qe8+ {-128.51/19 0.20s} 55. Kh4 { +1.07/4 0.026s} 55. ... Qd8+ {-128.51/20 0.20s} 56. Kh3 {+1.42/4 0.026s} 56. ... Qd7+ {-128.51/21 0.20s} 57. Kh2 {+0.77/2 0.018s} 57. ... Qh7+ { -128.51/20 0.20s} 58. Kg2 Qb7 {-128.51/22 0.20s} 59. Kf3 Qc6 {-128.51/20 0.20s} 60. Qg5 Qc3+ {-128.51/15 0.20s} 61. Qe3+ Kd1 {-128.51/17 0.20s} 62. e5 {+128.00/1 0.061s} 62. ... Qc6+ {-128.51/15 0.20s} 63. Qe4 {+12.25/5 0.45s} 63. ... Qe6 {-128.51/15 0.20s} 64. Kf4 {+10.02/5 0.50s} 64. ... Qf7+ {-128.51/16 0.20s} 65. Qf5 {+15.41/5 0.54s} 65. ... Qc7 {-128.51/17 0.20s} 66. Kg5 {+14.04/5 0.51s} 66. ... Qd8+ {-128.51/17 0.20s} 67. Qf6 { +19.64/5 0.50s} 67. ... Qd2+ {-128.51/15 0.20s} 68. Kg6 {+15.87/5 0.50s} 68. ... Qg2+ {-128.51/15 0.20s} 69. Kf7 {+13.02/5 0.46s} 69. ... Qb7+ { -128.51/18 0.20s} 70. Qe7 {+12.94/5 0.52s} 70. ... Qf3+ {-128.51/17 0.20s} 71. Ke8 {+16.37/5 0.50s} 71. ... Qh5+ {-128.51/18 0.20s} 72. Kd8 {+23.68/5 0.50s} 72. ... Qh1 {-128.51/20 0.20s} 73. Qd6+ {+27.20/4 0.50s} 73. ... Ke2 {-128.51/21 0.20s} 74. e6 {+128.00/2 0.50s} 74. ... Qa8+ {-128.51/21 0.20s} 75. Kd7 {+13.64/5 0.50s} 75. ... Qa4+ {-128.51/19 0.20s} 76. Qc6 { +16.29/5 0.50s} 76. ... Qd4+ {-128.51/18 0.20s} 77. Ke8 {+14.46/5 0.50s} 77. ... Qh8+ {-128.51/15 0.20s} 78. Kd7 {+12.86/6 0.49s} 78. ... Qd4+ { -128.51/40 0.20s} 79. Kc8 {+12.21/5 0.51s} 79. ... Qh8+ {-128.51/17 0.20s} 80. Kc7 {+12.02/5 0.50s} 80. ... Qg7+ {-128.51/16 0.20s} 81. Qd7 {+13.17/5 0.54s} 81. ... Qc3+ {-128.51/17 0.20s} 82. Kb6 {+16.91/5 0.50s} 82. ... Qe3+ {-128.51/18 0.20s} 83. Kb7 {+15.93/5 0.50s} 83. ... Qb3+ {-128.51/18 0.20s} 84. Kc7 {+12.30/5 0.50s} 84. ... Qc3+ {-128.51/42 0.20s} 85. Qc6 { +6.62/6 0.050s} 85. ... Qg7+ {-128.51/42 0.20s} 86. Kb6 {+10.55/3 0.024s} 86. ... Qd4+ {-128.51/16 0.20s} 87. Qc5 {+15.59/5 0.55s} 87. ... Qf6 { -128.51/17 0.20s} 88. Qd6 {+17.49/5 0.50s} 88. ... Qb2+ {-128.51/17 0.20s} 89. Kc7 {+19.47/5 0.51s} 89. ... Qc2+ {-128.51/17 0.20s} 90. Kd8 {+25.03/4 0.50s} 90. ... Qe4 {-128.51/17 0.20s} 91. e7 {+128.00/2 0.52s} 91. ... Qa8+ {-128.51/17 0.20s} 92. Kd7 {+18.34/5 0.50s} 92. ... Qb7+ {-128.51/13 0.20s} 93. Ke6 {+19.35/5 0.50s} 93. ... Qc8+ {-128.51/14 0.20s} 94. Kf7 { +17.35/5 0.50s} 94. ... Qf5+ {-128.51/13 0.20s} 95. Qf6 {+26.58/5 0.50s} 95. ... Qh5+ {-M112/14 0.20s} 96. Kf8 {+30.26/5 0.53s} 96. ... Qc5 { -128.51/17 0.20s} 97. Kg7 {+22.48/5 0.50s} 97. ... Qc7 {-128.51/13 0.20s} 98. Kf8 {+26.23/4 0.51s} 98. ... Qc5 {-128.51/61 0.20s} 99. Kf7 {+12.66/2 0.026s} 99. ... Qh5+ {-128.51/60 0.20s} 100. Kg7 {+7.38/3 0.026s} 100. ... Qg4+ {-M70/17 0.20s} 101. Kf8 {+28.90/4 0.51s} 101. ... Qb4 {-M60/20 0.20s} 102. Kf7 {+27.49/5 0.51s} 102. ... Qb7 {-128.51/15 0.20s} 103. Qe6+ {+15.65/4 0.51s} 103. ... Kd2 {-128.51/15 0.20s} 104. Kg6 {+20.09/4 0.49s} 104. ... Qg2+ {-128.51/16 0.20s} 105. Kh7 {+26.29/5 0.50s} 105. ... Qb7 { -128.51/15 0.20s} 106. Kh6 {+21.40/4 0.52s} 106. ... Qh1+ {-128.51/14 0.20s} 107. Kg7 {+19.46/5 0.50s} 107. ... Qg1+ {-128.51/14 0.20s} 108. Qg6 {+15.46/5 0.50s} 108. ... Qd4+ {-128.51/16 0.20s} 109. Qf6 {+18.71/5 0.48s } 109. ... Qg4+ {-128.51/17 0.20s} 110. Kf8 {+21.29/4 0.47s} 110. ... Qb4 {-128.51/17 0.20s} 111. Qe5 {+19.28/5 0.51s} 111. ... Kc2 {-128.51/18 0.20s} 112. Kf7 {+14.70/4 0.52s} 112. ... Qc4+ {-128.51/17 0.20s} 113. Qe6 {+16.22/5 0.50s} 113. ... Qf4+ {-128.51/15 0.20s} 114. Qf6 {+20.87/5 0.50s } 114. ... Qc7 {-128.51/18 0.20s} 115. Kf8 {+27.60/4 0.51s} 115. ... Qc5 { -128.51/19 0.20s} 116. Kg7 {+25.79/4 0.51s} 116. ... Qc7 {-128.51/19 0.20s } 117. Kh6 {+16.18/4 0.53s} 117. ... Qh2+ {-128.51/14 0.20s} 118. Kg7 { +14.99/5 0.47s} 118. ... Qc7 {-128.51/54 0.20s} 119. Kf7 {+7.68/6 0.15s} 119. ... Kd3 {-128.51/16 0.20s} 120. Kf8 {+18.85/4 0.51s} 120. ... Qc5 { -128.51/15 0.20s} 121. Kg7 {+13.07/5 0.51s} 121. ... Qc7 {-128.51/16 0.20s } 122. Kg6 {+8.85/4 0.53s} 122. ... Qg3+ {-M82/15 0.20s} 123. Kf7 { +10.67/5 0.51s} 123. ... Qc7 {-128.51/67 0.20s} 124. Qa6+ {+5.65/6 0.51s} 124. ... Kd4 {-128.51/15 0.20s} 125. Qa1+ {+5.98/5 0.54s} 125. ... Ke3 { -128.51/16 0.20s} 126. Qa3+ {+4.64/5 0.55s} 126. ... Ke2 {-128.51/17 0.20s } 127. Qa6+ {+3.75/5 0.51s} 127. ... Kf2 {-128.51/15 0.20s} 128. Qf6+ { +3.52/5 0.53s} 128. ... Ke1 {-M76/19 0.20s} 129. Kf8 {+4.14/5 0.51s} 129. ... Qc5 {-M74/21 0.20s} 130. Kf7 {+3.84/5 0.50s} 130. ... Qc7 { -128.51/51 0.20s} 131. Qd4 {+1.24/5 0.037s} 131. ... Qb7 {-M60/21 0.20s} 132. Qe5+ {+2.01/5 0.53s} 132. ... Kd1 {-128.51/15 0.20s} 133. Qa1+ { +1.71/5 0.50s} 133. ... Ke2 {-128.51/16 0.20s} 134. Qd4 {+1.25/5 0.031s} 134. ... Qf3+ {-128.51/27 0.20s} 135. Qf6 Qh5+ {-128.51/127 0.001s, Draw by 3-fold repetition} 1/2-1/2 [Event "?"] [Site "?"] [Date "2018.10.02"] [Round "163"] [White "lc0_v18_Syzygy"] [Black "SF8_Syzygy"] [Result "1/2-1/2"] [BlackTimeControl "0.2/move"] [GameDuration "00:00:07"] [GameEndTime "2018-10-02T11:23:43.490 GTB Daylight Time"] [GameStartTime "2018-10-02T11:23:36.381 GTB Daylight Time"] [PlyCount "35"] [SetUp "1"] [WhiteTimeControl "0.5/move"] [FEN "b7/8/6B1/3K4/8/8/2P5/Bk6 w - - 0 1"] 1. Kd4 Bc6 {-128.51/24 0.20s} 2. Kc5 Ba4 {-128.51/26 0.20s} 3. c4+ { +128.00/1 0.052s} 3. ... Kxa1 {-128.51/32 0.20s} 4. Kb4 Bc6 {-128.51/36 0.20s} 5. Ka3 Bh1 {-128.51/38 0.20s} 6. c5 {+128.00/2 0.42s} 6. ... Bg2 { -128.51/38 0.20s} 7. Bf7 {+5.56/5 0.47s} 7. ... Bc6 {-128.51/34 0.20s} 8. Kb3 {+6.24/5 0.49s} 8. ... Kb1 {-128.51/37 0.20s} 9. Kc3 {+5.66/6 0.47s} 9. ... Kc1 {-128.51/34 0.20s} 10. Bh5 {+5.79/6 0.50s} 10. ... Kb1 { -128.51/26 0.20s} 11. Bf7 {+5.32/5 0.039s} 11. ... Kc1 {-128.51/55 0.20s} 12. Bc4 {+4.86/5 0.031s} 12. ... Kd1 {-128.51/31 0.20s} 13. Ba6 {+5.76/2 0.018s} 13. ... Bg2 {-128.51/32 0.20s} 14. Bd3 {+6.96/5 0.50s} 14. ... Bc6 {-128.51/34 0.20s} 15. Ba6 {+5.30/4 0.021s} 15. ... Bg2 {-128.51/62 0.20s} 16. Bb5 {+4.25/4 0.024s} 16. ... Bf3 {-128.51/30 0.20s} 17. Bd3 {+5.92/5 0.52s} 17. ... Bc6 {-128.51/95 0.20s} 18. Ba6 {0.00/2 0.025s, Draw by 3-fold repetition} 1/2-1/2 [/pgn]
Hi, thanks a lot for testing! The dev team found another bug in the tablebase implementation, where only repeats from the current position but not from all positions since the last zeroing move were considered. There is now a fix for this: https://github.com/LeelaChessZero/lc0/pull/412, with compiled binary https://ci.appveyor.com/api/buildjobs/5 ... %2Flc0.exe. If you could run your testing suite with the new build again this would be great :D Thanks again!
How about fixing a bug where engine will suddenly resign during the game out of nowhere? This happens during draw or won game, and especially in long games...
How does a UCI engine resign in games?
Top

Return to “Computer Chess Club: General Topics”