Chess.com 2018 computer chess championship

[chrisw]

Updating status!

Leela's chance of going into final is thinner and thinner!

Anyway, 11250 + TB should be +50 elo than current network and she will have high chance of going into final in October 5/2 blitz tourney.

I can only hope it is not going to happen because I do not like stupid engines to get good results.

LOL, that's brilliant!

Exactly for this I like Lc0. Maybe because I empathize with it, as I am stupid too, but I want to get good results .
In fact the best thing for me would be "Idiot's guide on how to have a shot at Nobel Prize being a complete idiot" .

lc0 evaluated a drawn tablebases KQ vs KQP as 15 pawns for herself.
Lack of tablebases is no excuse because normal engines without them are not going to do it.

Yeah, I'm still trying to work out whether to "like" LC0 or not. It would be easy if it (she?) was in a vacuum, but there's a lot of baggage associated.

[Nay Lin Tun]

Leela's first win against Komodo! ( opening book - 2 moves)

[pgn][Event "CCCC 1: Rapid Rumble (15|5) Stage 2"] [Site "Chess.com"] [Date "2018.09.23"] [Round "?"] [White "Lc0 17.11089"] [Black "Komodo 2118.00"] [Result "1-0"] [BlackElo "3244"] [ECO "A80"] [Opening "Dutch"] [Time "06:03:58"] [Variation "Alapin"] [WhiteElo "3300"] [TimeControl "900+5"] [Termination "normal"] [PlyCount "371"] [WhiteType "human"] [BlackType "human"] 1. d4 f5 2. Qd3 e6 3. c4 b5 4. cxb5 Nf6 5. Nc3 a6 6. e3 axb5 7. Qxb5 Be7 8. Qb3 O-O 9. Nf3 Nc6 10. Be2 Ba6 11. Bxa6 Rxa6 12. O-O Qa8 13. a3 Ne4 14. Bd2 Rb8 15. Qc2 Nb4 16. Qb1 Nxc3 17. Bxc3 Nd5 18. Qd3 Ra4 19. Rac1 Bd6 20. Rc2 Rb3 21. Nd2 Rb8 22. Rfc1 Qc6 23. h3 Qb5 24. Qxb5 Rxb5 25. Nb1 Rb3 26. Be1 Nb6 27. Kf1 Kf7 28. Nd2 Rb5 29. Nf3 Ra7 30. Rd1 Na4 31. b4 Nb6 32. Rd3 Ra8 33. Rb3 h5 34. Bd2 c6 35. Bc1 Ke8 36. g3 Be7 37. h4 Bf6 38. Nd2 Be7 39. Kg2 g5 40. hxg5 Bxg5 41. Bb2 Bf6 42. Rc1 Kf7 43. Nb1 Nd5 44. Nc3 Rb7 45. Nxd5 exd5 46. Rh1 Kg6 47. Kf3 Rbb8 48. Rc3 Rh8 49. Rcc1 Kf7 50. Ke2 Ke6 51. Rh2 Be7 52. Rch1 Rh7 53. Bc1 Rah8 54. Rh3 Kf7 55. Kd3 Kg6 56. Kc2 Rb8 57. Bd2 Rhh8 58. R3h2 Rb7 59. Kb3 Rb6 60. Rf1 Ra8 61. Bc1 Rba6 62. Re1 R6a7 63. Rf1 Rh8 64. Re1 Ra6 65. Rd1 Rb8 66. Rf1 Rh8 67. Re1 Rb8 68. Rd1 Rba8 69. Rg1 Rh8 70. Re1 Rb8 71. Rd1 Rba8 72. Rh3 R6a7 73. Rf1 Rh8 74. Rfh1 Bd6 75. Rh4 Be7 76. R4h2 Bd6 77. Re1 Rha8 78. Rhh1 Rb8 79. Rh2 Rh8 80. Rhh1 Ra6 81. Rh3 Be7 82. Rhh1 Ra7 83. Ref1 Rha8 84. Rd1 Bd6 85. Rh2 Rh8 86. Bd2 Rha8 87. Bc1 Ra6 88. Bb2 Rh8 89. Rdh1 Ra7 90. Bc1 Be7 91. Rg2 Rb8 92. f3 Rh8 93. Re2 Rf8 94. Bd2 Rfa8 95. Bc1 Rf8 96. Reh2 Rh8 97. Bb2 Bd6 98. Bc3 Rha8 99. Bb2 Rh8 100. Rh4 Be7 101. R4h3 Ra6 102. R3h2 Ra7 103. Bc3 Rb7 104. Re1 Bd6 105. Rh3 Re8 106. Bd2 Rh8 107. Rh4 Be7 108. Rhh1 Ra8 109. Bc1 Rba7 110. Rh2 Re8 111. e4 fxe4 112. fxe4 Bd8 113. e5 Rf8 114. Bf4 Bg5 115. e6 Bxf4 116. e7 Re8 117. gxf4 d6 118. Re6+ Kf7 119. Rxd6 Rea8 120. Ra2 Rxe7 121. Rxc6 Re1 122. b5 h4 123. Kb4 Rb1+ 124. Kc5 h3 125. a4 Rh1 126. Rh6 Kg7 127. Rh4 Rc1+ 128. Kb6 Rcc8 129. Rxh3 Kg6 130. Ra1 Rab8+ 131. Ka5 Ra8+ 132. Kb4 Rc4+ 133. Kb3 Rb8 134. Rah1 Ra8 135. Ra1 Rb8 136. Rg1+ Kf6 137. Rd1 Rcc8 138. Rc3 Re8 139. Rc5 Re3+ 140. Kb4 Re2 141. Rxd5 Rb2+ 142. Ka3 Rh2 143. Rc5 Rbh8 144. Rc3 Ra8 145. Rdc1 Rhh8 146. Kb4 Rad8 147. Rc4 Rh2 148. Kb3 Rb8 149. d5 Ke7 150. f5 Kd6 151. f6 Ke5 152. Rc6 Rh7 153. d6 Rh3+ 154. Kb4 Ke6 155. Ka5 Ra8+ 156. Ra6 Rd8 157. f7 Rh4 158. Rf1 Rf8 159. Ra7 Kd5 160. d7 Rd4 161. b6 Ke4 162. d8=R Rfxd8 163. f8=Q R4d5+ 164. Ka6 Rxf8 165. Rxf8 Rg5 166. a5 Rg6 167. Kb5 Rg1 168. Kc4 Rc1+ 169. Kb5 Rb1+ 170. Kc4 Rc1+ 171. Kb3 Rb1+ 172. Kc3 Rc1+ 173. Kd2 Rg1 174. b7 Rg2+ 175. Kc3 Rg3+ 176. Kc4 Rg1 177. b8=Q Rc1+ 178. Kb3 Rb1+ 179. Kc4 Rc1+ 180. Kb5 Rb1+ 181. Kc5 Rc1+ 182. Kd6 Rd1+ 183. Ke6 Rd6+ 184. Qxd6 Ke3 185. Rd7 Ke2 186. Qd2# 1-0 [/pgn]

Leela got 3rd position after this game.
Her performance would be second best if there were only top 4 engines!

[chrisw]

Leela's first win against Komodo! ( opening book - 2 moves)

[pgn][Event "CCCC 1: Rapid Rumble (15|5) Stage 2"] [Site "Chess.com"] [Date "2018.09.23"] [Round "?"] [White "Lc0 17.11089"] [Black "Komodo 2118.00"] [Result "1-0"] [BlackElo "3244"] [ECO "A80"] [Opening "Dutch"] [Time "06:03:58"] [Variation "Alapin"] [WhiteElo "3300"] [TimeControl "900+5"] [Termination "normal"] [PlyCount "371"] [WhiteType "human"] [BlackType "human"] 1. d4 f5 2. Qd3 e6 3. c4 b5 4. cxb5 Nf6 5. Nc3 a6 6. e3 axb5 7. Qxb5 Be7 8. Qb3 O-O 9. Nf3 Nc6 10. Be2 Ba6 11. Bxa6 Rxa6 12. O-O Qa8 13. a3 Ne4 14. Bd2 Rb8 15. Qc2 Nb4 16. Qb1 Nxc3 17. Bxc3 Nd5 18. Qd3 Ra4 19. Rac1 Bd6 20. Rc2 Rb3 21. Nd2 Rb8 22. Rfc1 Qc6 23. h3 Qb5 24. Qxb5 Rxb5 25. Nb1 Rb3 26. Be1 Nb6 27. Kf1 Kf7 28. Nd2 Rb5 29. Nf3 Ra7 30. Rd1 Na4 31. b4 Nb6 32. Rd3 Ra8 33. Rb3 h5 34. Bd2 c6 35. Bc1 Ke8 36. g3 Be7 37. h4 Bf6 38. Nd2 Be7 39. Kg2 g5 40. hxg5 Bxg5 41. Bb2 Bf6 42. Rc1 Kf7 43. Nb1 Nd5 44. Nc3 Rb7 45. Nxd5 exd5 46. Rh1 Kg6 47. Kf3 Rbb8 48. Rc3 Rh8 49. Rcc1 Kf7 50. Ke2 Ke6 51. Rh2 Be7 52. Rch1 Rh7 53. Bc1 Rah8 54. Rh3 Kf7 55. Kd3 Kg6 56. Kc2 Rb8 57. Bd2 Rhh8 58. R3h2 Rb7 59. Kb3 Rb6 60. Rf1 Ra8 61. Bc1 Rba6 62. Re1 R6a7 63. Rf1 Rh8 64. Re1 Ra6 65. Rd1 Rb8 66. Rf1 Rh8 67. Re1 Rb8 68. Rd1 Rba8 69. Rg1 Rh8 70. Re1 Rb8 71. Rd1 Rba8 72. Rh3 R6a7 73. Rf1 Rh8 74. Rfh1 Bd6 75. Rh4 Be7 76. R4h2 Bd6 77. Re1 Rha8 78. Rhh1 Rb8 79. Rh2 Rh8 80. Rhh1 Ra6 81. Rh3 Be7 82. Rhh1 Ra7 83. Ref1 Rha8 84. Rd1 Bd6 85. Rh2 Rh8 86. Bd2 Rha8 87. Bc1 Ra6 88. Bb2 Rh8 89. Rdh1 Ra7 90. Bc1 Be7 91. Rg2 Rb8 92. f3 Rh8 93. Re2 Rf8 94. Bd2 Rfa8 95. Bc1 Rf8 96. Reh2 Rh8 97. Bb2 Bd6 98. Bc3 Rha8 99. Bb2 Rh8 100. Rh4 Be7 101. R4h3 Ra6 102. R3h2 Ra7 103. Bc3 Rb7 104. Re1 Bd6 105. Rh3 Re8 106. Bd2 Rh8 107. Rh4 Be7 108. Rhh1 Ra8 109. Bc1 Rba7 110. Rh2 Re8 111. e4 fxe4 112. fxe4 Bd8 113. e5 Rf8 114. Bf4 Bg5 115. e6 Bxf4 116. e7 Re8 117. gxf4 d6 118. Re6+ Kf7 119. Rxd6 Rea8 120. Ra2 Rxe7 121. Rxc6 Re1 122. b5 h4 123. Kb4 Rb1+ 124. Kc5 h3 125. a4 Rh1 126. Rh6 Kg7 127. Rh4 Rc1+ 128. Kb6 Rcc8 129. Rxh3 Kg6 130. Ra1 Rab8+ 131. Ka5 Ra8+ 132. Kb4 Rc4+ 133. Kb3 Rb8 134. Rah1 Ra8 135. Ra1 Rb8 136. Rg1+ Kf6 137. Rd1 Rcc8 138. Rc3 Re8 139. Rc5 Re3+ 140. Kb4 Re2 141. Rxd5 Rb2+ 142. Ka3 Rh2 143. Rc5 Rbh8 144. Rc3 Ra8 145. Rdc1 Rhh8 146. Kb4 Rad8 147. Rc4 Rh2 148. Kb3 Rb8 149. d5 Ke7 150. f5 Kd6 151. f6 Ke5 152. Rc6 Rh7 153. d6 Rh3+ 154. Kb4 Ke6 155. Ka5 Ra8+ 156. Ra6 Rd8 157. f7 Rh4 158. Rf1 Rf8 159. Ra7 Kd5 160. d7 Rd4 161. b6 Ke4 162. d8=R Rfxd8 163. f8=Q R4d5+ 164. Ka6 Rxf8 165. Rxf8 Rg5 166. a5 Rg6 167. Kb5 Rg1 168. Kc4 Rc1+ 169. Kb5 Rb1+ 170. Kc4 Rc1+ 171. Kb3 Rb1+ 172. Kc3 Rc1+ 173. Kd2 Rg1 174. b7 Rg2+ 175. Kc3 Rg3+ 176. Kc4 Rg1 177. b8=Q Rc1+ 178. Kb3 Rb1+ 179. Kc4 Rc1+ 180. Kb5 Rb1+ 181. Kc5 Rc1+ 182. Kd6 Rd1+ 183. Ke6 Rd6+ 184. Qxd6 Ke3 185. Rd7 Ke2 186. Qd2# 1-0 [/pgn]

Leela got 3rd position after this game.
Her performance would be second best if there were only top 4 engines!

This was lost by Komodo, not won by Leela. On move 3 Komodo gave away a pawn, and that's the way it stayed. Pieces were exchanged, any pressure Komodo had evaporated, but Leela had a bad bishop. Which Leela then proceeded to make worse by putting all her pawns on the same colour squares. Then the interminable shuffling, with Leela presumably misevaluating and unable to work out that she had to advance a pawn onto a white square somehow. The reason she eventually did, had nothing to do with playing chess well, but only in order to avoid the 50 move draw rule. And as a result of Leela being forced to do what she didn't want to do, her position improved and Komodo went downhill.
So, actually, Komodo played not a bad defensive game at all, and Leela blundered into a win, effectively. Nothing at all to crow about, I'm afraid.

[nabildanial]

Leela wins again vs Komodo.

[pgn][Event "CCCC 1: Rapid Rumble (15|5) Stage 2"] [Site "Chess.com"] [Date "2018.09.24"] [Round "?"] [White "Lc0 17.11089"] [Black "Komodo 2118.00"] [Result "1-0"] [WhiteElo "3300"] [BlackElo "3244"] [WhiteType "program"] [BlackType "program"] [ECO "B06"] [Opening "Robatsch (modern) defence"] [TimeControl "900+5"] [Time "22:22:45"] [Termination "normal"] [PlyCount "173"] 1. e4 g6 2. d4 Nf6 3. e5 Nh5 4. Nc3 d5 5. Nf3 Ng7 6. h3 c6 7. Bd3 Ne6 8. Be3 Bg7 9. Qd2 O-O 10. Ne2 c5 11. c3 cxd4 12. cxd4 Nc6 13. h4 Qa5 14. h5 Qxd2+ 15. Kxd2 Rd8 16. Rag1 Nb4 17. Bb1 Nc6 18. hxg6 hxg6 19. Ne1 a5 20. f4 a4 21. Bd3 Nb4 22. Bb1 Nc6 23. Bd3 Nb4 24. g4 Nf8 25. Bb1 Nc6 26. f5 Na5 27. Nf4 Nc4+ 28. Ke2 Ra6 29. Ned3 f6 30. e6 g5 31. Nh5 Nxe6 32. fxe6 Rxe6 33. Rh3 Bh8 34. Nc5 Rc6 35. Nxa4 e5 36. Bg6 b5 37. Nc5 Nxb2 38. Bf2 Nc4 39. Nd3 Be6 40. a3 Ra8 41. Nb4 Rd6 42. Bf5 Bxf5 43. gxf5 Re8 44. Kf1 exd4 45. Bxd4 Re4 46. Rd3 Rh4 47. Ng3 Rd7 48. Rh1 Rxh1+ 49. Nxh1 Kf7 50. Ng3 Bg7 51. Kg2 g4 52. Nc6 Bf8 53. Nh5 Rd6 54. Na7 Ra6 55. Nxb5 Ra5 56. Rb3 Nd2 57. Rb2 Ne4 58. Ng3 Bxa3 59. Rb3 Be7 60. Nxe4 dxe4 61. Kg3 Ra8 62. Kxg4 Rc8 63. Kf4 e3 64. Bxe3 Rh8 65. Nd4 Bd6+ 66. Ke4 Ke8 67. Kd5 Bg3 68. Ke6 Rh4 69. Nf3 Ra4 70. Kxf6 Kd7 71. Rd3+ Kc6 72. Ke6 Re4+ 73. Kf7 Kb7 74. Bg5 Bf2 75. Kg6 Bc5 76. f6 Kb6 77. f7 Bf8 78. Kf5 Ra4 79. Ne5 Kb5 80. Rd8 Ra2 81. Rxf8 Rf2+ 82. Bf4 Rg2 83. Rb8+ Ka6 84. f8=Q Rg5+ 85. Bxg5 Ka7 86. Rb1 Ka6 87. Qa3# 1-0[/pgn]

[Jesse Gersenson]

https://cccfiles.chess.com/archive/ccc1 ... /games.pgn

[Guenther]

https://cccfiles.chess.com/archive/ccc1 ... /games.pgn

A pity that it is again incomplete like stage 1 already.
http://talkchess.com/forum3/viewtopic.p ... 75#p774375

[Guenther]

This is the table after some cleaning up (not only the unterminated, but also the wrong game headers)
Game 1 which was still testing and was played with no opening moves at all still counts...
Andscacs instead of 1. e4 c5 2. Nf3 h6 3. c3 vs. SF played from the start position and the testing game
was elevated to a real stage 2 game later.

The normally reversed opening pair for that game:

[Event "TESTING for Stage 2"]
[Site "Chess.com"]
[Date "2018.09.17"]
[Round "?"]
[White "Andscacs 0.94"]
[Black "Stockfish 220818"]
[Result "0-1"]
[WhiteElo "3244"]
[BlackElo "3300"]
[ECO "C01"]
[TimeControl "900+5"]
[Time "10:23:16"]
[Termination "normal"]
[PlyCount "118"]

1. e4 {+0.20/26 21}
1... e6 {-0.15/33 50}
2. d4 {+0.29/29 29}
2... d5 {-0.11/32 8}
3. exd5 {+0.27/29 67}

[Event "CCCC 1: Rapid Rumble Stage 2"]
[Site "Chess.com"]
[Date "2018.09.18"]
[Round "?"]
[White "Stockfish 220818"]
[Black "Andscacs 0.94"]
[Result "1-0"]
[WhiteElo "3439"]
[BlackElo "3300"]
[ECO "B27"]
[TimeControl "900+5"]
[Time "08:39:57"]
[Termination "normal"]
[PlyCount "147"]

1. e4 c5 2. Nf3 h6 3. c3 {+0.77/32 50}

Code: Select all

CCCC 1: Rapid Rumble (15|5) Stage 2
Chess.com, 2018.09.17 - 2018.09.25
Average Rating: 3430  (Category 48)
                     Rtng    Score              1          2          3          4          5          6          7          8   Perf Chg
------------------------------------------------------------------------------------------------------------------------------------------
 1: Stockfish 220818 3439  51.0 / 70   XXXXXXXXXX =1=1=1=1=1 ===1=====1 ====1===== 1=1=1=1=11 11=11=1=1= =1=111===1 11=11111==   3596 +140  (+32 -0 =38)
 2: Houdini 6.03     3439  42.0 / 69   =0=0=0=0=0 XXXXXXXXXX 1==1==01=. ========1= 1==1=1==== 11=11=1==1 =1===1=1=1 1=1=1===1=   3501 +55  (+21 -6 =42)
 3: Komodo 2118.00   3439  38.5 / 69   ===0=====0 0==0==10=. XXXXXXXXXX ======0=01 1====1===1 1==101==== 1==1==1==1 1==1=1=1==   3465 +21  (+16 -8 =45)
 4: Lc0 17.11089     3439  37.5 / 70   ====0===== ========0= ======1=10 XXXXXXXXXX ========10 =111=0==== 11====1=== 10====101=   3451  +7  (+12 -7 =51)
 5: Ethereal 10.88   3404  31.0 / 70   0=0=0=0=00 0==0=0==== 0====0===0 ========01 XXXXXXXXXX ==0=0====1 ======1=== 1=1=10=11=   3386 -14  (+8 -16 =46)
 6: Fire 7.1         3404  29.0 / 70   00=00=0=0= 00=00=0==0 0==010==== =000=1==== ==1=1====0 XXXXXXXXXX ===1=1=1== =====0=1==   3364 -35  (+8 -20 =42)
 7: Booot 6.3.1      3439  25.5 / 70   =0=000===0 =0===0=0=0 0==0==0==0 00====0=== ======0=== ===0=0=0== XXXXXXXXXX ====1=====   3321 -119  (+1 -20 =49)
 8: Andscacs 0.94    3439  24.5 / 70   00=00000== 0=0=0===0= 0==0=0=0== 01====010= 0=0=01=00= =====1=0== ====0===== XXXXXXXXXX   3310 -126  (+4 -25 =41)
------------------------------------------------------------------------------------------------------------------------------------------
279 games: +79 -23 =177

[Guenther]

Ordo calculation of ratings after stage 1 + 2 combined (3 missing games) with 300 simuls.
Based on CCRL 40/40 average rating of Texel + Laser (4CPU) plus 3.5*35 rating points.
Texel and Laser placed in the middle range, therefore selected.
(48 physical cores = 3.5 doublings to 4 cores, 35 per doubling cautiously assumed between 4 and 48, YMMV)

Code: Select all

CCRL 40/40 Complete rating list

Laser 1.6 64-bit 4CPU	3223	+23	−23	40.8%
Texel 1.07 64-bit 4CPU	3143	+15	−15	49.8%

3223+3143/2=3183
3183+(3.5*35)~3305

Code: Select all

   # PLAYER              :   RATING   ERROR  POINTS  PLAYED   (%)
   1 Stockfish 220818    :  3663.79   52.89    90.0     116  77.6
   2 Houdini 6.03        :  3584.63   41.68    79.0     115  68.7
   3 Komodo 2118.00      :  3565.40   46.24    76.5     115  66.5
   4 Lc0 17.11089        :  3513.30   47.34    68.5     115  59.6
   5 Fire 7.1            :  3465.80   43.57    62.0     116  53.4
   6 Ethereal 10.88      :  3459.26   41.68    61.0     116  52.6
   7 Booot 6.3.1         :  3416.64   44.68    54.5     116  47.0
   8 Andscacs 0.94       :  3400.08   44.39    52.0     116  44.8
   9 Shredder 13         :  3370.30   62.61    26.5      46  57.6
  10 Xiphos 0.3.17       :  3324.13   63.92    24.0      46  52.2
  11 Fritz 16.10         :  3324.13   60.07    24.0      46  52.2
  12 Texel 1.07          :  3305.80   63.57    23.0      46  50.0
  13 Laser 1.6           :  3289.81   60.37    21.0      44  47.7
  14 Pedone 1.8          :  3269.06   64.72    21.0      46  45.7
  15 Vajolet 2.6         :  3269.06   62.75    21.0      46  45.7
  16 Arasan CCCC-2018    :  3250.55   61.77    20.0      46  43.5
  17 Fizbo 1.9           :  3241.23   68.62    19.5      46  42.4
  18 Gull 3.syz          :  3222.42   70.70    18.5      46  40.2
  19 Wasp 3.25           :  3164.08   72.15    15.5      46  33.7
  20 Nemorino 5.00       :  3143.72   70.10    14.5      46  31.5
  21 Ivanhoe 999946h     :  3112.00   72.30    13.0      46  28.3
  22 Senpai 2.0          :  3042.52   80.28    10.0      46  21.7
  23 Nirvana 2.4         :  2989.46   90.39     8.0      46  17.4
  24 Crafty 25.2         :  2932.85  104.85     6.0      45  13.3

White advantage = 61.91 +/- 8.17
Draw rate (equal opponents) = 72.56 % +/- 2.60

(based on average rating of 3305 see above)

[chrisw]

This is the table after some cleaning up (not only the unterminated, but also the wrong game headers)
Game 1 which was still testing and was played with no opening moves at all still counts...
Andscacs instead of 1. e4 c5 2. Nf3 h6 3. c3 vs. SF played from the start position and the testing game
was elevated to a real stage 2 game later.

The normally reversed opening pair for that game:

[Event "TESTING for Stage 2"]
[Site "Chess.com"]
[Date "2018.09.17"]
[Round "?"]
[White "Andscacs 0.94"]
[Black "Stockfish 220818"]
[Result "0-1"]
[WhiteElo "3244"]
[BlackElo "3300"]
[ECO "C01"]
[TimeControl "900+5"]
[Time "10:23:16"]
[Termination "normal"]
[PlyCount "118"]

1. e4 {+0.20/26 21}
1... e6 {-0.15/33 50}
2. d4 {+0.29/29 29}
2... d5 {-0.11/32 8}
3. exd5 {+0.27/29 67}

[Event "CCCC 1: Rapid Rumble Stage 2"]
[Site "Chess.com"]
[Date "2018.09.18"]
[Round "?"]
[White "Stockfish 220818"]
[Black "Andscacs 0.94"]
[Result "1-0"]
[WhiteElo "3439"]
[BlackElo "3300"]
[ECO "B27"]
[TimeControl "900+5"]
[Time "08:39:57"]
[Termination "normal"]
[PlyCount "147"]

1. e4 c5 2. Nf3 h6 3. c3 {+0.77/32 50}

Code: Select all

CCCC 1: Rapid Rumble (15|5) Stage 2
Chess.com, 2018.09.17 - 2018.09.25
Average Rating: 3430  (Category 48)
                     Rtng    Score              1          2          3          4          5          6          7          8   Perf Chg
------------------------------------------------------------------------------------------------------------------------------------------
 1: Stockfish 220818 3439  51.0 / 70   XXXXXXXXXX =1=1=1=1=1 ===1=====1 ====1===== 1=1=1=1=11 11=11=1=1= =1=111===1 11=11111==   3596 +140  (+32 -0 =38)
 2: Houdini 6.03     3439  42.0 / 69   =0=0=0=0=0 XXXXXXXXXX 1==1==01=. ========1= 1==1=1==== 11=11=1==1 =1===1=1=1 1=1=1===1=   3501 +55  (+21 -6 =42)
 3: Komodo 2118.00   3439  38.5 / 69   ===0=====0 0==0==10=. XXXXXXXXXX ======0=01 1====1===1 1==101==== 1==1==1==1 1==1=1=1==   3465 +21  (+16 -8 =45)
 4: Lc0 17.11089     3439  37.5 / 70   ====0===== ========0= ======1=10 XXXXXXXXXX ========10 =111=0==== 11====1=== 10====101=   3451  +7  (+12 -7 =51)
 5: Ethereal 10.88   3404  31.0 / 70   0=0=0=0=00 0==0=0==== 0====0===0 ========01 XXXXXXXXXX ==0=0====1 ======1=== 1=1=10=11=   3386 -14  (+8 -16 =46)
 6: Fire 7.1         3404  29.0 / 70   00=00=0=0= 00=00=0==0 0==010==== =000=1==== ==1=1====0 XXXXXXXXXX ===1=1=1== =====0=1==   3364 -35  (+8 -20 =42)
 7: Booot 6.3.1      3439  25.5 / 70   =0=000===0 =0===0=0=0 0==0==0==0 00====0=== ======0=== ===0=0=0== XXXXXXXXXX ====1=====   3321 -119  (+1 -20 =49)
 8: Andscacs 0.94    3439  24.5 / 70   00=00000== 0=0=0===0= 0==0=0=0== 01====010= 0=0=01=00= =====1=0== ====0===== XXXXXXXXXX   3310 -126  (+4 -25 =41)
------------------------------------------------------------------------------------------------------------------------------------------
279 games: +79 -23 =177

I want to suggest the elo of LC0 somehow manages to match the elo of whatever it is playing against. Well, that's one "explanation" of its rather curious behaviour:

If one looks at the loss count of the second program, Houdini against the final ranking of its opponents, we get, as would be expected, an decreasing gradient: 5,1,0,0,0,0,0
Komodo gets: 2,3,2,0,1,0,0
Ethereal: 6,3,3,1,2,0,1
Fire: 6,6,3,3,1,0,1
Booot: 5,4,4,3,1,3,0
Andsacs: 7,4,4,3,5,1,1

Lc0 is different: 1,1,1,1,1,0,2, almost irrelevent who the opponent is, the loss rate remains almost constant.

Obviously, "non-losses", counting wins and draws together, shows the same pattern in reverse. Which suggests, well, to me, that LC0 doesn't really have an elo that can be mapped onto any particular opponent. It's not behaving itself properly according to the laws of elo ratings.

[Robert Pope]

I want to suggest the elo of LC0 somehow manages to match the elo of whatever it is playing against. Well, that's one "explanation" of its rather curious behaviour:

If one looks at the loss count of the second program, Houdini against the final ranking of its opponents, we get, as would be expected, an decreasing gradient: 5,1,0,0,0,0,0
Komodo gets: 2,3,2,0,1,0,0
Ethereal: 6,3,3,1,2,0,1
Fire: 6,6,3,3,1,0,1
Booot: 5,4,4,3,1,3,0
Andsacs: 7,4,4,3,5,1,1

Lc0 is different: 1,1,1,1,1,0,2, almost irrelevent who the opponent is, the loss rate remains almost constant.

Obviously, "non-losses", counting wins and draws together, shows the same pattern in reverse. Which suggests, well, to me, that LC0 doesn't really have an elo that can be mapped onto any particular opponent. It's not behaving itself properly according to the laws of elo ratings.

I think the issue is that LC0 plays very well, except for a glaring hole that almost any opponent can capitalize on. Other engines have their own holes, but they are subtle, so weaker engines are less likely to discover them.

If an engine were programmed to put its queen randomly en prise in 10% of games, it's going to lose at least 10% of the time, no matter who the opponent is.