TalkChess.com

CPU - Ryzen Threadripper 1950x
GPU - Nvidia GTX 1080ti

Ethereal: 8threads, 150MB hash, 20+.2s time control.
Leela: 2threads, 10+.1s time control (But Ponder turned on)

Games are played with 8moves_v3, openings NOT repeated.
No adjudication.

Ethereal 10.00 (POPCNT) vs The Lc0 chess engine.: 48 - 0 - 0 [1.000] 48

Ethereal has a fairly established elo, so it looks like Leela's elo = 3200 - Infinity = -Infinity (92% confidence)

PGN is here : https://www.dropbox.com/s/99wsy5sf2zzkq ... s.pgn?dl=0

I think these games highligh some serious issues with Leela's position play. As well as her tactical play.

Oh, also, Leela was using the CPU not the GPU here.

As others have noted, Leela does better running on a GPU.

It does appear to be getting better. Following are a couple games against Arasan. In the first one it had a draw and then threw it away. The second one was actually a win (Arasan played a dubious opening line, but still, LC0 showed it can win given a chance).

[Event "?"]
[Site "chessclub.com"]
[Date "2018.06.03"]
[Round "?"]
[White "Arasan TCEC12-56-ge980232"]
[Black "moliartiLC0"]
[Result "1-0"]
[ECO "A02"]
[WhiteElo "2527"]
[BlackElo "2437"]
[TimeControl "300+5"]

1. f4 Nf6 2. Nf3 b6 3. d4 e6 4. e3 d5 5. Bb5+ c6 6. Bd3 Be7 7. b3 O-O
8. Nbd2 Ba6 9. O-O Bxd3 10. cxd3 c5 11. Bb2 a5 12. Rc1 a4 13. bxa4
Qd7 14. dxc5 Bxc5 15. Qe2 Be7 16. Nb3 Qxa4 17. Rc2 Nc6 18. Nbd4 Nxd4
19. Bxd4 Nd7 20. Ne5 Nxe5 21. fxe5 Qa5 22. Rb1 b5 23. Rf1 Rac8
24. Rfc1 Rxc2 25. Qxc2 h5 26. h3 b4 27. Qc7 Qa3 28. Rf1 Bg5 29. h4
Bh6 30. Qc2 g6 31. Kh2 Bg7 32. Kh3 Qa6 33. Qd2 Qa5 34. Rb1 Qc7
35. Rc1 Qb7 36. Rb1 Qc7 37. Qxb4 Qc2 38. Rb3 Qf2 39. a4 Qf5+ 40. Kh2
Ra8 41. Rb2 Bxe5+ 42. g3 Bxd4 43. Qxd4 Qf1 44. Qc3 Kh7 45. Qb4 Kg8
46. Qd4 Rc8 47. a5 Ra8 48. a6 Qc1 49. Kg2 Qc6 50. a7 Qc7 51. Ra2 Qb7
52. Kh2 Kh7 53. Qc5 Qb1 54. Qa5 Kg7 55. Qc3+ Kh7 56. Qa5 Kg7 57. Kg2
Qxd3 58. Qb6 Qc4 59. Rf2 Qa4 60. Qb2+ Kh6 61. Rxf7 Qe4+ 62. Kh2 e5
63. Qf2 Re8 64. Rf8 Qa4 65. g4 hxg4 66. Qf6 g3+ 67. Kxg3 Qxa7
68. Qg5+ Kh7 69. Rxe8 Qg7 70. Re7 Kh8 71. Rxg7 Kxg7 72. Qe7+ Kh6
73. Kg4 d4 74. Qf7 d3 75. Qg8 d2 76. Qh8#
1-0 {moliartiLC0 checkmated}

[Event "?"]
[Site "chessclub.com"]
[Date "2018.06.03"]
[Round "?"]
[White "moliartiLC0"]
[Black "Arasan TCEC12-56-ge980232"]
[Result "1-0"]
[ECO "B84"]
[WhiteElo "2425"]
[BlackElo "2539"]
[TimeControl "300+5"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 a6 6. Be2 e6 7. Be3
Be7 8. Qd2 Qc7 9. g4 b5 10. g5 Nfd7 11. a3 Bb7 12. O-O-O O-O 13. h4
Nc5 14. f3 Nc6 15. h5 Rad8 16. Nxc6 Bxc6 17. h6 g6 18. b4 Nd7 19. Kb2
f6 20. f4 Nc5 21. Bg4 f5 22. exf5 gxf5 23. Bh5 Ne4 24. Nxe4 Bxe4
25. Rhg1 a5 26. bxa5 Rc8 27. Rc1 Qc4 28. Be2 Qa4 29. Qd4 Rxc2+
30. Rxc2 Qxc2+ 31. Ka1 e5 32. Qb2 Qxb2+ 33. Kxb2 Ra8 34. Bxb5 Rxa5
35. a4 Ra8 36. Rc1 Bd8 37. Rd1 Rc8 38. Rxd6 Ba5 39. Bd3 Rb8+ 40. Kc2
Rc8+ 41. Kd1 Bf3+ 42. Be2 Bxe2+ 43. Kxe2 exf4 44. Bd4 Rd8 45. Rxd8+
Bxd8 1-0 {ArasanX resigns}

LOL. Always funny to see an engine author getting so salty over LC0 that they resort to posting something like this. Classy.

Cheers, Andrew. Look forward to Ethereal's thrashing at the hands of Leela in S13.

[quote]Always funny to see an engine author getting so salty over LC0[/quote]

Your post has left me confused. Can you please explain?

I wanted to contribute to the testing threads that I see here so often, so I have mirrored their setups.

Thanks, Andrew