Seer

[Werner]

I test NN engines only on my Skylake pcs - not on the older ivybridge. Here is a result of a short testmatch made with 40/10:
1: Naum 4.6 x64 1CPU 14,5/20 111111110110=1====01
2: Seer 1.0NN x64 1CPU 5,5/20 000000001001=0====10
so I think this version is between Deep Shredder 12 and Koivisto 2.0 (very small sample).

..and I think you can see on the pv when net is not loaded:
FEN: rnbqkbnr/pppppppp/8/8/8/7P/PPPPPPP1/RNBQKBNR b KQkq - 0 1

Seer 1.0NN x64 1CPU:
1/1 00:00 0 0 0,00
5/5 00:00 4k 254k -256,00 h2-h3 h7-h5 g2-g3 h5-h4 f2-f3
6/6 00:00 9k 266k -256,00 h2-h3 h7-h5 g2-g3 h5-h4 f2-f3 h4xg3
7/7 00:00 17k 257k -256,00 h2-h3 h7-h5 g2-g3 h5-h4 f2-f3 h4xg3 e2-e3
8/8 00:00 56k 270k -256,00 h2-h3 h7-h5 g2-g3 h5-h4 f2-f3 h4xg3 e2-e3 g3-g2

-256 ?? this is normally around 40

[Guenther]

Thanks! I will try it out today. I am not very optimistic though, because the core2 binary you released now, just adds around 4% in speed.
Obviously missing popcount and/or newer instructions makes a huge difference here (note that this hardware is from 2009).

For better comparison, vanilla SF12 (nnue integrated) official release has around 300kn/s on this machine.

Ok, my compilation for march=native is just a very tiny bit faster, than your released one for core2.

I noticed now though, that at least from cmd Seer always uses here 2 out of 4 cores?
Hopefully it doesn't act the same in real games too, that would be a problem for rating/test organisations.
May be someone can check this too?

[Guenther]

Thanks! I will try it out today. I am not very optimistic though, because the core2 binary you released now, just adds around 4% in speed.
Obviously missing popcount and/or newer instructions makes a huge difference here (note that this hardware is from 2009).

For better comparison, vanilla SF12 (nnue integrated) official release has around 300kn/s on this machine.

Ok, my compilation for march=native is just a very tiny bit faster, than your released one for core2.

I noticed now though, that at least from cmd Seer always uses here 2 out of 4 cores?
Hopefully it doesn't act the same in real games too, that would be a problem for rating/test organisations.
May be someone can check this too?

I played a few test games now in the CuteChessGUI on my old quadcore and actually it really uses always one extra thread(core),
even when it is not its turn?

It plays very interesting chess, which looks very much like 'young' Leela(LC0), also with all its strengths and weaknesses.
I like it :)

Obviously it needs very good hardware and/or long time controls and it is vulnerable to tactical shots in this stage.
The time management for classical moves per time sessions also looks currently a bit risky, because the last moves
before reaching a session end, have to be made in a tiny amount of time.

Sorry for chosing such a strong opponent considering the conditions on my side.
Here are four games at 40/120s - note that you can select the current game by clicking the three tiny dots in the board header menu.

[pgn]
[Event "Seer_Test"]
[Site "RWBC-CAPPUCCINO"]
[Date "2020.10.20"]
[Round "1"]
[White "Seer_10-64"]
[Black "Topple_074-64"]
[Result "0-1"]
[ECO "D00"]
[GameDuration "00:07:47"]
[GameEndTime "2020-10-20T12:35:17.987 Mitteleuropäische Sommerzeit"]
[GameStartTime "2020-10-20T12:27:30.822 Mitteleuropäische Sommerzeit"]
[Opening "Levitsky attack (Queen's Bishop attack)"]
[PlyCount "156"]
[TimeControl "40/120"]

1. d4 {book} d5 {book}
2. Bg5 {book} f6 {book}
3. Bf4 {book} c5 {book}
4. e3 {+0.69/11 1.98} Nc6 {-0.03/13 2.48}
5. Bb5 {+0.49/13 1.92} e6 {-0.01/14 3.75}
6. Nf3 {+0.65/12 5.84} cxd4 {-0.17/14 3.05}
7. Nxd4 {+1.52/12 1.89} Ne7 {+0.46/13 2.43}
8. Nxc6 {-0.85/12 5.55} bxc6 {+0.90/15 3.86}
9. Bd3 {-0.90/16 14.40} e5 {+0.79/15 9.87}
10. Bg3 {-0.82/13 1.64} Rb8 {+0.86/14 2.08}
11. b3 {-0.53/14 1.66} Be6 {+0.97/15 3.74}
12. O-O {-0.56/11 1.67} Nf5 {+0.93/16 5.08}
13. c4 {-0.61/12 2.19} dxc4 {+0.88/15 3.69}
14. bxc4 {+0.23/11 1.86} Nxg3 {+1.07/15 4.14}
15. hxg3 {+0.12/15 9.89} f5 {+0.89/15 4.48}
16. Qc2 {-0.36/13 1.54} e4 {+0.75/18 16.12}
17. Be2 {-0.56/13 1.56} Qf6 {+0.86/17 2.71}
18. Nc3 {-0.85/13 1.58} Be7 {+0.86/17 7.10}
19. Rab1 {-0.71/13 3.90} O-O {+0.74/16 2.43}
20. c5 {-0.81/14 4.83} Rfd8 {+0.99/13 3.01}
21. Na4 {-0.59/14 1.50} Qf7 {+0.70/16 5.48}
22. g4 {-1.07/13 1.52} Rxb1 {+1.03/14 3.97}
23. Qxb1 {-1.08/11 1.69} Bxa2 {+1.30/13 1.48}
24. Qb4 {-0.95/12 3.10} Qb3 {+1.33/13 1.60}
25. Qa5 {-1.71/16 6.40} Qc2 {+0.92/16 6.13}
26. Qxa7 {-1.97/17 6.46} Kf8 {+1.24/15 4.31}
27. Re1 {-2.88/12 1.96} Rd2 {+1.65/15 4.18}
28. Qa8+ {-3.20/13 1.24} Kf7 {+2.02/13 0.72}
29. Qa6 {-3.96/13 1.60} fxg4 {+1.69/13 0.99}
30. Bxg4 {-4.64/13 1.81} Rxf2 {+2.35/14 1.43}
31. Rf1 {-5.24/14 6.26} Rxf1+ {+2.13/16 1.72}
32. Qxf1+ {-5.15/16 2.88} Bf6 {+2.15/15 2.00}
33. Bd1 {-5.45/15 1.01} Qd3 {+2.90/12 0.70}
34. Qxd3 {-4.18/15 1.65} exd3 {+2.62/12 0.48}
35. Kf2 {-4.27/14 1.03} Bd5 {+2.91/14 1.22}
36. Nb6 {-4.64/15 1.07} Be6 {+2.59/12 0.90}
37. Ba4 {-4.54/14 2.36} Bh4+ {+2.81/12 0.62}
38. Kf1 {-4.86/16 2.48} Be7 {+2.60/12 0.69}
39. Bxc6 {-4.42/16 1.97} Bxc5 {+2.43/11 0.41}
40. Nd5 {-4.52/18 4.75} Ba3 {+2.83/12 0.60}
41. Ke1 {-4.59/16 3.42} Bc1 {+3.03/18 3.79}
42. Kd1 {-4.22/18 1.83} d2 {+3.02/18 3.88}
43. Nc3 {-4.36/17 1.84} Bb3+ {+2.97/17 2.80}
44. Ke2 {-4.28/15 1.85} Ke6 {+3.13/19 5.79}
45. Be4 {-4.46/15 2.16} h5 {+3.25/17 3.28}
46. Bf3 {-5.16/15 1.88} h4 {+3.13/17 9.86}
47. Kd3 {-5.31/15 1.89} Kf5 {+3.19/16 2.35}
48. Nd1 {-5.35/15 1.91} Bxd1 {+3.34/17 2.92}
49. Bxd1 {-5.03/18 1.92} g5 {+3.05/18 4.92}
50. Ke2 {-5.10/18 1.94} g4 {+3.05/18 1.99}
51. Ba4 {-5.04/17 2.24} Ke6 {+2.91/18 3.84}
52. Bd1 {-5.21/18 5.07} Ke5 {+2.86/18 3.04}
53. Ba4 {-5.18/18 1.94} Ke6 {+2.47/18 5.13}
54. Bd1 {-5.07/16 1.95} g3 {+2.88/19 2.60}
55. Bc2 {-6.81/17 3.69} Bb2 {+2.87/18 1.69}
56. Ba4 {-5.49/14 1.95} Kd6 {+2.87/19 2.69}
57. Bc2 {-5.38/17 1.98} Ke5 {+2.85/19 2.48}
58. Ba4 {-5.54/18 2.00} Kd5 {+2.85/19 1.76}
59. Bb3+ {-5.26/16 2.03} Kd6 {+2.85/21 2.33}
60. Bc2 {-5.20/18 2.05} Bc3 {+2.85/21 2.75}
61. Ba4 {-5.53/17 2.08} Bf6 {+3.22/17 2.21}
62. Bb3 {-5.62/17 2.11} Bg5 {+3.23/18 2.59}
63. Bc2 {-6.86/17 2.31} Kd5 {+3.86/18 5.33}
64. Bb3+ {-6.52/17 4.68} Kc5 {+3.93/17 1.79}
65. Ba4 {-6.45/19 2.71} Kb4 {+4.25/18 1.67}
66. Bc2 {-6.86/18 3.15} Kc3 {+6.98/19 3.96}
67. Ba4 {-6.57/18 2.13} Kb2 {+13.62/17 3.73}
68. Kxd2 {-4.62/17 2.18} h3 {+30.60/15 2.08}
69. gxh3 {-4.58/18 4.34} g2 {+M29/17 1.75}
70. Kd3 {-5.28/17 2.17} g1=Q {+M27/17 1.61}
71. Kc4 {-5.13/16 2.22} Bxe3 {+M29/17 2.16}
72. Kd5 {-9.07/19 25.12} Qh1+ {+M15/18 2.35}
73. Kd6 {-9.77/18 12.56} Qxh3 {+M29/18 1.80}
74. Kc7 {-3.05/12 1.37} Bf4+ {+M43/14 1.75}
75. Kd8 {-3.12/12 0.53} Qc3 {+M43/14 3.70}
76. Bd7 {-4.88/13 1.46} Qf6+ {+M5/45 1.94}
77. Ke8 {-256.00/14 0.75} Bg5 {+M3/89 1.51}
78. Bh3 {-256.00/15 0.49} Qe7# {+M1/255 0.036}
{Black mates}
0-1

[Event "Seer_Test"]
[Site "RWBC-CAPPUCCINO"]
[Date "2020.10.20"]
[Round "1"]
[White "Topple_074-64"]
[Black "Seer_10-64"]
[Result "1-0"]
[ECO "D00"]
[GameDuration "00:06:57"]
[GameEndTime "2020-10-20T12:42:16.499 Mitteleuropäische Sommerzeit"]
[GameStartTime "2020-10-20T12:35:19.195 Mitteleuropäische Sommerzeit"]
[Opening "Levitsky attack (Queen's Bishop attack)"]
[PlyCount "115"]
[TimeControl "40/120"]

1. d4 {book} d5 {book}
2. Bg5 {book} f6 {book}
3. Bf4 {book} c5 {book}
4. e3 {-0.05/13 2.53} cxd4 {-0.86/13 2.45}
5. exd4 {+0.07/16 6.77} Nc6 {-0.64/14 13.10}
6. Bb5 {+0.07/17 4.78} a6 {-0.20/14 5.82}
7. Bxc6+ {+0.16/15 4.68} bxc6 {-0.28/13 1.69}
8. Nc3 {+0.16/15 3.00} e6 {-0.41/13 1.70}
9. Qf3 {+0.03/16 5.99} Ne7 {+0.33/15 9.18}
10. h4 {+0.11/15 3.28} a5 {+0.32/13 1.59}
11. Na4 {+0.10/14 3.54} Nf5 {+0.39/13 3.82}
12. O-O-O {+0.01/14 4.62} Be7 {-0.02/12 1.58}
13. Qc3 {-0.07/15 3.31} Bb4 {+0.71/13 2.63}
14. Qb3 {-0.12/16 5.20} O-O {+1.30/12 1.59}
15. Kb1 {-0.18/15 2.79} Ba6 {+1.00/13 1.61}
16. a3 {-0.30/14 4.62} Bd6 {+0.88/14 1.63}
17. Bxd6 {-0.35/15 3.62} Nxd6 {+1.87/15 8.15}
18. Nf3 {-0.19/15 2.27} Qe7 {+2.17/12 1.64}
19. Nd2 {-0.07/14 3.35} e5 {+2.24/12 1.53}
20. Qb6 {-0.08/14 3.94} Qe8 {+1.13/17 19.33}
21. Nc5 {+0.29/13 3.18} Be2 {+3.90/13 1.31}
22. Rde1 {+0.15/15 3.37} exd4 {+1.16/13 2.09}
23. Ka1 {+0.30/16 7.27} Nc4 {+1.76/17 12.92}
24. Nxc4 {-0.01/16 2.62} dxc4 {+3.20/18 9.12}
25. h5 {+0.10/16 1.94} Rb8 {+1.89/15 5.97}
26. Qc7 {+0.24/16 4.82} Rb5 {+3.83/9 0.32}
27. h6 {+0.68/15 2.99} Rf7 {+5.28/11 0.32}
28. Qd6 {+0.69/16 3.42} Qe7 {+0.57/10 0.33}
29. Qxd4 {+0.57/15 3.61} Rxc5 {-0.45/13 1.31}
30. Rxe2 {+0.36/15 4.63} Qxe2 {-0.70/11 0.45}
31. Qxc5 {+0.59/15 1.89} Qxc2 {-0.59/10 0.30}
32. Qxa5 {+0.39/14 3.00} gxh6 {-0.23/11 0.69}
33. Qa8+ {+0.29/15 0.99} Kg7 {+1.45/13 2.07}
34. Qxc6 {+0.31/15 1.85} Re7 {+1.39/11 0.21}
35. f4 {+0.26/14 1.54} h5 {+1.89/11 0.62}
36. g3 {+0.41/12 1.15} Qb3 {+1.95/9 0.20}
37. Qc5 {+0.50/13 0.57} Re2 {+2.07/10 0.44}
38. Rb1 {+0.34/11 0.60} Kg6 {+2.71/9 0.42}
39. Qd5 {+1.23/13 0.55} Qc2 {0.00/12 0.83}
40. Qg8+ {+1.39/12 1.47} Kf5 {0.00/11 0.15}
41. Qf7 {+1.11/15 6.40} Kg4 {+1.93/18 11.83}
42. Qxf6 {+0.98/15 5.62} Kf3 {+1.72/19 22.26}
43. Qc6+ {+1.06/14 2.54} Kg4 {0.00/19 16.89}
44. Qd7+ {+1.13/15 2.57} Kxg3 {+3.71/12 1.11}
45. Qg7+ {+1.34/16 3.69} Kf3 {+1.79/13 3.04}
46. Qg5 {+1.33/17 12.17} Ke3 {-0.01/13 1.89}
47. f5+ {+2.67/14 3.21} Kd4 {-0.68/17 14.52}
48. f6 {+2.79/16 5.16} c3 {+3.15/12 1.53}
49. Qf4+ {+7.28/15 3.55} Kd3 {+3.35/12 0.86}
50. f7 {+8.41/14 2.15} cxb2+ {-0.12/15 11.45}
51. Ka2 {+14.60/14 5.16} Re4 {-4.58/13 8.87}
52. Qd6+ {+21.02/14 2.26} Kc3 {-6.91/13 1.78}
53. Qc5+ {+34.44/14 3.26} Rc4 {-13.38/13 6.54}
54. Qa5+ {+M17/15 2.77} Kd3 {-28.36/13 2.53}
55. f8=Q {+M13/18 1.70} Rf4 {-33.09/14 4.39}
56. Qd5+ {+M9/26 2.24} Ke2 {-32.98/10 0.55}
57. Qxf4 {+M5/46 2.88} h4 {-256.00/8 0.25}
58. Qdf3# {+M1/255 0.044}
{White mates}
1-0

[Event "Seer_Test"]
[Site "RWBC-CAPPUCCINO"]
[Date "2020.10.20"]
[Round "2"]
[White "Seer_10-64"]
[Black "Topple_074-64"]
[Result "0-1"]
[ECO "A46"]
[GameDuration "00:05:07"]
[GameEndTime "2020-10-20T12:47:25.445 Mitteleuropäische Sommerzeit"]
[GameStartTime "2020-10-20T12:42:17.608 Mitteleuropäische Sommerzeit"]
[Opening "Queen's pawn game"]
[PlyCount "89"]
[Termination "adjudication"]
[TimeControl "40/120"]

1. d4 {book} Nf6 {book}
2. Nf3 {book} c5 {book}
3. d5 {book} d6 {book}
4. c4 {+1.14/13 1.91} g6 {-0.20/14 2.65}
5. Nc3 {+1.57/13 2.19} Bf5 {-0.31/14 3.38}
6. Nh4 {+1.93/13 3.55} Bc8 {-0.58/18 22.73}
7. e4 {+1.53/12 1.92} Nbd7 {-0.57/16 5.71}
8. Be2 {+2.52/12 1.94} Bg7 {-0.56/16 2.60}
9. f4 {+2.49/11 1.96} b6 {-0.57/13 4.49}
10. O-O {+2.40/13 3.73} O-O {-0.58/15 3.94}
11. Be3 {+2.20/11 1.96} Bb7 {-0.55/14 1.90}
12. Qd2 {+2.96/11 2.23} Qe8 {-0.45/12 2.13}
13. Rad1 {+3.56/11 1.99} Rd8 {-0.54/14 8.39}
14. f5 {+3.66/11 2.34} Ne5 {-0.36/11 1.41}
15. Bg5 {+4.47/10 2.03} a6 {-0.37/12 2.87}
16. Qf4 {+4.59/10 2.05} Rb8 {-0.33/12 2.13}
17. b3 {+3.75/11 2.54} Ba8 {-0.28/11 2.38}
18. h3 {+5.07/9 2.09} b5 {+0.08/12 2.35}
19. Rb1 {+2.32/13 22.23} b4 {-0.03/12 2.33}
20. Na4 {+3.00/13 2.71} a5 {-0.21/12 2.10}
21. Rbe1 {+3.57/16 20.22} Bb7 {0.00/11 1.81}
22. g4 {+4.46/12 1.12} Nfd7 {+0.26/11 1.78}
23. Bh6 {+3.27/10 1.93} f6 {+0.19/14 10.73}
24. Bxg7 {+2.77/11 1.13} Kxg7 {+0.17/14 2.36}
25. g5 {+2.27/11 1.15} Kh8 {+0.44/12 1.65}
26. gxf6 {+0.58/15 14.04} Rg8 {+0.54/13 1.53}
27. Kg2 {+0.33/10 0.74} g5 {+3.83/14 1.53}
28. Qf2 {-7.63/12 1.44} gxh4+ {+3.53/14 2.21}
29. Kh2 {-7.12/12 0.74} exf6 {+3.52/14 1.91}
30. Qxh4 {-6.88/11 0.76} Rg5 {+3.22/15 2.94}
31. Qh6 {-7.38/12 1.24} Nd3 {+6.58/14 2.67}
32. Bxd3 {-12.98/10 0.77} Qe5+ {+10.12/16 1.82}
33. Kh1 {-15.98/14 0.79} Qg3 {+10.55/16 2.24}
34. Qxg5 {-17.00/14 1.38} fxg5 {+11.24/15 1.77}
35. Bc2 {-16.92/13 2.27} Qxh3+ {+12.60/17 1.26}
36. Kg1 {-17.51/13 0.73} Qg3+ {+13.52/17 2.02}
37. Kh1 {-16.63/14 0.76} Ne5 {+13.52/17 1.57}
38. Re2 {-19.76/17 4.88} Nf3 {+13.75/17 1.30}
39. Rxf3 {-21.91/16 3.65} Qxf3+ {+14.29/17 1.12}
40. Rg2 {-20.99/13 0.10} g4 {+14.83/17 1.70}
41. Nb2 {-24.62/15 2.31} g3 {+16.83/17 2.24}
42. Kg1 {-27.99/21 24.18} Qc3 {+15.79/17 2.17}
43. Bd3 {-28.29/21 19.65} Qe1+ {+17.75/18 6.11}
44. Bf1 {-28.52/17 1.19} Qxe4 {+18.00/16 2.05}
45. Rxg3 {-28.77/18 8.31}
{Black wins by adjudication}
0-1

[Event "Seer_Test"]
[Site "RWBC-CAPPUCCINO"]
[Date "2020.10.20"]
[Round "2"]
[White "Topple_074-64"]
[Black "Seer_10-64"]
[Result "1-0"]
[ECO "A46"]
[GameDuration "00:03:57"]
[GameEndTime "2020-10-20T12:51:23.547 Mitteleuropäische Sommerzeit"]
[GameStartTime "2020-10-20T12:47:26.525 Mitteleuropäische Sommerzeit"]
[Opening "Queen's pawn game"]
[PlyCount "79"]
[TimeControl "40/120"]

1. d4 {book} Nf6 {book}
2. Nf3 {book} c5 {book}
3. d5 {book} d6 {book}
4. Nc3 {+0.47/14 4.27} a6 {-1.35/12 1.91}
5. a4 {+0.41/15 2.44} e6 {-0.96/14 4.08}
6. e4 {+0.73/15 2.55} exd5 {-1.27/14 2.17}
7. exd5 {+0.71/17 4.67} Be7 {-0.50/12 1.91}
8. Bc4 {+0.57/16 3.93} O-O {-0.65/13 1.93}
9. O-O {+0.64/17 7.01} Re8 {-0.95/15 9.08}
10. Re1 {+0.63/16 3.12} Nbd7 {-0.65/14 1.83}
11. h3 {+0.61/16 5.98} h6 {-0.43/12 1.85}
12. Bf1 {+0.54/16 8.19} Nf8 {-0.39/11 1.87}
13. Nd2 {+0.61/16 5.07} Qc7 {-0.83/13 2.72}
14. Nc4 {+0.82/17 13.71} Bd7 {-1.01/13 1.89}
15. Bd3 {+0.76/14 2.62} Rad8 {0.00/11 1.91}
16. Bf4 {+0.92/15 5.04} Ng6 {-1.15/12 1.93}
17. Bxg6 {+4.53/16 6.13} fxg6 {-0.28/13 1.95}
18. Rxe7 {+6.81/15 3.02} Rxe7 {-13.98/18 7.47}
19. Bxd6 {+7.20/16 3.05} Qxd6 {-14.46/16 2.10}
20. Nxd6 {+7.30/15 1.70} Bxh3 {-14.63/15 1.88}
21. Nc4 {+7.26/15 1.72} Be6 {-14.16/13 5.29}
22. Nb6 {+7.49/14 3.06} Bf5 {-14.34/14 8.90}
23. a5 {+7.54/14 2.11} Nd7 {-15.09/15 20.48}
24. Nca4 {+7.57/13 1.39} Re4 {-14.97/17 13.65}
25. Nxd7 {+8.19/15 1.71} Rd4 {-14.88/15 2.10}
26. Qe2 {+8.72/16 1.63} Rxd7 {-15.16/13 0.70}
27. c3 {+8.91/17 2.23} R4xd5 {-14.44/13 0.72}
28. Nb6 {+9.27/16 2.02} Rd2 {-15.49/13 0.73}
29. Qe8+ {+9.48/16 1.79} Kh7 {-15.29/13 0.74}
30. Nxd7 {+9.53/18 2.51} Bxd7 {-16.13/12 1.02}
31. Qf7 {+10.16/15 1.38} g5 {-15.78/11 0.77}
32. Re1 {+15.70/12 1.24} Be6 {-29.62/17 8.64}
33. Qxe6 {+18.35/15 1.64} Rd8 {-25.72/12 0.63}
34. Qe4+ {+18.95/15 2.13} Kh8 {-25.43/11 0.40}
35. Qxb7 {+19.46/14 1.66} g4 {-28.79/15 4.22}
36. Qxa6 {+21.90/14 2.33} c4 {-27.65/12 1.69}
37. Qg6 {+M11/18 1.21} g3 {-24.68/7 0.062}
38. fxg3 {+M9/30 1.24} h5 {-256.00/9 0.24}
39. Re7 {+M7/54 1.31} h4 {-256.00/8 0.051}
40. Qxg7# {+M1/255 0.039}
{White mates}
1-0[/pgn]

[connor_mcmonigle]

I played a few test games now in the CuteChessGUI on my old quadcore and actually it really uses always one extra thread(core),
even when it is not its turn?

Oh. Crap. You're totally right. I added some code to fix this behavior, but it somehow didn't make its way to GitHub... I'll fix this soon. The problem originates from the CLI thread continuing to look for new input even when stopped. Thanks for bringing this issue to my attention.

[connor_mcmonigle]

...
I played a few test games now in the CuteChessGUI on my old quadcore and actually it really uses always one extra thread(core),
even when it is not its turn?

It plays very interesting chess, which looks very much like 'young' Leela(LC0), also with all its strengths and weaknesses.
I like it

Obviously it needs very good hardware and/or long time controls and it is vulnerable to tactical shots in this stage.
The time management for classical moves per time sessions also looks currently a bit risky, because the last moves
before reaching a session end, have to be made in a tiny amount of time.

Sorry for chosing such a strong opponent considering the conditions on my side.
Here are four games at 40/120s - note that you can select the current game by clicking the three tiny dots in the board header menu.

Thanks for testing it and no worries. I enjoy watching it lose as well Its play also reminds me a lot of young Leela (pre T10 run), tactical vulnerabilities and all. At least with the current network, I've observed it has some funny quirks which define its style such as being very content to get doubled pawns and extremely hesitant to push it's F pawn (this also results in it sometimes missing tactical shots involving F pawn pushes). In general, it places a lot of weight on achieving a big center and also really likes to create imbalances for better or worse (it is often overly optimistic in bishop+rook vs. queen positions, especially when it has the bishop pair).

The riskiness you observe with time per session time controls is probably, in part, because it's already losing in all these games by the time it reaches 40 moves so it spends extra time looking for a way out. It's definitely still stronger at blitz and better suited for longer time controls.

[connor_mcmonigle]

I test NN engines only on my Skylake pcs - not on the older ivybridge. Here is a result of a short testmatch made with 40/10:
1: Naum 4.6 x64 1CPU 14,5/20 111111110110=1====01
2: Seer 1.0NN x64 1CPU 5,5/20 000000001001=0====10
so I think this version is between Deep Shredder 12 and Koivisto 2.0 (very small sample).

Thanks for testing! This is about consistent with what I would expect for this time control, perhaps a little worse (In my limited testing, playing strength seemed to vary a fair bit between opponents). My time management implementation is probably a bit worse at time per session than incremental time controls as well.

[Guenther]

...
I played a few test games now in the CuteChessGUI on my old quadcore and actually it really uses always one extra thread(core),
even when it is not its turn?

It plays very interesting chess, which looks very much like 'young' Leela(LC0), also with all its strengths and weaknesses.
I like it :)

Obviously it needs very good hardware and/or long time controls and it is vulnerable to tactical shots in this stage.
The time management for classical moves per time sessions also looks currently a bit risky, because the last moves
before reaching a session end, have to be made in a tiny amount of time.

Sorry for chosing such a strong opponent considering the conditions on my side.
Here are four games at 40/120s - note that you can select the current game by clicking the three tiny dots in the board header menu.

Thanks for testing it and no worries. I enjoy watching it lose as well :D Its play also reminds me a lot of young Leela (pre T10 run), tactical vulnerabilities and all. At least with the current network, I've observed it has some funny quirks which define its style such as being very content to get doubled pawns and extremely hesitant to push it's F pawn (this also results in it sometimes missing tactical shots involving F pawn pushes). In general, it places a lot of weight on achieving a big center and also really likes to create imbalances for better or worse (it is often overly optimistic in bishop+rook vs. queen positions, especially when it has the bishop pair).

The riskiness you observe with time per session time controls is probably, in part, because it's already losing in all these games by the time it reaches 40 moves so it spends extra time looking for a way out. It's definitely still stronger at blitz and better suited for longer time controls.

In one of the 4 games an interesting buggy move popped up:

[pgn][Event "Seer_Test"]
[Site "RWBC-CAPPUCCINO"]
[Date "2020.10.20"]
[Round "2"]
[White "Seer_10-64"]
[Black "Topple_074-64"]
[Result "0-1"]
[ECO "A46"]
[GameDuration "00:05:07"]
[GameEndTime "2020-10-20T12:47:25.445 Mitteleuropäische Sommerzeit"]
[GameStartTime "2020-10-20T12:42:17.608 Mitteleuropäische Sommerzeit"]
[Opening "Queen's pawn game"]
[PlyCount "89"]
[Termination "adjudication"]
[TimeControl "40/120"]
[SetUp "1"]
[FEN "1r2q1rk/1b1np2p/3p1Pp1/p1pPnP2/NpP1PQ1N/1P5P/P3B3/4RRK1 w - - 1 27"]

27. Kg2 {+0.33/10 0.74} g5 {+3.83/14 1.53}
28. Qf2 {-7.63/12 1.44} gxh4+ {+3.53/14 2.21}
29. Kh2 {-7.12/12 0.74} exf6 {+3.52/14 1.91}
30. Qxh4 {-6.88/11 0.76} Rg5 {+3.22/15 2.94}
31. Qh6 {-7.38/12 1.24} Nd3 {+6.58/14 2.67}
32. Bxd3 {-12.98/10 0.77} Qe5+ {+10.12/16 1.82}
33. Kh1 {-15.98/14 0.79} Qg3 {+10.55/16 2.24}
34. Qxg5 {-17.00/14 1.38} fxg5 {+11.24/15 1.77}
35. Bc2 {-16.92/13 2.27} Qxh3+ {+12.60/17 1.26}
36. Kg1 {-17.51/13 0.73} Qg3+ {+13.52/17 2.02}
37. Kh1 {-16.63/14 0.76} Ne5 {+13.52/17 1.57}
38. Re2 {-19.76/17 4.88} Nf3 {+13.75/17 1.30}
39. Rxf3 {-21.91/16 3.65} Qxf3+ {+14.29/17 1.12}
40. Rg2 {-20.99/13 0.10} g4 {+14.83/17 1.70}
41. Nb2 {-24.62/15 2.31} g3 {+16.83/17 2.24}
42. Kg1 {-27.99/21 24.18} Qc3 {+15.79/17 2.17}
43. Bd3 {-28.29/21 19.65} Qe1+ {+17.75/18 6.11}
44. Bf1 {-28.52/17 1.19} Qxe4 {+18.00/16 2.05}
45. Rxg3 {-28.77/18 8.31}
{Black wins by adjudication}
0-1[/pgn]

When I start it inside CuteChessGUI for that position the move Kg2 never is considered and the correct Ng2, at least since depth 10.

Edit: ofc it is also possible it simply needs a certain depth - even to resolve a pawn fork?
No idea though, why it played that move so quickly. I could have spent more time here.

Haven't tried yet with feeding the whole game history for populating the hashtable until the crucial position.

Code: Select all

position fen 1r2q1rk/1b1np2p/3p1Pp1/p1pPnP2/NpP1PQ1N/1P5P/P3B3/4RRK1 w - - 1 27
isready
readyok
go wtime 3600000 btime 3600000 movestogo 40
info depth 1 seldepth 1 multipv 1 score cp 0 nodes 0 nps 0 tbhits 0 time 3 pv 
info depth 2 seldepth 2 multipv 1 score cp 553 nodes 197 nps 21888 tbhits 0 time 8 pv f5g6 
info depth 3 seldepth 3 multipv 1 score cp 458 nodes 701 nps 31863 tbhits 0 time 21 pv f6e7 e8e7 
info depth 4 seldepth 4 multipv 1 score cp 491 nodes 924 nps 34222 tbhits 0 time 26 pv f6e7 g6f5 g1h1 
info depth 5 seldepth 5 multipv 1 score cp 491 nodes 1237 nps 37484 tbhits 0 time 32 pv f6e7 g6f5 g1h1 e8e7 
info depth 6 seldepth 6 multipv 1 score cp 349 nodes 3214 nps 42289 tbhits 0 time 75 pv f5g6 g8g6 h4g6 e8g6 g1h1 g6f6 h1h2 
info depth 7 seldepth 7 multipv 1 score cp 278 nodes 8977 nps 44661 tbhits 0 time 200 pv g1h2 e7f6 f5g6 g8g6 h4f5 
info depth 8 seldepth 8 multipv 1 score cp 466 nodes 9988 nps 45400 tbhits 0 time 219 pv g1h2 g6f5 f6f7 g8g6 
info depth 9 seldepth 9 multipv 1 score cp 569 nodes 15181 nps 46003 tbhits 0 time 329 pv f6e7 e8e7 f5f6 g6g5 g1h1 
info depth 10 seldepth 10 multipv 1 score cp 86 nodes 89131 nps 44992 tbhits 0 time 1980 pv h4g2 e7f6 g1h1 e8f7 g2e3 g6f5 e4f5 b8f8 h1h2 
info depth 11 seldepth 11 multipv 1 score cp 88 nodes 92859 nps 45230 tbhits 0 time 2052 pv h4g2 e7f6 g1h1 e8e7 g2e3 b8f8 f4h6 g6g5 
info depth 12 seldepth 12 multipv 1 score cp 130 nodes 99566 nps 45505 tbhits 0 time 2187 pv h4g2 e7f6 g1h1 e8e7 g2e3 g6g5 f4g3 b8f8 h1h2 
info depth 13 seldepth 13 multipv 1 score cp 97 nodes 169585 nps 45710 tbhits 0 time 3709 pv h4g2 e7f6 g1h2 g6f5 e4f5 b8a8 g2e3 e8e7 f1g1 g8g5 e1f1 
info depth 14 seldepth 14 multipv 1 score cp 71 nodes 224348 nps 46124 tbhits 0 time 4863 pv h4g2 e7f6 g1h2 g6f5 e4f5 b8a8 g2e3 e8e7 f1g1 a8f8 g1g8 f8g8 f4h6 
info depth 15 seldepth 15 multipv 1 score cp 28 nodes 410775 nps 44331 tbhits 0 time 9265 pv h4g2 e7f6 g1h1 g6f5 e4f5 e8e7 g2e3 b8f8 h1h2 e7g7 f1g1 g7e7 h3h4 g8g1 e1g1 e5g4 e3g4 
info depth 16 seldepth 16 multipv 1 score cp 86 nodes 489043 nps 43750 tbhits 0 time 11177 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 g2e3 b8f8 f1g1 g8g5 h3h4 g5g1 e1g1 e5g4 e3g4 
info depth 17 seldepth 17 multipv 1 score cp 73 nodes 670674 nps 43993 tbhits 0 time 15244 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 g2e3 b8f8 f1g1 g8g5 h3h4 g5g8 f4h6 g8g7 
info depth 18 seldepth 18 multipv 1 score cp -13 nodes 1060505 nps 44547 tbhits 0 time 23805 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 g2e3 b8e8 f4h4 g8g5 h4f4 e7g7 f1g1 g7h6 e1f1 e8d8 
info depth 19 seldepth 19 multipv 1 score cp -26 nodes 1105812 nps 44724 tbhits 0 time 24724 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 g2e3 b8e8 h3h4 e5f7 e3g4 d7e5 e1c1 e5g4 e2g4 
info depth 20 seldepth 20 multipv 1 score cp -26 nodes 1179991 nps 44900 tbhits 0 time 26279 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 g2e3 b8e8 h3h4 e5f7 e3g4 d7e5 e1c1 e5g4 e2g4 
info depth 21 seldepth 21 multipv 1 score cp -23 nodes 1512444 nps 45182 tbhits 0 time 33473 pv h4g2 g6f5 e4f5 e7f6 g1h2 e8e7 g2e3 g8g5 a4b2 b8e8 f1g1 e8g8 b2d3 e5d3 e2d3 d7e5 d3e4 g8g7 
info depth 22 seldepth 22 multipv 1 score cp -7 nodes 1785626 nps 45393 tbhits 0 time 39336 pv h4g2 e7f6 g1h2 g6f5 f4f5 e8g6 f5g6 h7g6 g2e3 h8g7 e2g4 g8d8 g4d7 d8d7 a4b6 d7e7 h2g2 g7f7 
info depth 23 seldepth 23 multipv 1 score cp 38 nodes 2205526 nps 45677 tbhits 0 time 48284 pv h4g2 e7f6 g1h2 g6f5 e4f5 e8e7 a4b2 g8g5 g2e3 b8e8 h3h4 g5g7 h2h1 e8f8 e2h5 e7d8 f1g1 d8e7 f4h6 
info depth 24 seldepth 24 multipv 1 score cp 103 nodes 3367090 nps 45903 tbhits 0 time 73350 pv h4g2 g6f5 e4f5 e7f6 g1h2 e8e7 a4b2 g8g5 h3h4 g5g7 g2e3 b8e8 f1g1 e8g8 g1g7 e7g7 e1f1 g7e7 b2d3 e7g7 f1d1 
bestmove h4g2

[connor_mcmonigle]

In one of the 4 games an interesting buggy move popped up:

Interesting. Thanks for investigating. I'm not quite sure what to make of that. As you can see from running the engine on the crucial position, the evaluation fluctuates quite a lot on this position and, likely, on surrounding positions (as a consequence of the network misevaluating). Therefore, it's at least conceivable the hashtable entries are responsible for the blunder Kg2.

[connor_mcmonigle]

Edit: ofc it is also possible it simply needs a certain depth - even to resolve a pawn fork?
No idea though, why it played that move so quickly. I could have spent more time here.

On second thought, that's a simple enough tactic that it should be resolved immediately, I would guess. I'll have to do some more analysis, but my guess is that it's not so much that Seer isn't seeing the tactic. Rather, the resultant position where it's down a piece for pawn has ridiculously high static evaluation and therefore is getting static null move pruned.

It probably didn't use more time as the evaluation and best move were stable for a couple iterations.

It's also totally possible it's a bug or a hash collision.

[Guenther]

I played a few test games now in the CuteChessGUI on my old quadcore and actually it really uses always one extra thread(core),
even when it is not its turn?

Oh. Crap. You're totally right. I added some code to fix this behavior, but it somehow didn't make its way to GitHub... I'll fix this soon. The problem originates from the CLI thread continuing to look for new input even when stopped. Thanks for bringing this issue to my attention.

Thanks for the quick fix - I also thought it might be some thread polling issue - compiled the current repo again and all is ok now.