The “Kryptonite” position

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
dkappe
Posts: 272
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

The “Kryptonite” position

Post by dkappe » Sat Nov 30, 2019 11:14 pm

Scorpio just lost in a real howler to Komodo at CCCC. Here the key position:



Here Scorpio played Kxh4??

I was able to reproduce this, but the amazing thing is that almost all of the leela nets I tried also played this howler —- 11258, 42850, t60, LD2, t58, Bad Gyal 8, etc., and only saw the light after 30M+ nodes or many more. The only exceptions were Good Gyal 7, which got it after 2.5M nodes and Dark Queen 2.1, which took only 150k nodes to discard the move. Both of these last two nets rely heavily of SF’s eval rather than self-play.

I’m adding this to my endgame test suite. Not hard for an ab engine, but kryptonite for an nn engine.

jp
Posts: 839
Joined: Mon Apr 23, 2018 5:54 am

Re: The “Kryptonite” position

Post by jp » Sun Dec 01, 2019 12:37 pm

What PV does Leela give when it choose Kxh4?

zullil
Posts: 5680
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: The “Kryptonite” position

Post by zullil » Sun Dec 01, 2019 5:02 pm

jp wrote:
Sun Dec 01, 2019 12:37 pm
What PV does Leela give when it choose Kxh4?
Here's the portion of Lc0's log file before and after it realizes the Kxh4 loses (at about 2.25 M nodes and 30 s). This is J13B.3-200.

Code: Select all

1201 11:54:14.551671 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp 20 hashfull 1 nps 70907 tbhits 95433 multipv 1 pv g4h4 e5d5 h4g4 d5e6 g4g5 e6
f7 g5h6 f7f6 h3h4 f6f5 g2g3 c7a6 h6g7 a6c7 g7f7 c7a6 f7e7 f5g4 e7f6 g4g3
1201 11:54:14.551782 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp 19 hashfull 1 nps 70907 tbhits 95433 multipv 2 pv d5d6 e5d6 g4h4 c7e6 h4g4 d6
c5 g4f3 c5b5 f3e4 b5a5
1201 11:54:14.551797 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp 16 hashfull 1 nps 70907 tbhits 95433 multipv 3 pv g4g5 c7d5 a5a6 d5c7 a6a7 e5
e4 g5g6 e4f4 g6h5 f4g3 h5g5 c7a8 g5f5 a8c7 f5e5 g3g2
1201 11:54:14.551806 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp 2 hashfull 1 nps 70907 tbhits 95433 multipv 4 pv g4f3 e5d5 f3f4 c7e6 f4g4 d5c
6 g4h4 c6b5 h4g4 b5a5
1201 11:54:14.551815 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp 5 hashfull 1 nps 70907 tbhits 95433 multipv 5 pv g2g3 h4g3 g4g3 e5d5
1201 11:54:14.551824 140330957842176 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 26411 nodes 1872742 score cp -37 hashfull 1 nps 70907 tbhits 95433 multipv 6 pv a5a6 c7a6 g4g5 e5e4 g5f6 e
4f4 f6g6 a6c5 d5d6 f4g3 g6h5 c5d7 h5g5 d7e5 g5h5 e5f7
1201 11:54:14.551882 140330957842176 ../../src/chess/uciloop.cc:218] << info string a5a6  (913 ) N:    6677 (+ 0) (P:  8.12%) (Q: -0.12683) (D:  0.833) (U: 0.20188) (Q+U:  0.07506) (V: -0.0009) 
1201 11:54:14.551894 140330957842176 ../../src/chess/uciloop.cc:218] << info string g2g3  (374 ) N:   21033 (+ 0) (P:  7.24%) (Q:  0.01792) (D:  0.959) (U: 0.05720) (Q+U:  0.07512) (V: -0.0011) 
1201 11:54:14.551902 140330957842176 ../../src/chess/uciloop.cc:218] << info string g4f3  (849 ) N:   21410 (+ 0) (P:  8.68%) (Q:  0.00778) (D:  0.924) (U: 0.06735) (Q+U:  0.07513) (V:  0.0054) 
1201 11:54:14.551910 140330957842176 ../../src/chess/uciloop.cc:218] << info string g4g5  (861 ) N:  227117 (+ 0) (P: 25.87%) (Q:  0.05620) (D:  0.837) (U: 0.01891) (Q+U:  0.07512) (V:  0.0698) 
1201 11:54:14.551918 140330957842176 ../../src/chess/uciloop.cc:218] << info string d5d6  (1007) N:  358297 (+ 0) (P: 20.22%) (Q:  0.06574) (D:  0.917) (U: 0.00937) (Q+U:  0.07511) (V:  0.0166) 
1201 11:54:14.551926 140330957842176 ../../src/chess/uciloop.cc:218] << info string g4h4  (858 ) N: 1238207 (+12) (P: 29.86%) (Q:  0.07113) (D:  0.917) (U: 0.00400) (Q+U:  0.07513) (V:  0.4410) 
1201 11:54:19.555215 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp -12800 hashfull 1 nps 71892 tbhits 115703 multipv 1 pv g4h4 e5d5 h4g4 d5e6 g4
g5 e6f7 g5h6 f7f6 h3h4 f6f5 g2g3 c7a6 h6g7 a6c7 g7f7 c7a6 f7e7 f5g4 e7f6 g4g3
1201 11:54:19.555291 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp 18 hashfull 1 nps 71892 tbhits 115703 multipv 2 pv d5d6 e5d6 g4h4 c7e6 h4g4 d
6c5 g4f3 c5b5 f3e4 b5a5
1201 11:54:19.555317 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp 15 hashfull 1 nps 71892 tbhits 115703 multipv 3 pv g4g5 c7d5 a5a6 d5c7 a6a7 e
5e4 g5g6 e4f4 g6h5 f4g3 h5g5 c7a8 g5f5 a8c7 f5e5 g3g2
1201 11:54:19.555327 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp 5 hashfull 1 nps 71892 tbhits 115703 multipv 4 pv g2g3 h4g3 g4g3 e5d5
1201 11:54:19.555340 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp 2 hashfull 1 nps 71892 tbhits 115703 multipv 5 pv g4f3 e5d5 f3f4 c7e6 f4g4 d5
c6 g4h4 c6b5 h4g4 b5a5
1201 11:54:19.555349 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp -39 hashfull 1 nps 71892 tbhits 115703 multipv 6 pv a5a6 c7a6 g4g5 e5e4 g5g4 
a6c5 g4g5 c5d7 g5g6 e4f4 d5d6 f4g3 g6g5

jp
Posts: 839
Joined: Mon Apr 23, 2018 5:54 am

Re: The “Kryptonite” position

Post by jp » Mon Dec 02, 2019 7:33 am

zullil wrote:
Sun Dec 01, 2019 5:02 pm
Here's the portion of Lc0's log file before and after it realizes the Kxh4 loses (at about 2.25 M nodes and 30 s). This is J13B.3-200.

1201 11:54:14.551926 140330957842176 ../../src/chess/uciloop.cc:218] << info string g4h4 (858 ) N: 1238207 (+12) (P: 29.86%) (Q: 0.07113) (D: 0.917) (U: 0.00400) (Q+U: 0.07513) (V: 0.4410)
1201 11:54:19.555215 140330966234880 ../../src/chess/uciloop.cc:218] << info depth 12 seldepth 30 time 31415 nodes 2258517 score cp -12800 hashfull 1 nps 71892 tbhits 115703 multipv 1 pv g4h4 e5d5 h4g4 d5e6 g4
g5 e6f7 g5h6 f7f6 h3h4 f6f5 g2g3 c7a6 h6g7 a6c7 g7f7 c7a6 f7e7 f5g4 e7f6 g4g3
I see, so it's stuck with the reply Kxd4? at that point and doesn't see the mate in 6.

Post Reply