Lizard-NNUE Experiment NOT bad with NNUE Net Evaluation.........

[Daniel Shawul]

Oiy. What a colossal f*ck up. Before the final network save, the nnue executable loaded the nn.bin from eval and saved it in evalsave/final. The previous checkpoint was the network trained on Komodo data. While strong, it’s nowhere near Komodo or sf. The network in the eval/nn.bin? gk20200720, a very strong net trained on stockfish data. It’s byte for byte identical.

My apologies for the confusion. It was an unintentional mistake.

Lol

[dkappe]

So, a little more down to earth at 1+1.

Score of LizardFish1 vs Komodo13: 12 - 46 - 42 [0.330] 100
Elo difference: -123.02 +/- 52.94

[Tony P.]

Considering that all NNUE code is open source, how are you planning integrating open source code into commercial product?
Will you make Komodo search code also available as requested per GPL license?

There are ways to avoid the infection by GPL:

1. base the proprietary code on the PDF paper only, not on the SF code;
2. clean-room the SF code;
3. (as for training) communicate with SF (modified to be verbose) through a pipe in idiomatic UCI and claim that mere aggregation took place;
4. port an MIT-licensed Rust implementation of NNUE for Shogi

[dkappe]

OK, not quite done training LizardFish 2 with 150m positions, 600 iterations, bit it’s getting better. 8 threads.

[pgn]

[Event "Blitz 2min+2sec"]
[Site "?"]
[Date "2020.07.19"]
[Round "4"]
[White "Stockfish 10 64 BMI2"]
[Black "SF NNUE LizardFish2-600m"]
[Result "0-1"]
[ECO "B25"]
[TimeControl "120+2"]
[Annotator "0.37;0.00"]


{[%evp 0,180,26,18,12,-12,42,5,15,13,12,-8,24,24,23,4,22,-29,0,-19,14,18,24,14, 11,18,22,13,-11,-11,9,12,0,12,40,35,35,5,35,29,44,51,62,7,7,-3,3,49,11,-17,42, -28,2,12,12,12,55,30,36,23,34,-14,20,-11,31,5,-6,-25,-19,-19,-18,1,18,7,15,6, 12,4,6,6,0,4,14,-2,-8,-20,-20,-39,-48,-39,-48,-41,-42,-93,-35,-41,-41,-41,-41, -41,-41,-41,-41,-41,2,-45,-41,-41,-41,-41,-11,-3,-13,-32,-29,-21,-41,-138,0,0, 0,-11,0,0,0,-89,-89,-78,-80,-75,-57,-68,-68,-91,-75,-86,-86,-92,-92,-92,-84, -157,-84,-85,-85,-85,-90,-89,-89,-89,-84,-149,-97,-123,-129,-129,-121,-121, -132,-132,-132,-132,-153,-158,-167,-162,-162,-128,-162,-178,-178,-178,-178, -188,-188,-188,-188,-166,-166,-166,-166,-166,-134] Intel(R) Core(TM) i7-6700HQ CPU @ 2.60GHz 2592 MHz W=25.5 plies; 5,391kN/s; 2,869,467 TBAs B=24.4 plies; 2, 761kN/s; 1,763,057 TBAs}
1. Nf3 Nf6 2. g3 g6 3. Bg2 Bg7 4. O-O O-O 5. d3 d6 6. e4 {Both last book move}
6... c5 {[%eval 0,22] [%emt 0:00:06]} 7. Nc3 {[%eval 37,21] [%emt 0:00:08] (e5)}
7... Nc6 {[%eval 0,21] [%emt 0:00:03]} 8. Nd5
{[%eval 28,21] [%emt 0:00:05] (Re1)} 8... Nxd5 {[%eval -9,22] [%emt 0:00:07]}
9. exd5 {[%eval 26, 22] [%emt 0:00:02]} 9... Nd4 {[%eval -7,22] [%emt 0:00:06]}
10. Nxd4 {[%eval 20,22] [%emt 0:00:11] (c3)} 10... cxd4
{[%eval -6,20] [%emt 0:00:02]} 11. Rb1 {[%eval 18,23] [%emt 0:00:04] (Bf4)}
11... Re8 {[%eval -21,23] [%emt 0:00:08] (Bd7)} 12. Bd2
{[%eval 22,21] [%emt 0:00:02]} 12... Bf5 {[%eval -15,22] [%emt 0:00:03]} 13. g4
{[%eval 22,23] [%emt 0:00:02]} 13... Bd7 {[%eval -17,23] [%emt 0:00:03]} 14. f4
{[%eval 26,24] [%emt 0:00:02] (h3)} 14... f5
{[%eval -19,23] [%emt 0:00:07] (Qc8)} 15. g5 {[%eval 32,20] [%emt 0:00:02]}
15... Rc8 {[%eval -15,22] [%emt 0:00:07]} 16. Re1 {[%eval 25,24] [%emt 0:00:09]}
16... h6 {[%eval -13,23] [%emt 0:00:08]} 17. gxh6
{[%eval 10,22] [%emt 0:00:02] (h4)} 17... Bxh6
{[%eval -24,22] [%emt 0:00:06] (Bf6)} 18. h4 {[%eval 47,22] [%emt 0:00:07]}
18... Kf7 {[%eval -31,23] [%emt 0:00:06] (Bg7)} 19. h5
{[%eval 38,23] [%emt 0:00:15]} 19... Bg7 {[%eval -25,22] [%emt 0:00:06] (Rg8)}
20. c4 {[%eval 36,22] [%emt 0:00:03]} 20... dxc3
{[%eval -24,23] [%emt 0:00:08] (Bf6)} 21. Bxc3 {[%eval 19,23] [%emt 0:00:05]}
21... Bf6 {[%eval -12,22] [%emt 0:00:07] (Rh8)} 22. hxg6+
{[%eval 27,21] [%emt 0:00:04] (Bxf6)} 22... Kxg6
{[%eval -26,21] [%emt 0:00:03]} 23. Qf3 {[%eval 0,24] [%emt 0:00:04] (Qd2)}
23... Rh8 {[%eval -17,24] [%emt 0:00:11]} 24. Kf1
{[%eval 0,27] [%emt 0:00:04] (Qg3+)} 24... Rh4 {[%eval -17, 24] [%emt 0:00:03]}
25. Rbc1 {[%eval 0,27] [%emt 0:00:03] (Bxf6)} 25... Bxc3
{[%eval -18,25] [%emt 0:00:10] (Qb6)} 26. Rxc3 {[%eval 0,26] [%emt 0:00:02]}
26... Rxc3 {[%eval -21,25] [%emt 0:00:02] (Qb6)} 27. bxc3
{[%eval 0,27] [%emt 0:00: 03]} 27... Kf7 {[%eval -33,25] [%emt 0:00:02] (Qf8)}
28. Qe3 {[%eval -1,24] [%emt 0: 00:03]} 28... Qf8
{[%eval -23,24] [%emt 0:00:03] (b6)} 29. Re2 {[%eval -13,26] [%emt 0:00:06]}
29... Ke8 {[%eval -31,27] [%emt 0:00:07] (b6)} 30. Ke1
{[%eval -29,26] [%emt 0:00:07] (Qxa7)} 30... b6 {[%eval -54,22] [%emt 0:00:02]}
31. Kd2 {[%eval -28, 25] [%emt 0:00:04]} 31... Kd8
{[%eval -49,24] [%emt 0:00:03]} 32. Kc2 {[%eval -25,26] [%emt 0:00:03] (Bf3)}
32... Qg7 {[%eval -35,23] [%emt 0:00:04]} 33. Bf1
{[%eval -26, 29] [%emt 0:00:17] (Kb3)} 33... Ba4+
{[%eval -28,24] [%emt 0:00:07] (Rh1)} 34. Kb2 {[%eval -18,23] [%emt 0:00:02]}
34... Qh7 {[%eval -18,25] [%emt 0:00:05]} 35. c4
{[%eval -37,25] [%emt 0:00:04] (Bg2)} 35... Rh1
{[%eval -50,25] [%emt 0:00:07] (Rh2)} 36. Bg2
{[%eval -31,25] [%emt 0:00:02] (Qf2)} 36... Rh2 {[%eval -34,28] [%emt 0:00: 03]}
37. d4 {[%eval -32,28] [%emt 0:00:03]} 37... Bd1 {[%eval -53,25] [%emt 0:00:02]}
38. Rd2 {[%eval -24,27] [%emt 0:00:03]} 38... Qg7
{[%eval -57,26] [%emt 0:00:04]} 39. Bf1 {[%eval -70,30] [%emt 0:00:13] (Qg1)}
39... Rxd2+ {[%eval -33,29] [%emt 0:00:05]} 40. Qxd2
{[%eval -65,28] [%emt 0:00:02]} 40... Bf3 {[%eval -46,24] [%emt 0:00:02]} 41.
Qe3 {[%eval -62,29] [%emt 0:00:02] (Qf2)} 41... Be4
{[%eval -37,26] [%emt 0:00: 04]} 42. Kc3 {[%eval -76,28] [%emt 0:00:10] (Qf2)}
42... Qg4 {[%eval -58,26] [%emt 0: 00:02] (Qh6)} 43. Kd2
{[%eval -76,28] [%emt 0:00:01]} 43... Qh4 {[%eval -42,26] [%emt 0:00:03]} 44.
Bh3 {[%eval -62,29] [%emt 0:00:04]} 44... Qh7
{[%eval -37,29] [%emt 0:00:04] (Qh8)} 45. a4
{[%eval -79,30] [%emt 0:00:12] (Kc3)} 45... Qg8
{[%eval -42,30] [%emt 0:00:10] (Qh8)} 46. Bf1
{[%eval -70,25] [%emt 0:00:02] (Kd1)} 46... Qg7
{[%eval -50,26] [%emt 0:00:03] (Qh8)} 47. Bh3 {[%eval -94,28] [%emt 0:00:06]}
47... Qh8 {[%eval -42,28] [%emt 0:00:02] (Qg8)} 48. Qc3
{[%eval -99,27] [%emt 0:00:02] (Kc1)} 48... Qg7
{[%eval -36,24] [%emt 0:00:01] (Qg8)} 49. Qe3 {[%eval -107,28] [%emt 0:00:04]}
49... Qh8 {[%eval -33,25] [%emt 0:00:01]} 50. Qc3
{[%eval -109,30] [%emt 0:00:03]} 50... Qh4 {[%eval -42,27] [%emt 0:00:04] (Qg8)}
51. Qe3 {[%eval -100,28] [%emt 0:00:01]} 51... Kc7
{[%eval -35,30] [%emt 0:00:02] (a5)} 52. Kd1
{[%eval -100,29] [%emt 0:00:03] (Kc1)} 52... Kd8
{[%eval -35,29] [%emt 0:00: 01] (a5)} 53. Kd2 {[%eval -108,30] [%emt 0:00:06]}
53... Kc7 {[%eval -33,30] [%emt 0: 00:01] (a5)} 54. Kc3
{[%eval -98,25] [%emt 0:00:01] (Kc1)} 54... Qh7
{[%eval -38,27] [%emt 0:00:02] (a5)} 55. Qg3
{[%eval -103,25] [%emt 0:00:01] (Kd2)} 55... Qh5 {[%eval -33,28] [%emt 0:00:01]}
56. Kd2 {[%eval -98,27] [%emt 0:00:02]} 56... Qh8
{[%eval -32,29] [%emt 0:00:02] (Kb7)} 57. Kc3
{[%eval -109,27] [%emt 0:00:02] (Qe3)} 57... Qh5
{[%eval -32,29] [%emt 0:00:03]} 58. Bg2 {[%eval -80,27] [%emt 0:00: 04] (Kd2)}
58... Bxg2 {[%eval -49,21] [%emt 0:00:02]} 59. Qxg2
{[%eval -110,29] [%emt 0:00:02]} 59... Qg4 {[%eval -48,25] [%emt 0:00:02]} 60.
Qd2 {[%eval -108,29] [%emt 0:00:05]} 60... Qf3+ {[%eval -46,25] [%emt 0:00:02]}
61. Kb2 {[%eval -99,25] [%emt 0:00:00]} 61... a5
{[%eval -38,27] [%emt 0:00:03]} 62. Ka2 {[%eval -99,24] [%emt 0:00:01]} 62...
Qf1 {[%eval -72,28] [%emt 0:00:05] (Kc8)} 63. Kb3
{[%eval -104, 28] [%emt 0:00:01]} 63... Qb1+
{[%eval -31,28] [%emt 0:00:01] (Qf3+)} 64. Ka3
{[%eval -104,30] [%emt 0:00:02] (Qb2)} 64... Kb7
{[%eval -73,22] [%emt 0:00:01] (Qe4)} 65. Qc3 {[%eval -167,26] [%emt 0:00:05]}
65... Qf1 {[%eval -79,21] [%emt 0:00:01]} 66. Kb3
{[%eval -154,26] [%emt 0:00:02]} 66... Qxf4 {[%eval -130,24] [%emt 0:00:03]} 67.
Qe1 {[%eval -198,27] [%emt 0:00:03]} 67... Qg5 {[%eval -137,22] [%emt 0:00:01]}
68. c5 {[%eval -201,25] [%emt 0:00:01]} 68... dxc5
{[%eval -191,23] [%emt 0:00:02]} 69. dxc5 {[%eval -220,27] [%emt 0:00:02]} 69...
bxc5 {[%eval -180,26] [%emt 0:00:05]} 70. Qe6 {[%eval -256,27] [%emt 0:00:03]}
70... Qg3+ {[%eval -201,22] [%emt 0:00:01]} 71. Kc2
{[%eval -254,27] [%emt 0:00:01]} 71... Qh2+ {[%eval -213,24] [%emt 0:00:01]} 72.
Kd3 {[%eval -277,24] [%emt 0:00:01]} 72... Qd6 {[%eval -251,25] [%emt 0:00:02]}
73. Qxf5 {[%eval -205,24] [%emt 0:00:01]} 73... c4+
{[%eval -279,22] [%emt 0:00:01]} 74. Ke4 {[%eval -295,27] [%emt 0:00:03] (Kc2)}
74... Kc7 {[%eval -322,23] [%emt 0:00: 01]} 75. Qh3
{[%eval -324,26] [%emt 0:00:03] (Qf3)} 75... Qb4
{[%eval -336,24] [%emt 0:00:02]} 76. Qh5 {[%eval -280,24] [%emt 0:00:02] (Qg3+)}
76... Qb1+ {[%eval -423,21] [%emt 0:00:03] (Qd6)} 77. Kd4
{[%eval -262,24] [%emt 0:00:01]} 77... Qd3+
{[%eval -533,26] [%emt 0:00:10] (Qb2+)} 78. Kc5 {[%eval -200,24] [%emt 0:00:01]}
78... Qa3+ {[%eval -691,20] [%emt 0:00:01]} 79. Kd4
{[%eval -368,28] [%emt 0:00:04]} 79... c3
{[%eval -842,25] [%emt 0:00:02] (Qa1+)} 80. Qe8 {[%eval -304,26] [%emt 0:00:01]}
80... Qb4+ {[%eval -877,20] [%emt 0:00:00]} 81. Kd3
{[%eval -513,25] [%emt 0:00:03]} 81... Qc5 {[%eval -862,22] [%emt 0:00:01]} 82.
Kc2 {[%eval -719,24] [%emt 0:00:02]} 82... Kd6 {[%eval -877,22] [%emt 0:00:01]}
83. Qg8 {[%eval -386,21] [%emt 0:00:01]} 83... Ke5
{[%eval -672,25] [%emt 0:00:01]} 84. Qg5+
{[%eval -271,24] [%emt 0:00:02] (Qe6+)} 84... Ke4
{[%eval -951,23] [%emt 0:00:03]} 85. Qg2+ {[%eval -1234,23] [%emt 0:00:02]}
85... Kd4 {[%eval -1196,21] [%emt 0:00:02]} 86. Qg8
{[%eval -1272,25] [%emt 0:00:03] (Qg5)} 86... Qb4
{[%eval -1287,22] [%emt 0:00:01]} 87. Qh8+ {[%eval -559,21] [%emt 0:00:01]}
87... Kc4 {[%eval -1420,26] [%emt 0:00:04]} 88. Qc8+
{[%eval -1326,20] [%emt 0:00:02]} 88... Kd4
{[%eval -1660,23] [%emt 0:00:04] (Qc5)} 89. Qh8+
{[%eval -1448,22] [%emt 0:00:02]} 89... Kc4 {[%eval -1602,22] [%emt 0:00:02]}
90. Qc8+ {[%eval -1407,22] [%emt 0:00:01]} 90... Qc5
{[%eval -1521,22] [%emt 0:00: 01] (Kxd5)}
0-1
[/pgn]