Stockfish NNUE SV Tests

[mehmet123]

Test of 20200808-0817 Net

Program Elo + - Games Score Av.Op. Draws

1 SF NNUE SV 1817 : 2459 15 14 800 66.3 % 23.41 60.9 %
2 Stockfish 310720 x64 bmi2 : 2341 14 15 800 33.7 % 2459 60.9 %

Individual statistics:

1 SF NNUE SV 1817 : 2459 800 (+287,=487,- 26), 66.3 %

Stockfish 310720 x64 bmi2 : 800 (+287,=487,- 26), 66.3 %

2 Stockfish 310720 x64 bmi2 : 2341 800 (+ 26,=487,-287), 33.7 %

SF NNUE SV 1817 : 800 (+ 26,=487,-287), 33.7 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10 (From "ChessMan"/ Member of The Outskirts Chess Forum )
http://www.mediafire.com/file/796tee669 ... 5.pgn/file

Great record (+118 elo) at this time control (1 min + 0.5 sec).
The performance is +106 elo with old compilation (Stockfish NNUE 250720 x64 Haswell BMI2 256 mingw10)
The performance is +118 elo with new compilation (Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10)
A new record has been broken with the help of new Stockfish patches and the help of new great compilation of "ChessMan".
ChessMan compilation (Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10) is % 7-8 faster than official Stockfish compilation (Stockfish 20080808 x64 bmi2) with NNUE in my system.

[marsell]

sorry, but where can i get Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10

[mehmet123]

sorry, but where can i get Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10

You must register to The Outskirts Chess Forum.
http://outskirts.altervista.org/forum/index.php

After registration to this forum you will see the download links at Stockfish-NNUE topic.
(The Outskirts Chess Forum/The Chess Outskirts/Chess Engines/Stockfish-NNUE)

I don't think it would be right to share links here without the developer's permission

[marsell]

thanks for the info

[mehmet123]

Test of SV 20200803-2108 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 2108 : 2458 19 18 500 66.2 % 23.42 59.2 %
2 Stockfish 310720 x64 bmi2 :b]2342[/b] 18 19 500 33.8 % 2458 59.2 %

Individual statistics:

1 Stockfish NNUE SV 2108 : 2458 500 (+183,=296,- 21), 66.2 %

Stockfish 310720 x64 bmi2 : 500 (+183,=296,- 21), 66.2 %

2 Stockfish 310720 x64 bmi2 : 2342 500 (+ 21,=296,-183), 33.8 %

Stockfish NNUE SV 2108 : 500 (+ 21,=296,-183), 33.8 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10
http://www.mediafire.com/file/6z1ddtdqc ... 0.pgn/file

Stockfish NNUE SV 2108 is the record holder of at 30 sec + 0.5 time control with +128 elo.
At 1 min + 0.5 sec test performance (+116 elo) of this chess engine was very good but it couldn' t broke the record (+118 elo) of SF NNUE SV 1817.

[mehmet123]

Test of SV 20200809-0854 Net:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 0854 : 2452 20 20 402 64.6 % 23.48 62.4 %
2 Stockfish 310720 x64 bmi2 : 2348 20 20 402 35.4 % 2452 62.4 %

Individual statistics:

1 Stockfish NNUE SV 0854 : 2452 402 (+134,=251,- 17), 64.6 %

Stockfish 310720 x64 bmi2 : 402 (+134,=251,- 17), 64.6 %

2 Stockfish 310720 x64 bmi2 : 2348 402 (+ 17,=251,-134), 35.4 %

Stockfish NNUE SV 0854 : 402 (+ 17,=251,-134), 35.4 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10
http://www.mediafire.com/file/l4epwiw5g ... 6.pgn/file

Latest SV Nets performances aren't as good as expected in my tests.

[mehmet123]

Test of 20200810-0744 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 0744 : 2455 11 11 1400 65.4 % 2345 60.9 %
2 Stockfish 310720 x64 bmi2 : 2345 11 11 1400 34.6 % 2455 60.9 %

Individual statistics:

1 Stockfish NNUE SV 0744 : 2455 1400 (+489,=853,- 58), 65.4 %

Stockfish 310720 x64 bmi2 : 1400 (+489,=853,- 58), 65.4 %

2 Stockfish 310720 x64 bmi2 : 2345 1400 (+ 58,=853,-489), 34.6 %

Stockfish NNUE SV 0744 : 1400 (+ 58,=853,-489), 34.6 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 080820 x64 BMI2 Haswell mingw 10
http://www.mediafire.com/file/1n1pnxhv1hm7uwc/b62.pgn

SV 0744 is the official Stockfish NNUE net for now. Performance of Stockfish NNUE SV 0744 is good (+110 elo) but it's not enough to break the record of SF NNUE SV 0817 (+118 elo).

[mehmet123]

Test of 20200812-2257 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 2257 : 2454 21 21 402 65.0 % 2346 59.5 %
2 Stockfish 310720 x64 bmi2 : 2346 21 21 402 35.0 % 2454 59.5 %


Individual statistics:

1 Stockfish NNUE SV 2257 : 2454 402 (+142,=239,- 21), 65.0 %

Stockfish 310720 x64 bmi2 : 402 (+142,=239,- 21), 65.0 %

2 Stockfish 310720 x64 bmi2 : 2346 402 (+ 21,=239,-142), 35.0 %

Stockfish NNUE SV 2257 : 402 (+ 21,=239,-142), 35.0 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2_Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/fwmwoiy3s ... 0.pgn/file

For now 20200812-2257 net is the official Stockfish net.
The performance of Stockfish NNUE SV 2257 is good (+ 108 elo) at this time control(1 min + 0.5 sec) but it can't not break the record (+ 118 elo)

[mehmet123]

Test of SV 20200813-1217 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1217 : 2457 19 19 500 65.8 % 2343 58.4 %
2 Stockfish 310720 x64 bmi2 : 2343 19 19 500 34.2 % 2457 58.4 %

Individual statistics:

1 Stockfish NNUE SV 1217 : 2457 500 (+183,=292,- 25), 65.8 %

Stockfish 310720 x64 bmi2 : 500 (+183,=292,- 25), 65.8 %

2 Stockfish 310720 x64 bmi2 : 2343 500 (+ 25,=292,-183), 34.2 %

Stockfish NNUE SV 1217 : 500 (+ 25,=292,-183), 34.2 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2_Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/724shdr4t ... 1.pgn/file

The performance of Stockfish NNUE SV 1217 is very good (+114 elo).

[mehmet123]

Test of 20200813-1245 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1245 : 2453 17 17 536 64.7 % 2347 63.4 %
2 Stockfish 310720 x64 bmi2 : 2347 17 17 536 35.3 % 2453 63.4 %

Individual statistics:

1 Stockfish NNUE SV 1245 : 2453 536 (+177,=340,- 19), 64.7 %

Stockfish 310720 x64 bmi2 : 536 (+177,=340,- 19), 64.7 %

2 Stockfish 310720 x64 bmi2 : 2347 536 (+ 19,=340,-177), 35.3 %

Stockfish NNUE SV 1245 : 536 (+ 19,=340,-177), 35.3 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2 Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/711odj4k9 ... 5.pgn/file