Stockfish NNUE SV Tests

[mehmet123]

Test Of 20200814-1035 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1035 : 2456 18 17 540 65.6 % 2344 61.5 %
2 Stockfish 310720 x64 bmi2 : 2344 17 18 540 34.4 % 2456 61.5 %

Individual statistics:

1 Stockfish NNUE SV 1035 : 2456 540 (+188,=332,- 20), 65.6 %

Stockfish 310720 x64 bmi2 : 540 (+188,=332,- 20), 65.6 %

2 Stockfish 310720 x64 bmi2 : 2344 540 (+ 20,=332,-188), 34.4 %

Stockfish NNUE SV 1035 : 540 (+ 20,=332,-188), 34.4 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2_Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/wfavgmzud ... 6.pgn/file

For now SV 20200814-1035 is the latest SV net. It's performance is very good ( +112 elo) but not enough to break the record (+128 elo).

[mehmet123]

Test Of 20200814-1035 Net (Fischer Random Chess Match)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1035 : 2445 22 22 500 62.7 % 2355 48.6 %
2 Stockfish 140820 x64 bmi2 : 2355 22 22 500 37.3 % 2445 48.6 %

Individual statistics:

1 Stockfish NNUE SV 1035 : 2445 500 (+192,=243,- 65), 62.7 %

Stockfish 140820 x64 bmi2 : 500 (+192,=243,- 65), 62.7 %

2 Stockfish 140820 x64 bmi2 : 2355 500 (+ 65,=243,-192), 37.3 %

Stockfish NNUE SV 1035 : 500 (+ 65,=243,-192), 37.3 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Chess960 Book 3 Moves, 64 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2 Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/bj7fr0305 ... 0.pgn/file

The performance of Stockfish NNUE SV 1035 is + 90 elo against Stockfish 140820 x64 bmi2.
The performance of Stockfish NNUE is good at Fischer Random Chess at this time control (30 sec + 0.5 sec ) but it's performance isn't as good as at Classic Chess.

[mehmet123]

Test of 20200814-1035 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1035 : 2479 21 20 500 71.4 % 2321 51.6 %
2 Stockfish 140820 x64 bmi2 : 2321 20 21 500 28.6 % 2479 51.6 %

Individual statistics:

1 Stockfish NNUE SV 1035 : 2479 500 (+228,=258,- 14), 71.4 %

Stockfish 140820 x64 bmi2 : 500 (+228,=258,- 14), 71.4 %

2 Stockfish 140820 x64 bmi2 : 2321 500 (+ 14,=258,-228), 28.6 %

Stockfish NNUE SV 1035 : 500 (+ 14,=258,-228), 28.6 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2 Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/2vwckiwe9 ... 1.pgn/file

Incredible record at this time control (30 sec + 0.5 sec)
The performance of Stockfish NNUE SV 1035 is +158 elo against latest Stockfish dev.

[mehmet123]

Test of 20200814-1035 Net

Program Elo + - Games Score Av.Op. Draws

1 Stockfish NNUE SV 1035 : 2408 7 7 3000 52.4 % 2392 64.4 %
2 Stockfish NNUE SV 2257 : 2392 7 7 3000 47.6 % 2408 64.4 %

Individual statistics:

1 Stockfish NNUE SV 1035 : 2408 3000 (+606,=1932,-462), 52.4 %

Stockfish NNUE SV 2257 : 3000 (+606,=1932,-462), 52.4 %

2 Stockfish NNUE SV 2257 : 2392 3000 (+462,=1932,-606), 47.6 %

Stockfish NNUE SV 1035 : 3000 (+462,=1932,-606), 47.6 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 100 kn/ move, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Compilation: Stockfish NNUE 120820 x64 BMI2 Haswell mingw 10 (ChessMan compile)
http://www.mediafire.com/file/8ylrns7xvf5ftfj/e77.pgn

Stockfish NNUE SV 1035 beat Stockfish NNUE SV 2257 (Plays with official Stockfish NNUE net) without much difficulty at 100 kn/move match.

[mehmet123]

Test of Cfish NNUE SV 1035

Program Elo + - Games Score Av.Op. Draws

1 Cfish NNUE SV 1035 : 2465 17 17 700 67.8 % 2335 54.1 %
2 Stockfish 140820 x64 bmi2 : 2335 17 17 700 32.2 % 2465 54.1 %

Individual statistics:

1 Cfish NNUE SV 1035 : 2465 700 (+285,=379,- 36), 67.8 %

Stockfish 140820 x64 bmi2 : 700 (+285,=379,- 36), 67.8 %

2 Stockfish 140820 x64 bmi2 : 2335 700 (+ 36,=379,-285), 32.2 %

Cfish NNUE SV 1035 : 700 (+ 36,=379,-285), 32.2 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Cfish NNUE 170820 x64 ELTO BMI2 mingw10 (ChessMan Compile/Member of The Outskirts Chess Forum)
http://www.mediafire.com/file/c94fdggyh ... 0.pgn/file

Amazing performance of Cfish NNUE SV 1035.
It's a record (+130 elo) at this time control (1 min + 0.5 sec). The previous record was belonged to SF NNUE SV 1817 (+118 elo)

Thanks to Stockfish Team, Ronald de Man, Hisayori Noda, Henk Drost, Sergio Vieri and ChessMan

[Jouni]

1035 is now the latest available net from 14.8. End of project?

[mehmet123]

1035 is now the latest available net from 14.8. End of project?

Sergio Vieri is training a net from scratch in parallel with current reinforcement learning.

[mehmet123]

Test of Cfish NNUE SV 1035

Program Elo + - Games Score Av.Op. Draws

1 Cfish NNUE SV 1035 : 2453 17 17 550 64.7 % 2347 62.2 %
2 Stockfish 140820 x64 bmi2 : 2347 17 17 550 35.3 % 2453 62.2 %

Individual statistics:

1 Cfish NNUE SV 1035 : 2453 550 (+185,=342,- 23), 64.7 %

Stockfish 140820 x64 bmi2 : 550 (+185,=342,- 23), 64.7 %

2 Stockfish 140820 x64 bmi2 : 2347 550 (+ 23,=342,-185), 35.3 %

Cfish NNUE SV 1035 : 550 (+ 23,=342,-185), 35.3 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 2 min + 0.5 sec TC, Balsa 5 Move Opening Book, 256 Mb Hash, Ponder Off
Compilation: Cfish NNUE 170820 x64 ELTO BMI2 mingw10 (ChessMan compile)
http://www.mediafire.com/file/6k72pesb4 ... 1.pgn/file

Another great performance of Cfish NNUE SV 1035.
It's a record (+106 elo) at this time control (2 min + 0.5 sec). The previous record was belonged to Stockfish NNUE SV 1950 (+100 elo)

[mehmet123]

Test of Cfish NNUE SV 1035

Program Elo + - Games Score Av.Op. Draws

1 Cfish NNUE SV 1035 : 2470 18 18 700 69.2 % 2330 49.0 %
2 Stockfish 140820 x64 bmi2 : 2330 18 18 700 30.8 % 2470 49.0 %

Individual statistics:

1 Cfish NNUE SV 1035: 2470 700 (+313,=343,- 44), 69.2 %

Stockfish 140820 x64 bmi2 : 700 (+313,=343,- 44), 69.2 %

2 Stockfish 140820 x64 bmi2 : 2330 700 (+ 44,=343,-313), 30.8 %

Cfish NNUE SV 1035: 700 (+ 44,=343,-313), 30.8 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Compilation: Cfish NNUE 170820 x64 ELTO BMI2 mingw10 (ChessMan compile)
http://www.mediafire.com/file/lx8dw2pks ... 2.pgn/file

Another great performance of ( + 140 elo) Cfish NNUE SV 1035 at this time control (30 sec + 0.5 sec)

[mehmet123]

Cfish NNUE SV 1035 vs. Stockfish 140820 x64 bmi2:

+106 elo at 2 min + 0.5 sec
+130 elo at 1 min + 0.5 sec
+140 elo at 30 sec + 0.5 sec

This performance shows only one thing Cfish NNUE SV is the world's most powerful chess engine.