Stockfish NNUE SV Tests

[Vinvin]

Default Net vs. SV 1520 Net:

Program Elo + - Games Score Av.Op. Draws

1 Corchess Default(eba324f53044) : 2405 7 7 2200 51.5 % 2395 76.9 %
2 Corchess SV 20200914-1520 : 2395 7 7 2200 48.5 % 2405 76.9 %

Thanks !
Vincent

[mehmet123]

Raubfish vs. Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 281020 x64 bmi2 : 2417 11 11 1000 54.8 % 2383 73.2 %
2 Raubfisch X43d nn sl bmi2 : 2383 11 11 1000 45.2 % 2417 73.2 %


Individual statistics:

1 Stockfish 281020 x64 bmi2 : 2417 1000 (+182,=732,- 86), 54.8 %

Raubfisch X43d nn sl bmi2 : 1000 (+182,=732,- 86), 54.8 %

2 Raubfisch X43d nn sl bmi2 : 2383 1000 (+ 86,=732,-182), 45.2 %

Stockfish 281020 x64 bmi2 : 1000 (+ 86,=732,-182), 45.2 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Both engines played with default net (nn-2eb2e0707c2b)
http://www.mediafire.com/file/eerw7iqr9 ... 5.pgn/file

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 291020 x64 bmi2 : 2406 9 9 1000 51.6 % 2394 81.2 %
2 Stockfish 281020 x64 bmi2 : 2394 9 9 1000 48.4 % 2406 81.2 %

Individual statistics:

1 Cfish 291020 x64 bmi2 : 2406 1000 (+110,=812,- 78), 51.6 %

Stockfish 281020 x64 bmi2 : 1000 (+110,=812,- 78), 51.6 %

2 Stockfish 281020 x64 bmi2 : 2394 1000 (+ 78,=812,-110), 48.4 %

Cfish 291020 x64 bmi2 : 1000 (+ 78,=812,-110), 48.4 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish compile: Cfish 291020 x64 E BMI2 mingw10 (Chessman compile)// Default net (nn-2eb2e0707c2b)
http://www.mediafire.com/file/daazzybpl ... 1.pgn/file

[mehmet123]

Cfish vs Stockfish (Fischer Random Chess):

Program Elo + - Games Score Av.Op. Draws

1 Cfish 291020 x64 bmi2 : 2410 10 10 1000 52.8 % 2390 78.7 %
2 Stockfish 281020 x64 bmi2 : 2390 10 10 1000 47.2 % 2410 78.7 %

Individual statistics:

1 Cfish 291020 x64 bmi2 : 2410 1000 (+134,=787,- 79), 52.8 %

Stockfish 281020 x64 bmi2 : 1000 (+134,=787,- 79), 52.8 %

2 Stockfish 281020 x64 bmi2 : 2390 1000 (+ 79,=787,-134), 47.2 %

Cfish 291020 x64 bmi2 : 1000 (+ 79,=787,-134), 47.2 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish compile: Cfish 291020 x64 E BMI2 mingw10 (Chessman compile)// Default net (nn-2eb2e0707c2b)
http://www.mediafire.com/file/zwv5hdn9r ... 5.pgn/file

This is one of the best score of Cfish against Stockfish (+20 elo) in my tests at Fischer Random Chess.

[mehmet123]

Default Net vs. Night Nurse 0.3 Net:

Program Elo + - Games Score Av.Op. Draws

1 Corchess 1.3 311020 Default : 2438 17 16 601 60.8 % 2362 63.4 %
2 Corchess 1.3 311020 NN : 2362 16 17 601 39.2 % 2438 63.4 %

Individual statistics:

1 Corchess 1.3 311020 Default: 2438 601 (+175,=381,- 45), 60.8 %

Corchess 1.3 311020 NN : 601 (+175,=381,- 45), 60.8 %

2 Corchess 1.3 311020 NN : 2362 601 (+ 45,=381,-175), 39.2 %

Corchess 1.3 311020 Default : 601 (+ 45,=381,-175), 39.2 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Default Net (nn-cb26f10b1fd9)
http://www.mediafire.com/file/8woyzwjh5 ... 8.pgn/file

[mehmet123]

Default Net vs. Night Nurse 0.3 Net:

Program Elo + - Games Score Av.Op. Draws

1 Corchess 1.3 311020 Default : 2436 15 14 600 60.2 % 2364 71.5 %
2 Corchess 1.3 311020 NN : 2364 14 15 600 39.8 % 2436 71.5 %

Individual statistics:

1 Corchess 1.3 311020 Default: 2436 600 (+147,=429,- 24), 60.2 %

Corchess 1.3 311020 NN : 600 (+147,=429,- 24), 60.2 %

2 Corchess 1.3 311020 NN : 2364 600 (+ 24,=429,-147), 39.8 %

Corchess 1.3 311020 Default : 600 (+ 24,=429,-147), 39.8 %

Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Default Net (nn-cb26f10b1fd9)
http://www.mediafire.com/file/fwyq7c67j ... 9.pgn/file

At 30 sec + 0.5 sec TC match the performance of Corchess Night Nurse 0.3 is a little better according to 10 sec + 0.2 match.

[mehmet123]

Cfish vs Stockfish Match:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 081120 x64 bmi2 : 2403 7 6 1000 50.7 % 2397 90.9 %
2 Stockfish 081120 x64 bmi2 : 2397 6 7 1000 49.2 % 2403 90.9 %

Individual statistics:

1 Cfish 081120 x64 bmi2 : 2403 1000 (+ 53,=909,- 38), 50.8 %

Stockfish 081120 x64 bmi2 : 1000 (+ 53,=909,- 38), 50.7 %

2 Stockfish 081120 x64 bmi2 : 2397 1000 (+ 38,=909,- 53), 49.2 %

Cfish 081120 x64 bmi2 : 1000 (+ 38,=909,- 53), 49.2 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Compilation1: Cfish 081120 x64 E BMI2 mingw10(ChessMan compile) // Default Net
Compilation2: Stockfish 081120 x64 bmi2 (Official compile)// Default Net
http://www.mediafire.com/file/kz23fyb7t ... 5.pgn/file

[mehmet123]

Dragon by Komodo vs. Stockfish 12 NNUE:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 12 x64 bmi2 : 2427 16 16 600 57.6 % 2373 66.8 %
2 Dragon x64 avx2 : 2373 16 16 600 42.4 % 2427 66.8 %


Individual statistics:

1 Stockfish 12 x64 bmi2 : 2427 600 (+145,=401,- 54), 57.6 %

Dragon x64 avx2 : 600 (+145,=401,- 54), 57.6 %

2 Dragon x64 avx2 : 2373 600 (+ 54,=401,-145), 42.4 %

Stockfish 12 x64 bmi2 : 600 (+ 54,=401,-145), 42.4 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
http://www.mediafire.com/file/iyouisncx ... 7.pgn/file

[mehmet123]

Dragon by Komodo vs. Stockfish 12 NNUE:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 12 x64 bmi2 : 2432 14 14 600 59.0 % 2368 72.3 %
2 Dragon x64 avx2 : 2368 14 14 600 41.0 % 2432 72.3 %

Individual statistics:

1 Stockfish 12 x64 bmi2 : 2432 600 (+137,=434,- 29), 59.0 %

Dragon x64 avx2 : 600 (+137,=434,- 29), 59.0 %

2 Dragon x64 avx2 : 2368 600 (+ 29,=434,-137), 41.0 %

Stockfish 12 x64 bmi2 : 600 (+ 29,=434,-137), 41.0 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
http://www.mediafire.com/file/e4le0ufbt ... 8.pgn/file

[mehmet123]

Dragon by Komodo vs. Stockfish 12 NNUE:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 12 x64 bmi2 : 2423 15 15 600 56.5 % 2377 69.0 %
2 Dragon x64 avx2 : 2377 15 15 600 43.5 % 2423 69.0 %


Individual statistics:

1 Stockfish 12 x64 bmi2 : 2423 600 (+132,=414,- 54), 56.5 %

Dragon x64 avx2 : 600 (+132,=414,- 54), 56.5 %

2 Dragon x64 avx2 : 2377 600 (+ 54,=414,-132), 43.5 %

Stockfish 12 x64 bmi2 : 600 (+ 54,=414,-132), 43.5 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
Contempt :Dragon by Komodo:0, Stockfish 12: Default (24)
http://www.mediafire.com/file/ilwvj8e5n ... 9.pgn/file

The score of Dragon against Stockfish 12 is 8 elo better with contempt 0 according to with default contempt (8)