Stockfish NNUE SV Tests

[mehmet123]

Cfish vs Stockfish (Fischer Random Chess):

Program Elo + - Games Score Av.Op. Draws

1 Cfish 090521 bmi2 : 2408 11 11 1200 52.4 % 2392 68.6 %
2 Stockfish 070521 x64 bmi2 : 2392 11 11 1200 47.6 % 2408 68.6 %


Individual statistics:

1 Cfish 090521 bmi2 : 2408 1200 (+217,=823,-160), 52.4 %

Stockfish 070521 x64 bmi2 : 1200 (+217,=823,-160), 52.4 %

2 Stockfish 070521 x64 bmi2 : 2392 1200 (+160,=823,-217), 47.6 %

Cfish 090521 bmi2 : 1200 (+160,=823,-217), 47.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/vr9gzois ... 6.pgn/file

[mehmet123]

Cfish vs Sugar AI:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 090521 bmi2 : 2405 8 7 800 51.4 % 2395 90.2 %
2 SugaR AI 2.00 bmi2 : 2395 7 8 800 48.6 % 2405 90.2 %


Individual statistics:

1 Cfish 090521 bmi2 : 2405 800 (+ 50,=722,- 28), 51.4 %

SugaR AI 2.00 bmi2 : 800 (+ 50,=722,- 28), 51.4 %

2 SugaR AI 2.00 bmi2 : 2395 800 (+ 28,=722,- 50), 48.6 %

Cfish 090521 bmi2 : 800 (+ 28,=722,- 50), 48.6 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
http://www.mediafire.com/file/u0gccg0q6desrb1/r17.pgn

[mehmet123]

NN-8a08400ed089 Net vs Default Net:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089) : 2453 11 11 3000 64.9 % 2347 31.0 %
2 Stockfish 170521 x64 bmi2 (Default Net) : 2347 11 11 3000 35.1 % 2453 31.0 %


Individual statistics:

1 Stockfish 180521 x64 bmi2 : 2453 3000 (+1482,=930,-588), 64.9 %

Stockfish 170521 x64 bmi2 : 3000 (+1482,=930,-588), 64.9 %

2 Stockfish 170521 x64 bmi2 : 2347 3000 (+588,=930,-1482), 35.1 %

Stockfish 180521 x64 bmi2 : 3000 (+588,=930,-1482), 35.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/48hnbcfc ... 8.pgn/file

Stockfish with nn-8a08400ed089 net is very strong at ultra fast time controls.

[mehmet123]

NN-8a08400ed089 Net vs Default Net:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089): 2419 14 14 600 55.4 % 2381 75.2 %
2 Stockfish 170521 x64 bmi2(Default Net) : 2381 14 14 600 44.6 % 2419 75.2 %

Individual statistics:

1 Stockfish 180521 x64 bmi2 : 2419 600 (+107,=451,- 42), 55.4 %

Stockfish 170521 x64 bmi2 : 600 (+107,=451,- 42), 55.4 %

2 Stockfish 170521 x64 bmi2 : 2381 600 (+ 42,=451,-107), 44.6 %

Stockfish 180521 x64 bmi2 : 600 (+ 42,=451,-107), 44.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/tr4yhf7h ... 9.pgn/file

[mehmet123]

NN-8a08400ed089 Net vs Default Net (Fischer Random Chess):

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 180521 x64 bmi2 : 2415 12 12 800 54.4 % 2385 74.9 %
2 Stockfish 170521 x64 bmi2 : 2385 12 12 800 45.6 % 2415 74.9 %


Individual statistics:

1 Stockfish 180521 x64 bmi2 : 2415 800 (+136,=599,- 65), 54.4 %

Stockfish 170521 x64 bmi2 : 800 (+136,=599,- 65), 54.4 %

2 Stockfish 170521 x64 bmi2 : 2385 800 (+ 65,=599,-136), 45.6 %

Stockfish 180521 x64 bmi2 : 800 (+ 65,=599,-136), 45.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/2fs3fgb8 ... 0.pgn/file

Great performance of Stockfish with nn-8a08400ed089 net at FRC with these test conditions.

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 190521 x64 bmi2 : 2413 6 6 1300 53.7 % 2387 88.9 %
2 Stockfish 13 x64 bmi2 : 2387 6 6 1300 46.3 % 2413 88.9 %


Individual statistics:

1 Stockfish 190521 x64 bmi2 : 2413 1300 (+120,=1156,- 24), 53.7 %

Stockfish 13 x64 bmi2 : 1300 (+120,=1156,- 24), 53.7 %

2 Stockfish 13 x64 bmi2 : 2387 1300 (+ 24,=1156,-120), 46.3 %

Stockfish 190521 x64 bmi2 : 1300 (+ 24,=1156,-120), 46.3 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 2 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/1wki84p2 ... 1.pgn/file

Impressive score for this time control (2 min + 0.5 sec) match.

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2457 11 11 3000 65.9 % 2343 28.2 %
2 Stockfish 13 x64 bmi2 : 2343 11 11 3000 34.1 % 2457 28.2 %


Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2457 3000 (+1554,=846,-600), 65.9 %

Stockfish 13 x64 bmi2 : 3000 (+1554,=846,-600), 65.9 %

2 Stockfish 13 x64 bmi2 : 2343 3000 (+600,=846,-1554), 34.1 %

Stockfish 220521 x64 bmi2 : 3000 (+600,=846,-1554), 34.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/gc7q5yqq ... 2.pgn/file

Stockfish Dev with new net( nn-7756374aaed3) is very stronger at ultra fast time controls like Stockfish Dev with old net (nn-8a08400ed089).

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2451 14 14 1000 64.3 % 2349 57.8 %
2 Stockfish 13 x64 bmi2 : 2349 14 14 1000 35.7 % 2451 57.8 %


Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2451 1000 (+354,=578,- 68), 64.3 %

Stockfish 13 x64 bmi2 : 1000 (+354,=578,- 68), 64.3 %

2 Stockfish 13 x64 bmi2 : 2349 1000 (+ 68,=578,-354), 35.7 %

Stockfish 220521 x64 bmi2 : 1000 (+ 68,=578,-354), 35.7 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 100 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/0toiyfz1 ... 3.pgn/file

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2416 12 11 500 54.5 % 2384 85.4 %
2 Stockfish 13 x64 bmi2 : 2384 11 12 500 45.5 % 2416 85.4 %


Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2416 500 (+ 59,=427,- 14), 54.5 %

Stockfish 13 x64 bmi2 : 500 (+ 59,=427,- 14), 54.5 %

2 Stockfish 13 x64 bmi2 : 2384 500 (+ 14,=427,- 59), 45.5 %

Stockfish 220521 x64 bmi2 : 500 (+ 14,=427,- 59), 45.5 %

Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/v03slyra ... 4.pgn/file

Great score for this time control (1 min + 0.5 sec) match

[mehmet123]

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220521 x64 bmi2 : 2424 14 13 500 56.9 % 2376 80.2 %
2 Stockfish 13 x64 bmi2 : 2376 13 14 500 43.1 % 2424 80.2 %

Individual statistics:

1 Stockfish 220521 x64 bmi2 : 2424 500 (+ 84,=401,- 15), 56.9 %

Stockfish 13 x64 bmi2 : 500 (+ 84,=401,- 15), 56.9 %

2 Stockfish 13 x64 bmi2 : 2376 500 (+ 15,=401,- 84), 43.1 %

Stockfish 220521 x64 bmi2 : 500 (+ 15,=401,- 84), 43.1 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/n2ahnr81 ... 5.pgn/file

There is a record elo difference (+48 elo) between Stockfish Dev vs Stockfish 13 at this test with the help of SuperGM 4 Moves Opening Book.