Stockfish NNUE SV Tests

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Opening Book vs No Opening Book Test:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish Polyglot 13 M12.4 : 2417 13 10 300 54.8 % 2383 90.3 %
2 Stockfish Polyglot 13 Master : 2383 10 13 300 45.2 % 2417 90.3 %

Individual statistics:

1 Stockfish Polyglot 13 M12.4: 2417 300 (+ 29,=271,- 0), 54.8 %

Stockfish Polyglot 13 Master : 300 (+ 29,=271,- 0), 54.8 %

2 Stockfish Polyglot 13 Master: 2383 300 (+ 0,=271,- 29), 45.2 %

Stockfish Polyglot 13 M12.4 : 300 (+ 0,=271,- 29), 45.2 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, 64 Mb Hash, Ponder Off
Stockfish Polyglot 13 Master played without opening book.
Stockfish Polyglot 13 x64 bmi2 by Massimiliano Goi// M12.4 opening book by Mustafa Canseven
https://www.mediafire.com/file/ftls53u6 ... 7.pgn/file

In these tests, the goal isn' t to find the strongest opening books. To learn the most strongest opening books please follow Sedat Canbaz or Hurnavich / Oliprog /Skynet (Members of The Outskirts Chess Forum)
https://sites.google.com/site/computerschess/
https://outskirts.altervista.org/forum/index.php
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 150621 x64 bmi2 : 2425 9 9 900 53.6 % 2388 84.2 %
2 Stockfish 13 x64 bmi2 : 2400 9 9 900 46.4 % 2412 84.2 %

Individual statistics:

1 Stockfish 150621 x64 bmi2 : 2425 900 (+103,=758,- 39), 53.6 %

Stockfish 13 x64 bmi2 : 900 (+103,=758,- 39), 53.6 %

2 Stockfish 13 x64 bmi2 : 2400 900 (+ 39,=758,-103), 46.4 %

Stockfish 150621 x64 bmi2 : 900 (+ 39,=758,-103), 46.4 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/5nrawkn0 ... 8.pgn/file
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Dragon 2 by Komodo vs. Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 150621 x64 bmi2 : 2458 20 19 400 66.0 % 2342 64.5 %
2 Dragon 2 x64 avx2 : 2342 19 20 400 34.0 % 2458 64.5 %


Individual statistics:

1 Stockfish 150621 x64 bmi2 : 2458 400 (+135,=258,- 7), 66.0 %

Dragon 2 x64 avx2 : 400 (+135,=258,- 7), 66.0 %

2 Dragon 2 x64 avx2 : 2342 400 (+ 7,=258,-135), 34.0 %

Stockfish 150621 x64 bmi2 : 400 (+ 7,=258,-135), 34.0 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/w22yrasb ... 9.pgn/file

If Dragon by Komodo doesn't participate TCEC tournament with a new version, I guess the difference will be less than 40-50 elo under TCEC conditions.
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Stockfish Dev vs Stockfish 13: (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 180621 x64 bmi2 : 2412 15 15 700 53.4 % 2388 67.9 %
2 Stockfish 13 x64 bmi2 : 2388 15 15 700 46.6 % 2412 67.9 %


1 Stockfish 180621 x64 bmi2 : 2412 700 (+136,=475,- 89), 53.4 %

Stockfish 13 x64 bmi2 : 700 (+136,=475,- 89), 53.4 %

2 Stockfish 13 x64 bmi2 : 2388 700 (+ 89,=475,-136), 46.6 %

Stockfish 180621 x64 bmi2 : 700 (+ 89,=475,-136), 46.6 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/2rhrscwu ... 0.pgn/file
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Stockfish Dev vs Stockfish 13:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220621 x64 bmi2 : 2417 8 8 1000 54.9 % 2383 85.2 %
2 Stockfish 13 x64 bmi2 : 2383 8 8 1000 45.1 % 2417 85.2 %


Individual statistics:

1 Stockfish 220621 x64 bmi2 : 2417 1000 (+123,=852,- 25), 54.9 %

Stockfish 13 x64 bmi2 : 1000 (+123,=852,- 25), 54.9 %

2 Stockfish 13 x64 bmi2 : 2383 1000 (+ 25,=852,-123), 45.1 %

Stockfish 220621 x64 bmi2 : 1000 (+ 25,=852,-123), 45.1 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
http://www.mediafire.com/file/g6i72y881gt2iwl/r51.pgn
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Stockfish Dev vs Stockfish 13: (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220621 x64 bmi2 : 2413 14 14 700 53.6 % 2387 68.7 %
2 Stockfish 13 x64 bmi2 : 2387 14 14 700 46.4 % 2413 68.7 %

Individual statistics:

1 Stockfish 220621 x64 bmi2 : 2413 700 (+135,=481,- 84), 53.6 %

Stockfish 13 x64 bmi2 : 700 (+135,=481,- 84), 53.6 %

2 Stockfish 13 x64 bmi2 : 2387 700 (+ 84,=481,-135), 46.4 %

Stockfish 220621 x64 bmi2 : 700 (+ 84,=481,-135), 46.4 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/2x8kyw8q ... 2.pgn/file
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 260621 x64 bmi2 : 2400 6 6 1500 50.1 % 2400 90.1 %
2 Stockfish 220621 x64 bmi2 : 2400 6 6 1500 49.9 % 2400 90.1 %

Individual statistics:

1 Cfish 260621 x64 bmi2 : 2400 1500 (+ 75,=1352,- 73), 50.1 %

Stockfish 220621 x64 bmi2 : 1500 (+ 75,=1352,- 73), 50.1 %

2 Stockfish 220621 x64 bmi2 : 2400 1500 (+ 73,=1352,- 75), 49.9 %

Cfish 260621 x64 bmi2 : 1500 (+ 73,=1352,- 75), 49.9 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
Cfish Version: Cfish 260621 x64 Elto Bmi2 (ChessMan compile) Net:nn-62ef826d1a6d// Stockfish 220621 played with default net
https://www.mediafire.com/file/pim7a17p ... 3.pgn/file

This is a great success for Cfish because Cfish is behind in patches according to Stockfish and Cfish is playing with an old network.
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Sugar AI ve Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220621 x64 bmi2 : 2402 6 6 800 50.7 % 2398 93.6 %
2 SugaR AI 2.20 x64 bmi2 : 2398 6 6 800 49.3 % 2402 93.6 %

Individual statistics:

1 Stockfish 220621 x64 bmi2 : 2402 800 (+ 31,=749,- 20), 50.7 %

SugaR AI 2.20 bmi2 : 800 (+ 31,=749,- 20), 50.7 %

2 SugaR AI 2.20 bmi2 : 2398 800 (+ 20,=749,- 31), 49.3 %

Stockfish 220621 x64 bmi2 : 800 (+ 20,=749,- 31), 49.3 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/irk3toas ... 4.pgn/file
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Eman vs Stockfish Dev:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 220621 x64 bmi2 : 2403 7 7 800 50.9 % 2397 90.6 %
2 Eman 7.30 x64 bmi2 : 2397 7 7 800 49.1 % 2403 90.6 %

Individual statistics:

1 Stockfish 220621 x64 bmi2 : 2403 800 (+ 45,=725,- 30), 50.9 %

Eman 7.30 x64 bmi2 : 800 (+ 45,=725,- 30), 50.9 %

2 Eman 7.30 x64 bmi2 : 2397 800 (+ 30,=725,- 45), 49.1 %

Stockfish 220621 x64 bmi2 : 800 (+ 30,=725,- 45), 49.1 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/b8jubkmh ... 5.pgn/file
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 »

Stockfish Dev vs Stockfish 13: (Fischer Random Chess)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 290621 x64 bmi2 : 2419 11 11 1200 55.5 % 2381 68.8 %
2 Stockfish 13 x64 bmi2 : 2381 11 11 1200 44.5 % 2419 68.8 %


Individual statistics:

1 Stockfish 290621 x64 bmi2 : 2419 1200 (+253,=826,-121), 55.5 %

Stockfish 13 x64 bmi2 : 1200 (+253,=826,-121), 55.5 %

2 Stockfish 13 x64 bmi2 : 2381 1200 (+121,=826,-253), 44.5 %

Stockfish 290621 x64 bmi2 : 1200 (+121,=826,-253), 44.5 %


Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/5c15dxu7 ... 6.pgn/file