Cfish vs Stockfish (Fischer Random Chess):
Program Elo + - Games Score Av.Op. Draws
1 Cfish 090521 bmi2 : 2408 11 11 1200 52.4 % 2392 68.6 %
2 Stockfish 070521 x64 bmi2 : 2392 11 11 1200 47.6 % 2408 68.6 %
Individual statistics:
1 Cfish 090521 bmi2 : 2408 1200 (+217,=823,-160), 52.4 %
Stockfish 070521 x64 bmi2 : 1200 (+217,=823,-160), 52.4 %
2 Stockfish 070521 x64 bmi2 : 2392 1200 (+160,=823,-217), 47.6 %
Cfish 090521 bmi2 : 1200 (+160,=823,-217), 47.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
https://www.mediafire.com/file/vr9gzois ... 6.pgn/file
Stockfish NNUE SV Tests
Moderators: hgm, Rebel, chrisw
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Cfish vs Sugar AI:
Program Elo + - Games Score Av.Op. Draws
1 Cfish 090521 bmi2 : 2405 8 7 800 51.4 % 2395 90.2 %
2 SugaR AI 2.00 bmi2 : 2395 7 8 800 48.6 % 2405 90.2 %
Individual statistics:
1 Cfish 090521 bmi2 : 2405 800 (+ 50,=722,- 28), 51.4 %
SugaR AI 2.00 bmi2 : 800 (+ 50,=722,- 28), 51.4 %
2 SugaR AI 2.00 bmi2 : 2395 800 (+ 28,=722,- 50), 48.6 %
Cfish 090521 bmi2 : 800 (+ 28,=722,- 50), 48.6 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
http://www.mediafire.com/file/u0gccg0q6desrb1/r17.pgn
Program Elo + - Games Score Av.Op. Draws
1 Cfish 090521 bmi2 : 2405 8 7 800 51.4 % 2395 90.2 %
2 SugaR AI 2.00 bmi2 : 2395 7 8 800 48.6 % 2405 90.2 %
Individual statistics:
1 Cfish 090521 bmi2 : 2405 800 (+ 50,=722,- 28), 51.4 %
SugaR AI 2.00 bmi2 : 800 (+ 50,=722,- 28), 51.4 %
2 SugaR AI 2.00 bmi2 : 2395 800 (+ 28,=722,- 50), 48.6 %
Cfish 090521 bmi2 : 800 (+ 28,=722,- 50), 48.6 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Cfish Version: Cfish 090521 x64 E Bmi2 (ChessMan compile) // Default Nets
http://www.mediafire.com/file/u0gccg0q6desrb1/r17.pgn
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
NN-8a08400ed089 Net vs Default Net:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089) : 2453 11 11 3000 64.9 % 2347 31.0 %
2 Stockfish 170521 x64 bmi2 (Default Net) : 2347 11 11 3000 35.1 % 2453 31.0 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2453 3000 (+1482,=930,-588), 64.9 %
Stockfish 170521 x64 bmi2 : 3000 (+1482,=930,-588), 64.9 %
2 Stockfish 170521 x64 bmi2 : 2347 3000 (+588,=930,-1482), 35.1 %
Stockfish 180521 x64 bmi2 : 3000 (+588,=930,-1482), 35.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/48hnbcfc ... 8.pgn/file
Stockfish with nn-8a08400ed089 net is very strong at ultra fast time controls.
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089) : 2453 11 11 3000 64.9 % 2347 31.0 %
2 Stockfish 170521 x64 bmi2 (Default Net) : 2347 11 11 3000 35.1 % 2453 31.0 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2453 3000 (+1482,=930,-588), 64.9 %
Stockfish 170521 x64 bmi2 : 3000 (+1482,=930,-588), 64.9 %
2 Stockfish 170521 x64 bmi2 : 2347 3000 (+588,=930,-1482), 35.1 %
Stockfish 180521 x64 bmi2 : 3000 (+588,=930,-1482), 35.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/48hnbcfc ... 8.pgn/file
Stockfish with nn-8a08400ed089 net is very strong at ultra fast time controls.
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
NN-8a08400ed089 Net vs Default Net:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089): 2419 14 14 600 55.4 % 2381 75.2 %
2 Stockfish 170521 x64 bmi2(Default Net) : 2381 14 14 600 44.6 % 2419 75.2 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2419 600 (+107,=451,- 42), 55.4 %
Stockfish 170521 x64 bmi2 : 600 (+107,=451,- 42), 55.4 %
2 Stockfish 170521 x64 bmi2 : 2381 600 (+ 42,=451,-107), 44.6 %
Stockfish 180521 x64 bmi2 : 600 (+ 42,=451,-107), 44.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/tr4yhf7h ... 9.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 (nn-8a08400ed089): 2419 14 14 600 55.4 % 2381 75.2 %
2 Stockfish 170521 x64 bmi2(Default Net) : 2381 14 14 600 44.6 % 2419 75.2 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2419 600 (+107,=451,- 42), 55.4 %
Stockfish 170521 x64 bmi2 : 600 (+107,=451,- 42), 55.4 %
2 Stockfish 170521 x64 bmi2 : 2381 600 (+ 42,=451,-107), 44.6 %
Stockfish 180521 x64 bmi2 : 600 (+ 42,=451,-107), 44.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/tr4yhf7h ... 9.pgn/file
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
NN-8a08400ed089 Net vs Default Net (Fischer Random Chess):
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 : 2415 12 12 800 54.4 % 2385 74.9 %
2 Stockfish 170521 x64 bmi2 : 2385 12 12 800 45.6 % 2415 74.9 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2415 800 (+136,=599,- 65), 54.4 %
Stockfish 170521 x64 bmi2 : 800 (+136,=599,- 65), 54.4 %
2 Stockfish 170521 x64 bmi2 : 2385 800 (+ 65,=599,-136), 45.6 %
Stockfish 180521 x64 bmi2 : 800 (+ 65,=599,-136), 45.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/2fs3fgb8 ... 0.pgn/file
Great performance of Stockfish with nn-8a08400ed089 net at FRC with these test conditions.
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 180521 x64 bmi2 : 2415 12 12 800 54.4 % 2385 74.9 %
2 Stockfish 170521 x64 bmi2 : 2385 12 12 800 45.6 % 2415 74.9 %
Individual statistics:
1 Stockfish 180521 x64 bmi2 : 2415 800 (+136,=599,- 65), 54.4 %
Stockfish 170521 x64 bmi2 : 800 (+136,=599,- 65), 54.4 %
2 Stockfish 170521 x64 bmi2 : 2385 800 (+ 65,=599,-136), 45.6 %
Stockfish 180521 x64 bmi2 : 800 (+ 65,=599,-136), 45.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 1 min + 0.5 sec TC, Chess960 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/2fs3fgb8 ... 0.pgn/file
Great performance of Stockfish with nn-8a08400ed089 net at FRC with these test conditions.
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 190521 x64 bmi2 : 2413 6 6 1300 53.7 % 2387 88.9 %
2 Stockfish 13 x64 bmi2 : 2387 6 6 1300 46.3 % 2413 88.9 %
Individual statistics:
1 Stockfish 190521 x64 bmi2 : 2413 1300 (+120,=1156,- 24), 53.7 %
Stockfish 13 x64 bmi2 : 1300 (+120,=1156,- 24), 53.7 %
2 Stockfish 13 x64 bmi2 : 2387 1300 (+ 24,=1156,-120), 46.3 %
Stockfish 190521 x64 bmi2 : 1300 (+ 24,=1156,-120), 46.3 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 2 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/1wki84p2 ... 1.pgn/file
Impressive score for this time control (2 min + 0.5 sec) match.
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 190521 x64 bmi2 : 2413 6 6 1300 53.7 % 2387 88.9 %
2 Stockfish 13 x64 bmi2 : 2387 6 6 1300 46.3 % 2413 88.9 %
Individual statistics:
1 Stockfish 190521 x64 bmi2 : 2413 1300 (+120,=1156,- 24), 53.7 %
Stockfish 13 x64 bmi2 : 1300 (+120,=1156,- 24), 53.7 %
2 Stockfish 13 x64 bmi2 : 2387 1300 (+ 24,=1156,-120), 46.3 %
Stockfish 190521 x64 bmi2 : 1300 (+ 24,=1156,-120), 46.3 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 2 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 128 Mb Hash, Ponder Off
https://www.mediafire.com/file/1wki84p2 ... 1.pgn/file
Impressive score for this time control (2 min + 0.5 sec) match.
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2457 11 11 3000 65.9 % 2343 28.2 %
2 Stockfish 13 x64 bmi2 : 2343 11 11 3000 34.1 % 2457 28.2 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2457 3000 (+1554,=846,-600), 65.9 %
Stockfish 13 x64 bmi2 : 3000 (+1554,=846,-600), 65.9 %
2 Stockfish 13 x64 bmi2 : 2343 3000 (+600,=846,-1554), 34.1 %
Stockfish 220521 x64 bmi2 : 3000 (+600,=846,-1554), 34.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/gc7q5yqq ... 2.pgn/file
Stockfish Dev with new net( nn-7756374aaed3) is very stronger at ultra fast time controls like Stockfish Dev with old net (nn-8a08400ed089).
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2457 11 11 3000 65.9 % 2343 28.2 %
2 Stockfish 13 x64 bmi2 : 2343 11 11 3000 34.1 % 2457 28.2 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2457 3000 (+1554,=846,-600), 65.9 %
Stockfish 13 x64 bmi2 : 3000 (+1554,=846,-600), 65.9 %
2 Stockfish 13 x64 bmi2 : 2343 3000 (+600,=846,-1554), 34.1 %
Stockfish 220521 x64 bmi2 : 3000 (+600,=846,-1554), 34.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/gc7q5yqq ... 2.pgn/file
Stockfish Dev with new net( nn-7756374aaed3) is very stronger at ultra fast time controls like Stockfish Dev with old net (nn-8a08400ed089).
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2451 14 14 1000 64.3 % 2349 57.8 %
2 Stockfish 13 x64 bmi2 : 2349 14 14 1000 35.7 % 2451 57.8 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2451 1000 (+354,=578,- 68), 64.3 %
Stockfish 13 x64 bmi2 : 1000 (+354,=578,- 68), 64.3 %
2 Stockfish 13 x64 bmi2 : 2349 1000 (+ 68,=578,-354), 35.7 %
Stockfish 220521 x64 bmi2 : 1000 (+ 68,=578,-354), 35.7 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 100 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/0toiyfz1 ... 3.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2451 14 14 1000 64.3 % 2349 57.8 %
2 Stockfish 13 x64 bmi2 : 2349 14 14 1000 35.7 % 2451 57.8 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2451 1000 (+354,=578,- 68), 64.3 %
Stockfish 13 x64 bmi2 : 1000 (+354,=578,- 68), 64.3 %
2 Stockfish 13 x64 bmi2 : 2349 1000 (+ 68,=578,-354), 35.7 %
Stockfish 220521 x64 bmi2 : 1000 (+ 68,=578,-354), 35.7 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 100 kn/move , Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/0toiyfz1 ... 3.pgn/file
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2416 12 11 500 54.5 % 2384 85.4 %
2 Stockfish 13 x64 bmi2 : 2384 11 12 500 45.5 % 2416 85.4 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2416 500 (+ 59,=427,- 14), 54.5 %
Stockfish 13 x64 bmi2 : 500 (+ 59,=427,- 14), 54.5 %
2 Stockfish 13 x64 bmi2 : 2384 500 (+ 14,=427,- 59), 45.5 %
Stockfish 220521 x64 bmi2 : 500 (+ 14,=427,- 59), 45.5 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/v03slyra ... 4.pgn/file
Great score for this time control (1 min + 0.5 sec) match
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2416 12 11 500 54.5 % 2384 85.4 %
2 Stockfish 13 x64 bmi2 : 2384 11 12 500 45.5 % 2416 85.4 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2416 500 (+ 59,=427,- 14), 54.5 %
Stockfish 13 x64 bmi2 : 500 (+ 59,=427,- 14), 54.5 %
2 Stockfish 13 x64 bmi2 : 2384 500 (+ 14,=427,- 59), 45.5 %
Stockfish 220521 x64 bmi2 : 500 (+ 14,=427,- 59), 45.5 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/v03slyra ... 4.pgn/file
Great score for this time control (1 min + 0.5 sec) match
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2424 14 13 500 56.9 % 2376 80.2 %
2 Stockfish 13 x64 bmi2 : 2376 13 14 500 43.1 % 2424 80.2 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2424 500 (+ 84,=401,- 15), 56.9 %
Stockfish 13 x64 bmi2 : 500 (+ 84,=401,- 15), 56.9 %
2 Stockfish 13 x64 bmi2 : 2376 500 (+ 15,=401,- 84), 43.1 %
Stockfish 220521 x64 bmi2 : 500 (+ 15,=401,- 84), 43.1 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/n2ahnr81 ... 5.pgn/file
There is a record elo difference (+48 elo) between Stockfish Dev vs Stockfish 13 at this test with the help of SuperGM 4 Moves Opening Book.
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2424 14 13 500 56.9 % 2376 80.2 %
2 Stockfish 13 x64 bmi2 : 2376 13 14 500 43.1 % 2424 80.2 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2424 500 (+ 84,=401,- 15), 56.9 %
Stockfish 13 x64 bmi2 : 500 (+ 84,=401,- 15), 56.9 %
2 Stockfish 13 x64 bmi2 : 2376 500 (+ 15,=401,- 84), 43.1 %
Stockfish 220521 x64 bmi2 : 500 (+ 15,=401,- 84), 43.1 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/n2ahnr81 ... 5.pgn/file
There is a record elo difference (+48 elo) between Stockfish Dev vs Stockfish 13 at this test with the help of SuperGM 4 Moves Opening Book.
Last edited by mehmet123 on Sat May 22, 2021 6:49 pm, edited 1 time in total.