Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2415 12 11 500 54.3 % 2385 86.2 %
2 Stockfish 13 x64 bmi2 : 2385 11 12 500 45.7 % 2415 86.2 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2415 500 (+ 56,=431,- 13), 54.3 %
Stockfish 13 x64 bmi2 : 500 (+ 56,=431,- 13), 54.3 %
2 Stockfish 13 x64 bmi2 : 2385 500 (+ 13,=431,- 56), 45.7 %
Stockfish 220521 x64 bmi2 : 500 (+ 13,=431,- 56), 45.7 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Perfect 2021 Opening Book (8 moves), 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/w5w111kr ... 6.pgn/file
Stockfish NNUE SV Tests
Moderators: hgm, Rebel, chrisw
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Stockfish Dev vs Stockfish 13:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2407 12 12 501 52.0 % 2393 84.8 %
2 Stockfish 13 x64 bmi2 : 2393 12 12 501 48.0 % 2407 84.8 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2407 500 (+ 48,=424,- 28), 52.0 %
Stockfish 13 x64 bmi2 : 500 (+ 48,=424,- 28), 52.0 %
2 Stockfish 13 x64 bmi2 : 2393 500 (+ 28,=424,- 48), 48.0 %
Stockfish 220521 x64 bmi2 : 500 (+ 28,=424,- 48), 48.0 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/r2qy9h70 ... 7.pgn/file
Stockfish Dev had played always white against Stockfish 13 in the last tests because I accidentally closed the swap sides option. In previous test the elo difference is a bit high (+32 elo ) because of this error.
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 220521 x64 bmi2 : 2407 12 12 501 52.0 % 2393 84.8 %
2 Stockfish 13 x64 bmi2 : 2393 12 12 501 48.0 % 2407 84.8 %
Individual statistics:
1 Stockfish 220521 x64 bmi2 : 2407 500 (+ 48,=424,- 28), 52.0 %
Stockfish 13 x64 bmi2 : 500 (+ 48,=424,- 28), 52.0 %
2 Stockfish 13 x64 bmi2 : 2393 500 (+ 28,=424,- 48), 48.0 %
Stockfish 220521 x64 bmi2 : 500 (+ 28,=424,- 48), 48.0 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/r2qy9h70 ... 7.pgn/file
Stockfish Dev had played always white against Stockfish 13 in the last tests because I accidentally closed the swap sides option. In previous test the elo difference is a bit high (+32 elo ) because of this error.
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Sugar AI vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 SugaR AI 2.10 x64 bmi2 : 2403 9 9 1000 50.4 % 2399 84.2 %
2 Stockfish 250521 x64 bmi2 : 2400 9 9 1000 49.6 % 2401 84.2 %
Individual statistics:
1 SugaR AI 2.10 x64 bmi2 : 2403 1000 (+ 83,=842,- 75), 50.4 %
Stockfish 250521 x64 bmi2 : 1000 (+ 83,=842,- 75), 50.4 %
2 Stockfish 250521 x64 bmi2 : 2400 1000 (+ 75,=842,- 83), 49.6 %
SugaR AI 2.10 x64 bmi2 : 1000 (+ 75,=842,- 83), 49.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off//Default Nets
https://www.mediafire.com/file/skq4kt9x ... 8.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 SugaR AI 2.10 x64 bmi2 : 2403 9 9 1000 50.4 % 2399 84.2 %
2 Stockfish 250521 x64 bmi2 : 2400 9 9 1000 49.6 % 2401 84.2 %
Individual statistics:
1 SugaR AI 2.10 x64 bmi2 : 2403 1000 (+ 83,=842,- 75), 50.4 %
Stockfish 250521 x64 bmi2 : 1000 (+ 83,=842,- 75), 50.4 %
2 Stockfish 250521 x64 bmi2 : 2400 1000 (+ 75,=842,- 83), 49.6 %
SugaR AI 2.10 x64 bmi2 : 1000 (+ 75,=842,- 83), 49.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off//Default Nets
https://www.mediafire.com/file/skq4kt9x ... 8.pgn/file
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Sugar AI vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 250521 x64 bmi2 : 2403 5 5 1500 50.4 % 2399 92.8 %
2 SugaR AI 2.10 x64 bmi2 : 2400 5 5 1500 49.6 % 2401 92.8 %
Individual statistics:
1 Stockfish 250521 x64 bmi2 : 2403 1500 (+ 60,=1392,- 48), 50.4 %
SugaR AI 2.10 x64 bmi2 : 1500 (+ 60,=1392,- 48), 50.4 %
2 SugaR AI 2.10 x64 bmi2 : 2400 1500 (+ 48,=1392,- 60), 49.6 %
Stockfish 250521 x64 bmi2 : 1500 (+ 48,=1392,- 60), 49.6 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
Default Nets//Sugar Experience File :Off
https://www.mediafire.com/file/xghnh1cj ... 9.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 250521 x64 bmi2 : 2403 5 5 1500 50.4 % 2399 92.8 %
2 SugaR AI 2.10 x64 bmi2 : 2400 5 5 1500 49.6 % 2401 92.8 %
Individual statistics:
1 Stockfish 250521 x64 bmi2 : 2403 1500 (+ 60,=1392,- 48), 50.4 %
SugaR AI 2.10 x64 bmi2 : 1500 (+ 60,=1392,- 48), 50.4 %
2 SugaR AI 2.10 x64 bmi2 : 2400 1500 (+ 48,=1392,- 60), 49.6 %
Stockfish 250521 x64 bmi2 : 1500 (+ 48,=1392,- 60), 49.6 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
Default Nets//Sugar Experience File :Off
https://www.mediafire.com/file/xghnh1cj ... 9.pgn/file
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Fire vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2439 25 24 400 61.1 % 2361 48.8 %
2 Stockfish 11 x64 bmi2 : 2361 24 25 400 38.9 % 2439 48.8 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2439 400 (+147,=195,- 58), 61.1 %
Stockfish 11 x64 bmi2 : 400 (+147,=195,- 58), 61.1 %
2 Stockfish 11 x64 bmi2 : 2361 400 (+ 58,=195,-147), 38.9 %
Fire 8.NN x64 bmi2 : 400 (+ 58,=195,-147), 38.9 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/75nlvtf1 ... 0.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2439 25 24 400 61.1 % 2361 48.8 %
2 Stockfish 11 x64 bmi2 : 2361 24 25 400 38.9 % 2439 48.8 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2439 400 (+147,=195,- 58), 61.1 %
Stockfish 11 x64 bmi2 : 400 (+147,=195,- 58), 61.1 %
2 Stockfish 11 x64 bmi2 : 2361 400 (+ 58,=195,-147), 38.9 %
Fire 8.NN x64 bmi2 : 400 (+ 58,=195,-147), 38.9 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/75nlvtf1 ... 0.pgn/file
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Fire vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2441 22 21 400 61.5 % 2359 59.5 %
2 Stockfish 11 x64 bmi2 : 2359 21 22 400 38.5 % 2441 59.5 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2441 400 (+127,=238,- 35), 61.5 %
Stockfish 11 x64 bmi2 : 400 (+127,=238,- 35), 61.5 %
2 Stockfish 11 x64 bmi2 : 2359 400 (+ 35,=238,-127), 38.5 %
Fire 8.NN x64 bmi2 : 400 (+ 35,=238,-127), 38.5 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/3y6792ro ... 1.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2441 22 21 400 61.5 % 2359 59.5 %
2 Stockfish 11 x64 bmi2 : 2359 21 22 400 38.5 % 2441 59.5 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2441 400 (+127,=238,- 35), 61.5 %
Stockfish 11 x64 bmi2 : 400 (+127,=238,- 35), 61.5 %
2 Stockfish 11 x64 bmi2 : 2359 400 (+ 35,=238,-127), 38.5 %
Fire 8.NN x64 bmi2 : 400 (+ 35,=238,-127), 38.5 %
Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, Balsa 5 Moves Opening Book , 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/3y6792ro ... 1.pgn/file
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Fire vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2429 14 14 1100 58.4 % 2371 50.9 %
2 Stockfish 310720 x64 bmi2 : 2371 14 14 1100 41.6 % 2429 50.9 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2429 1100 (+362,=560,-178), 58.4 %
Stockfish 310720 x64 bmi2 : 1100 (+362,=560,-178), 58.4 %
2 Stockfish 310720 x64 bmi2 : 2371 1100 (+178,=560,-362), 41.6 %
Fire 8.NN x64 bmi2 : 1100 (+178,=560,-362), 41.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/6izrspw3 ... 2.pgn/file
Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.
Program Elo + - Games Score Av.Op. Draws
1 Fire 8.NN x64 bmi2 : 2429 14 14 1100 58.4 % 2371 50.9 %
2 Stockfish 310720 x64 bmi2 : 2371 14 14 1100 41.6 % 2429 50.9 %
Individual statistics:
1 Fire 8.NN x64 bmi2 : 2429 1100 (+362,=560,-178), 58.4 %
Stockfish 310720 x64 bmi2 : 1100 (+362,=560,-178), 58.4 %
2 Stockfish 310720 x64 bmi2 : 2371 1100 (+178,=560,-362), 41.6 %
Fire 8.NN x64 bmi2 : 1100 (+178,=560,-362), 41.6 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/6izrspw3 ... 2.pgn/file
Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Ethereal vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Ethereal 12.75 NX1 : 2406 17 17 800 51.8 % 2394 49.4 %
2 Stockfish 310720 x64 bmi2 : 2394 17 17 800 48.2 % 2406 49.4 %
Individual statistics:
1 Ethereal 12.75 NX1 : 2406 800 (+217,=395,-188), 51.8 %
Stockfish 310720 x64 bmi2 : 800 (+217,=395,-188), 51.8 %
2 Stockfish 310720 x64 bmi2 : 2394 800 (+188,=395,-217), 48.2 %
Ethereal 12.75 NX1 : 800 (+188,=395,-217), 48.2 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/rp5cxywm ... 3.pgn/file
Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.
Ethereal 12.75 NX1 is a non official Ethereal version. It plays with a NNUE net.
Program Elo + - Games Score Av.Op. Draws
1 Ethereal 12.75 NX1 : 2406 17 17 800 51.8 % 2394 49.4 %
2 Stockfish 310720 x64 bmi2 : 2394 17 17 800 48.2 % 2406 49.4 %
Individual statistics:
1 Ethereal 12.75 NX1 : 2406 800 (+217,=395,-188), 51.8 %
Stockfish 310720 x64 bmi2 : 800 (+217,=395,-188), 51.8 %
2 Stockfish 310720 x64 bmi2 : 2394 800 (+188,=395,-217), 48.2 %
Ethereal 12.75 NX1 : 800 (+188,=395,-217), 48.2 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/rp5cxywm ... 3.pgn/file
Stockfish 310720 is the last Stockfish Dev version without NNUE evaluation.
Ethereal 12.75 NX1 is a non official Ethereal version. It plays with a NNUE net.
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Honey vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Honey 13.2 x64 bmi2 : 2404 10 10 800 51.1 % 2396 83.9 %
2 Stockfish 280521 x64 bmi2 : 2396 10 10 800 48.9 % 2404 83.9 %
Individual statistics:
1 Honey 13.2 x64 bmi2 : 2404 800 (+ 73,=671,- 56), 51.1 %
Stockfish 280521 x64 bmi2 : 800 (+ 73,=671,- 56), 51.1 %
2 Stockfish 280521 x64 bmi2 : 2396 800 (+ 56,=671,- 73), 48.9 %
Honey 13.2 x64 bmi2 : 800 (+ 56,=671,- 73), 48.9 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/k7tmrghm ... 5.pgn/file
Great success for Honey chess engine at this test conditions.
Program Elo + - Games Score Av.Op. Draws
1 Honey 13.2 x64 bmi2 : 2404 10 10 800 51.1 % 2396 83.9 %
2 Stockfish 280521 x64 bmi2 : 2396 10 10 800 48.9 % 2404 83.9 %
Individual statistics:
1 Honey 13.2 x64 bmi2 : 2404 800 (+ 73,=671,- 56), 51.1 %
Stockfish 280521 x64 bmi2 : 800 (+ 73,=671,- 56), 51.1 %
2 Stockfish 280521 x64 bmi2 : 2396 800 (+ 56,=671,- 73), 48.9 %
Honey 13.2 x64 bmi2 : 800 (+ 56,=671,- 73), 48.9 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 10 sec + 0.2 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/k7tmrghm ... 5.pgn/file
Great success for Honey chess engine at this test conditions.
-
- Posts: 676
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Stockfish NNUE SV Tests
Honey vs Stockfish:
Program Elo + - Games Score Av.Op. Draws
1 Honey 13.2 x64 bmi2 : 2403 8 7 800 50.9 % 2397 90.4 %
2 Stockfish 280521 x64 bmi2 : 2397 7 8 800 49.1 % 2403 90.4 %
Individual statistics:
1 Honey 13.2 x64 bmi2 : 2403 800 (+ 46,=723,- 31), 50.9 %
Stockfish 280521 x64 bmi2 : 800 (+ 46,=723,- 31), 50.9 %
2 Stockfish 280521 x64 bmi2 : 2397 800 (+ 31,=723,- 46), 49.1 %
Honey 13.2 x64 bmi2 : 800 (+ 31,=723,- 46), 49.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/dnslogcb ... 6.pgn/file
Program Elo + - Games Score Av.Op. Draws
1 Honey 13.2 x64 bmi2 : 2403 8 7 800 50.9 % 2397 90.4 %
2 Stockfish 280521 x64 bmi2 : 2397 7 8 800 49.1 % 2403 90.4 %
Individual statistics:
1 Honey 13.2 x64 bmi2 : 2403 800 (+ 46,=723,- 31), 50.9 %
Stockfish 280521 x64 bmi2 : 800 (+ 46,=723,- 31), 50.9 %
2 Stockfish 280521 x64 bmi2 : 2397 800 (+ 31,=723,- 46), 49.1 %
Honey 13.2 x64 bmi2 : 800 (+ 31,=723,- 46), 49.1 %
Game Conditions: Cutechess Gui, 1 Core (Core-i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/dnslogcb ... 6.pgn/file