Stockfish NNUE SV Tests

Discussion of computer chess matches and engine tournaments.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Vinvin
Posts: 4784
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Stockfish NNUE SV Tests

Post by Vinvin » Sat Oct 24, 2020 10:30 am

Please, would you mind to test "CorChess NNUE 1.3" ?
I saw very good results from it recently.

The executable is here : https://chess.ultimaiq.net/stockfish.html
You probably has to download the NN-file at the bottom of the page.

Thanks !

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Sun Oct 25, 2020 5:36 am

CorChess vs. Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 221020 x64 bmi2 : 2402 8 8 1000 50.4 % 2398 87.7 %
2 Corchess 1.3 211020 x64 bmi2 : 2398 8 8 1000 49.5 % 2402 87.7 %

Individual statistics:

1 Stockfish 221020 x64 bmi2 : 2402 1000 (+ 66,=877,- 57), 50.5 %

Corchess 1.3 211020 x64 bmi2 : 1000 (+ 66,=877,- 57), 50.4 %

2 Corchess 1.3 211020 x64 bmi2: 2398 1000 (+ 57,=877,- 66), 49.5 %

Stockfish 221020 x64 bmi2 : 1000 (+ 57,=877,- 66), 49.5 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 128 Mb Hash, Ponder Off
http://www.mediafire.com/file/gsvu5nb19 ... 8.pgn/file

CorChess is developed for long time games, because of this it's hard to give to a conclusion about CorChess with these fast games.

Vinvin
Posts: 4784
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Stockfish NNUE SV Tests

Post by Vinvin » Sun Oct 25, 2020 11:35 am

Thanks !
Which nn-file did you use ? Latest or the one on the page ?

2 other very strong SF evolutions to test : Honey-12-R1 and Bluefish-12-R1
At the bottom of the page : https://github.com/MichaelB7/Stockfish/ ... /tag/v12r1
May be you have to add the latest nn-file from here : https://tests.stockfishchess.org/nns

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Sun Oct 25, 2020 12:40 pm

Vinvin wrote:
Sun Oct 25, 2020 11:35 am
Thanks !
Which nn-file did you use ? Latest or the one on the page ?

2 other very strong SF evolutions to test : Honey-12-R1 and Bluefish-12-R1
At the bottom of the page : https://github.com/MichaelB7/Stockfish/ ... /tag/v12r1
May be you have to add the latest nn-file from here : https://tests.stockfishchess.org/nns
I used default net(nn-eba324f53044.nnue)

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Mon Oct 26, 2020 7:33 pm

Ethereal vs. Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 221020 x64 bmi2 : 2491 21 20 500 74.1 % 2309 49.0 %
2 Ethereal 12.75 NNUE : 2309 20 21 500 25.9 % 2491 49.0 %

Individual statistics:

1 Stockfish 221020 x64 bmi2 : 2491 500 (+248,=245,- 7), 74.1 %

Ethereal 12.75 NNUE : 500 (+248,=245,- 7), 74.1 %

2 Ethereal 12.75 NNUE : 2309 500 (+ 7,=245,-248), 25.9 %

Stockfish 221020 x64 bmi2 : 500 (+ 7,=245,-248), 25.9 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
//Both chess engines played with Stockfish default net (nn-eba324f53044.nnue)
http://www.mediafire.com/file/r7pg3p292 ... 0.pgn/file

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Mon Oct 26, 2020 8:51 pm

Etheral NNUE vs Stockfish (without NNUE):

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 221020 x64 bmi2 : 2400 11 11 2200 50.0 % 2400 43.2 %
2 Ethereal 12.75 NNUE : 2400 11 11 2200 50.0 % 2400 43.2 %

Individual statistics:

1 Stockfish 221020 x64 bmi2 : 2400 2200 (+625,=950,-625), 50.0 %

Ethereal 12.75 NNUE : 2200 (+625,=950,-625), 50.0 %

2 Ethereal 12.75 NNUE : 2400 2200 (+625,=950,-625), 50.0 %

Stockfish 221020 x64 bmi2 : 2200 (+625,=950,-625), 50.0 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Ethereal played with Stockfish default net (nn-eba324f53044.nnue), Stockfish played without net.
http://www.mediafire.com/file/639tncjif ... 1.pgn/file

The most powerful chess engine after Stockfish NNUE is Ethereal NNUE (non official) at hardwares that do not have a very powerful graphics cards.

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Tue Oct 27, 2020 3:54 pm

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 261020 x64 bmi2 : 2403 10 10 1000 50.8 % 2397 77.8 %
2 Stockfish 221020 x64 bmi2 : 2397 10 10 1000 49.2 % 2403 77.8 %

Individual statistics:

1 Cfish 261020 x64 bmi2 : 2403 1000 (+119,=778,-103), 50.8 %

Stockfish 221020 x64 bmi2 : 1000 (+119,=778,-103), 50.8 %

2 Stockfish 221020 x64 bmi2 : 2397 1000 (+103,=778,-119), 49.2 %

Cfish 261020 x64 bmi2 : 1000 (+103,=778,-119), 49.2 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish compile:Cfish++NNUE 261020 x64 BMI2 (Mymoso compile)//Default net
http://www.mediafire.com/file/6mmve4h58 ... 3.pgn/file

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Tue Oct 27, 2020 6:16 pm

Cfish (M. Goi compile) vs Stockfish :

Program Elo + - Games Score Av.Op. Draws

1 Cfish 261020 : 2405 11 10 1000 51.3 % 2395 76.1 %
2 Stockfish 221020 x64 bmi2 : 2395 10 11 1000 48.6 % 2405 76.1 %

Individual statistics:

1 Cfish 261020 : 2405 1000 (+133,=761,-106), 51.4 %

Stockfish 221020 x64 bmi2 : 1000 (+133,=761,-106), 51.3 %

2 Stockfish 221020 x64 bmi2 : 2395 1000 (+106,=761,-133), 48.6 %

Cfish 261020 : 1000 (+106,=761,-133), 48.6 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Cfish compile: Cfish NUMA 261020 x64 BMI2 (Massimiliano Goi compile)//Default net
http://www.mediafire.com/file/74gniwi3j ... 4.pgn/file

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Tue Oct 27, 2020 7:55 pm

Download link of Cfish (Goi compile)
https://chess.massimilianogoi.com/downl ... wnload.php

mehmet123
Posts: 261
Joined: Sun Jan 26, 2020 9:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Stockfish NNUE SV Tests

Post by mehmet123 » Thu Oct 29, 2020 5:28 pm

Default Net vs. SV 1520 Net:

Program Elo + - Games Score Av.Op. Draws

1 Corchess Default(eba324f53044) : 2405 7 7 2200 51.5 % 2395 76.9 %
2 Corchess SV 20200914-1520 : 2395 7 7 2200 48.5 % 2405 76.9 %

Individual statistics:

1 Corchess Default : 2405 2200 (+288,=1692,-220), 51.5 %

Corchess SV 1520 : 2200 (+288,=1692,-220), 51.5 %

2 Corchess SV 1520 : 2395 2200 (+220,=1692,-288), 48.5 %

Corchess Default : 2200 (+220,=1692,-288), 48.5 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
CorChess Version: CorChess NNUE 1.3 211020
http://www.mediafire.com/file/vusaizwl9 ... 2.pgn/file

20200914-1520 net is the last published net trained by Sergio Vieri and eba324f53044 is the previous default net.

Post Reply