Stockfish NNUE SV Tests

[mehmet123]

Cfish vs Stockfish Match:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 050920 x64 bmi2 : 2405 6 6 1500 51.4 % 2395 87.0 %
2 Stockfish 040920 x64 bmi2 : 2395 6 6 1500 48.6 % 2405 87.0 %

Individual statistics:

1 Cfish 050920 x64 bmi2 : 2405 1500 (+118,=1305,- 77), 51.4 %

Stockfish 040920 x64 bmi2 : 1500 (+118,=1305,- 77), 51.4 %

2 Stockfish 040920 x64 bmi2 : 2395 1500 (+ 77,=1305,-118), 48.6 %

Cfish 050920 x64 bmi2 : 1500 (+ 77,=1305,-118), 48.6 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 128 Mb Hash, Ponder Off
Compilation: Cfish++NNUE 050920 x64 BMI2 (Mymoso Compilation)// Default Net
http://www.mediafire.com/file/glmdoiqkl ... 2.pgn/file

First time ı'm testing Mymoso Cfish compilation. This is one of the best results of Cfish against Stockfish (+10 elo).
Previous test shows +8 elo performance against Stockfish (2000 games)

[mehmet123]

Cfish vs Stockfish Match:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 090920 (ChessMan) : 2405 6 6 1750 51.6 % 2395 87.5 %
2 Stockfish 080920 x64 bmi2 : 2395 6 6 1750 48.4 % 2405 87.5 %

Individual statistics:

1 Cfish 090920 (ChessMan) : 2405 1750 (+137,=1531,- 82), 51.6 %

Stockfish 080920 x64 bmi2 : 1750 (+137,=1531,- 82), 51.6 %

2 Stockfish 080920 x64 bmi2: 2395 1750 (+ 82,=1531,-137), 48.4 %

Cfish 090920 (ChessMan) : 1750 (+ 82,=1531,-137), 48.4 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, Balsa 5 Move Opening Book, 64 Mb Hash, Ponder Off
Compilation: Cfish 090920 x64 E BMI2 Haswell B O3 mingw10(ChessMan Compilation)// Default Net
http://www.mediafire.com/file/t8ojx6xfz ... 2.pgn/file

The performance of Cfish Chessman compilation is same Cfish Mymoso compilation against Stockfish Dev. (+10 elo) at my tests.

[mehmet123]

For the first and last time I'm sharing ChessMan and Mymoso Cfish compilations:

Mymoso Cfish compilation:
https://mega.nz/file/Ix9xgAQC#l1n6P4Qhz ... q6iI9flyMY

ChessMan Cfish compilation:
https://pixeldrain.com/u/py6nLAj9

Both Chessman and Mymoso are the members of The Outskirts Chess Forum and they regularly post their compilations at this website.
I recommend this chess website with peace of mind because posting download links to or asking for illegal or commercial material and posting download links to private material without the owner's permission is not allowed at this website.
http://outskirts.altervista.org/forum/index.php

[mehmet123]

SV 20200914-1520 Net vs. Default Net (Fischer Random Chess Match)

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 080920 (SV 1520) : 2404 7 7 6000 51.1 % 2396 42.2 %
2 Stockfish 080920 (Default) : 2396 7 7 6000 48.9 % 2404 42.2 %

Individual statistics:

1 Stockfish 080920 (SV 1520): 2404 6000 (+1800,=2532,-1668), 51.1 %

Stockfish 080920 (Default) : 6000 (+1800,=2532,-1668), 51.1 %

2 Stockfish 080920 (Default): 2396 6000 (+1668,=2532,-1800), 48.9 %

Stockfish 080920 (SV 1520) : 6000 (+1668,=2532,-1800), 48.9 %

Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 20 kn/move, Chess960 Book 3moves Opening Book, 64 Mb Hash, Ponder Off
Compilation: Stockfish 080920 x64 bmi2
http://www.mediafire.com/file/pa4ykhquy ... 2.pgn/file

Stockfish with latest Sergio Vieri's net beat Stockfish (Default net) with a good score (+ 8 elo) at Fischer Random Chess Match

[mehmet123]

Timelines of Chess Engines:

Cfish is the best chess engine of 2020
Komodo 9.3 was the best chess engine of 2015 (TCEC Season 8(Aug – Nov 2015) Komodo 9.3x - Stockfish 021115 + 9 = 89 - 2)
Houdini 1.5a was the best chess engine of 2010 (TCEC Season 1(Dec 2010 – Feb 2011) Houdini 1.5a - Rybka 4.0) + 12 = 23 - 5)
Fruit 2.1 was the best chess engine of 2005

Cfish vs. Top Engines of 2005,2010,2015

Rank Name Elo +/- Games Score Draw
0 Cfish 240920........ : 613 56 720 97.2% 5.4%
1 Komodo 9.3 x64... : -477 68 240 6.0% 11.3%
2 Houdini 1.5a x64.. : -669 124 240 2.1% 4.2%
3 Fruit 2.1............ : -951 nan 240 0.4% 0.8%

Cfish 240920 :

Fruit 2.1 : 240 (+238,= 2,- 0), 99.6 %
Houdini 1.5a x64 : 240 (+230,= 10,- 0), 97.9 %
Komodo 9.3 x64 : 240 (+212,= 27,- 1), 94.0 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 128 Mb Hash, Ponder Off
Compilation:Cfish 240920 x64 E BMI2 mingw10 (ChessMan compile)//Default Net//Contempt:60
http://www.mediafire.com/file/kmz3hszf1 ... 0.pgn/file

It is clear that chess programs have made tremendous progress over time.
Fruit 2.1 is very weak (- 951 elo) according to Cfish. But Fruit 2.1 is stronger than Deep Fritz 7 at 1 core. Kramnik was the world chess champion at 2002 and Kramnik - Deep Fritz 7 match ended in a 4-4 tie at 2002 .

[mehmet123]

Cfish vs Stockfish Match

Program Elo + - Games Score Av.Op. Draws

1 Cfish 031020 x64 bmi2 : 2403 7 7 1540 50.8 % 2397 83.2 %
2 Stockfish 280920 x64 bmi2 : 2397 7 7 1540 49.2 % 2403 83.2 %

Individual statistics:

1 Cfish 031020 x64 bmi2 : 2403 1540 (+142,=1282,-116), 50.8 %

Stockfish 280920 x64 bmi2 : 1540 (+142,=1282,-116), 50.8 %

2 Stockfish 280920 x64 bmi2 : 2397 1540 (+116,=1282,-142), 49.2 %

Cfish 031020 x64 bmi2 : 1540 (+116,=1282,-142), 49.2 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 30 sec + 0.5 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
Compilation1: Cfish 031020 x64 E BMI2 mingw10 (ChessMan compile ) // Default Net
Compilation1: Stockfish 280920 x64 bmi2 (Official version)//Default Net
http://www.mediafire.com/file/mgn16rlnr ... 6.pgn/file

[mehmet123]

ShashChess vs Stockfish Match

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 141020 x64 bmi2 : 2411 11 11 1000 53.1 % 2389 74.4 %
2 ShashChess 15.1 x64 bmi2 : 2389 11 11 1000 46.9 % 2411 74.4 %

Individual statistics:

1 Stockfish 141020 x64 bmi2 : 2411 1000 (+159,=744,- 97), 53.1 %

ShashChess 15.1 x64 bmi2 : 1000 (+159,=744,- 97), 53.1 %

2 ShashChess 15.1 x64 bmi2 : 2389 1000 (+ 97,=744,-159), 46.9 %

Stockfish 141020 x64 bmi2 : 1000 (+ 97,=744,-159), 46.9 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off//Default Nets
http://www.mediafire.com/file/kvlxwmbxb ... 1.pgn/file

[mehmet123]

BrainLearn vs Stockfish Match

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 141020 x64 bmi2 :2406 9 9 1200 51.6 % 2394 79.3 %
2 BrainLearn 12.1 x64 bmi2 : 2394 9 9 1200 48.4 % 2406 79.3 %

Individual statistics:

1 Stockfish 141020 x64 bmi2 : 2406 1200 (+143,=952,-105), 51.6 %

BrainLearn 12.1 x64 bmi2 : 1200 (+143,=952,-105), 51.6 %

2 BrainLearn 12.1 x64 bmi2 : 2394 1200 (+105,=952,-143), 48.4 %

Stockfish 141020 x64 bmi2 : 1200 (+105,=952,-143), 48.4 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off//Default Nets
http://www.mediafire.com/file/zh4do2q6p ... 2.pgn/file

[mehmet123]

Stockfish 141020 (without net) vs Stockfish 310720

Program Elo + - Games Score Av.Op. Draws

1 Stockfish 310720 x64 bmi2 : 2403 12 12 1200 51.0 % 2397 60.7 %
2 Stockfish 141020 x64 bmi2 : 2397 12 12 1200 49.0 % 2403 60.7 %

Individual statistics:

1 Stockfish 310720 x64 bmi2 : 2403 1200 (+248,=728,-224), 51.0 %

Stockfish 141020 x64 bmi2 : 1200 (+248,=728,-224), 51.0 %

2 Stockfish 141020 x64 bmi2 : 2397 1200 (+224,=728,-248), 49.0 %

Stockfish 310720 x64 bmi2 : 1200 (+224,=728,-248), 49.0 %


Game Conditions: Cutechess Gui, 1 Core (i7 9750h), 10 sec + 0.2 sec TC, SuperGM 4 Moves Opening Book, 64 Mb Hash, Ponder Off
http://www.mediafire.com/file/2s4mea1en ... 3.pgn/file

It seems that some patches that strengthen the Stockfish NNUE cause a power drop in Stockfish without NNUE.

[mehmet123]

Cfish vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Cfish 231020 x64 bmi2 : 2402 8 8 1000 50.7 % 2398 85.8 %
2 Stockfish 221020 x64 bmi2 : 2398 8 8 1000 49.3 % 2402 85.8 %

Individual statistics:

1 Cfish 231020 x64 bmi2 : 2402 1000 (+ 78,=858,- 64), 50.7 %

Stockfish 221020 x64 bmi2 : 1000 (+ 78,=858,- 64), 50.7 %

2 Stockfish 221020 x64 bmi2 : 2398 1000 (+ 64,=858,- 78), 49.3 %

Cfish 231020 x64 bmi2 : 1000 (+ 64,=858,- 78), 49.3 %


Game Conditions: Cutechess Gui, 1 Core ( i7 9750h), 1 min + 0.5 sec TC, SuperGM 4 Moves Opening Book, 128 Mb Hash, Ponder Off
Compilation:Cfish 231020 x64 E BMI2 mingw (ChessMan compile)//Default Net
http://www.mediafire.com/file/o9sbwgn8y ... 6.pgn/file