Stockfish 12 64-bit 4CPU Gauntlet for CCRL 40/15

[Graham Banks]

PGN - http://kirill-kryukov.com/chess/discuss ... p?id=47345

[Graham Banks]

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1189229 games played by 2732 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on November 7, 2020 with Bayeselo based on 1'189'229 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Stockfish 12 64-bit 4CPU                3516  +25  -24  76.0% -169.0   544
  Stockfish 2019-10-09 64-bit 4CPU        3493  +23  -23  74.7% -156.1   616
  Stockfish 11 64-bit 4CPU                3481  +19  -19  73.0% -142.9   840
  Stockfish 10 64-bit 4CPU                3464  +16  -16  73.4% -155.7  1227
  Stockfish 270918 64-bit 4CPU            3453  +28  -27  77.9% -189.0   457
  Stockfish 9 64-bit 4CPU                 3431  +15  -15  72.3% -153.3  1423
  Stockfish 8 64-bit 4CPU                 3378  +14  -13  65.1%  -96.9  1647
  Stockfish 7 64-bit 4CPU                 3326  +15  -15  67.0% -106.4  1304
  Stockfish 6 64-bit 4CPU                 3290  +14  -14  65.3%  -93.8  1542
  Stockfish 5 64-bit 4CPU                 3269  +15  -15  67.7% -110.0  1346
  Stockfish DD 64-bit 4CPU                3233  +17  -17  63.0%  -78.2  1032
  Stockfish 4 64-bit 4CPU                 3205  +16  -16  60.1%  -59.9  1086
  Stockfish 3 64-bit 4CPU                 3166  +21  -21  56.0%  -35.5   663
  Stockfish 2.2.2 64-bit 4CPU             3146  +16  -16  59.2%  -56.2  1141
  Stockfish 2.3.1 64-bit 4CPU             3142  +19  -19  55.4%  -33.5   846
  Stockfish 2.0.1 64-bit 4CPU             3126  +24  -24  56.4%  -40.4   514
  Stockfish 1.9.1 64-bit 4CPU             3114  +22  -22  60.9%  -73.7   639
  Stockfish 2.1.1 64-bit 4CPU             3112  +27  -27  54.7%  -28.6   406
  Stockfish 1.8 64-bit 4CPU               3107  +18  -18  60.8%  -74.1   918
  Stockfish 1.7.1 64-bit 4CPU             3103  +19  -18  60.4%  -68.4   882
  Stockfish 1.6.3 64-bit 4CPU             3036  +22  -22  57.5%  -49.8   651
  Stockfish 1.5.1 64-bit 4CPU             2968  +25  -25  53.7%  -23.0   495
  Stockfish 1.4 64-bit 4CPU               2947  +17  -17  54.2%  -29.2  1131

[Ozymandias]

Hi Graham

Is it using NNUE or classical eval?

[Graham Banks]

Hi Graham

Is it using NNUE or classical eval?

NNUE.

[Peperoni]

Does Stockfish lose with black sometimes?

[Graham Banks]

Does Stockfish lose with black sometimes?

There were only 2 losses in the 512 games.
I'm not sure what colour SF was in those games. You could always download the pgn and take a look.