Stockfish 14.1 64-bit 4CPU Gauntlet for CCRL 40/15

[Graham Banks]

PGN - http://kirill-kryukov.com/chess/discuss ... p?id=49460

[Graham Banks]

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1298816 games played by 2955 programs, run by 25 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on November 20, 2021 with Bayeselo based on 1'298'816 games
Tested by CCRL team, 2005-2021, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 Stockfish 14 64-bit 4CPU                3547  +20  -20  68.4% -111.1   702
  Stockfish 13 64-bit 4CPU                3540  +17  -17  76.4% -173.1  1142
  Stockfish 2021-01-11 64-bit 4CPU        3540  +18  -17  74.5% -157.8  1088
  Stockfish 14.1 64-bit 4CPU              3518  +21  -21  65.3%  -88.9   616
  Stockfish 12 64-bit 4CPU                3511  +19  -19  71.8% -140.3   841
  Stockfish 2019-10-09 64-bit 4CPU        3485  +23  -23  74.7% -156.0   616
  Stockfish 11 64-bit 4CPU                3473  +20  -19  73.0% -143.0   840
  Stockfish 10 64-bit 4CPU                3457  +17  -16  73.4% -155.2  1227
  Stockfish 270918 64-bit 4CPU            3447  +28  -27  77.9% -188.7   457
  Stockfish 9 64-bit 4CPU                 3426  +15  -15  72.3% -153.0  1423
  Stockfish 8 64-bit 4CPU                 3373  +13  -13  64.8%  -94.8  1665
  Stockfish 7 64-bit 4CPU                 3323  +15  -15  67.0% -105.7  1304
  Stockfish 6 64-bit 4CPU                 3288  +14  -14  65.3%  -93.9  1542
  Stockfish 5 64-bit 4CPU                 3268  +14  -14  65.0%  -93.2  1591
  Stockfish DD 64-bit 4CPU                3231  +17  -17  63.0%  -78.5  1032
  Stockfish 4 64-bit 4CPU                 3203  +16  -16  59.8%  -58.5  1122
  Stockfish 3 64-bit 4CPU                 3164  +21  -21  56.0%  -35.5   663
  Stockfish 2.2.2 64-bit 4CPU             3146  +16  -16  58.6%  -52.6  1185
  Stockfish 2.3.1 64-bit 4CPU             3140  +19  -19  55.4%  -33.4   846
  Stockfish 2.0.1 64-bit 4CPU             3124  +24  -24  56.4%  -40.9   514
  Stockfish 1.9.1 64-bit 4CPU             3116  +20  -20  57.3%  -51.6   750
  Stockfish 2.1.1 64-bit 4CPU             3110  +27  -27  54.7%  -29.3   406
  Stockfish 1.8 64-bit 4CPU               3107  +18  -18  59.0%  -62.3   986
  Stockfish 1.7.1 64-bit 4CPU             3102  +18  -18  59.9%  -64.1   922
  Stockfish 1.6.3 64-bit 4CPU             3034  +22  -22  57.1%  -46.7   661
  Stockfish 1.5.1 64-bit 4CPU             2968  +25  -25  53.7%  -23.3   495
  Stockfish 1.4 64-bit 4CPU               2946  +17  -17  54.2%  -28.5  1131

[Jouni]

14.1 single and multi: no progress . I am not surprised.

[Graham Banks]

Hi Jouni,

I was a little surprised, as most other results I've seen give a small improvement.