THE SSDF RATING LIST 2020-12-31

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2020-12-31

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2020-12-31    155019 games played by  397 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 12 NNUE x64 1800X 3.6 GHz     3573   47   -43   257   65%  3466
   2 Dragon by Komodo x64 1800X 3.6 GHz      3564   50   -45   250   70%  3413
   3 Stockfish 11 x64 1800X 3.6 GHz          3547   38   -35   423   71%  3391
   4 Stockfish 10 x64 1800X 3.6 GHz          3521   25   -24   880   68%  3385
   5 Stockfish 9 x64 1800X 3.6 GHz           3482   27   -25   842   71%  3324
   6 Komodo 13.1 x64 1800X 3.6 GHz           3469   30   -29   560   62%  3386
   7 Komodo 14 x64 1800X 3.6 GHz             3466   38   -38   320   52%  3452
   8 Komodo 13.02 x64 1800X 3.6 GHz          3462   30   -29   600   65%  3351
   9 Komodo 12.3 x64 1800X 3.6 GHz           3452   27   -26   760   66%  3334
  10 Stockfish 9 x64 Q6600 2.4 GHz           3445   32   -31   480   56%  3400
  11 Komodo 12.3 x64 Q6600 2.4 GHz           3434   38   -36   360   60%  3360
  12 Stockfish 8 x64 1800X 3.6 GHz           3426   21   -20  1400   72%  3263
  13 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz    3421   50   -48   200   56%  3376
  14 Stockfish 8 x64 Q6600 2.4 GHz           3410   31   -30   560   65%  3300
  15 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3398   31   -30   520   57%  3346
  16 Komodo 11.01 x64 1800X 3.6 GHz          3394   19   -19  1474   67%  3270
  17 Booot 6.4 x64 1800X 3.6 GHz             3370   41   -41   280   53%  3344
  18 Booot 6.3.1 x64 1800X 3.6 GHz           3357   19   -19  1260   47%  3374
  19 Deep Shredder 13 x64 1800X 3.6 GHz      3356   24   -24   880   64%  3255
  20 Komodo 11.01 x64 Q6600 2.4 GHz          3340   27   -27   642   50%  3338
  21 Stockfish 6 x64 Q6600 2.4 GHz           3325   21   -20  1256   69%  3190
  22 Vajolet2 2.8 x64 1800X 3.6 GHz          3297   27   -28   650   38%  3379
  23 Arasan 21.2 x64 1800X 3.6 GHz           3282   26   -27   680   38%  3364
  24 Vajolet2 2.8 x64 Q6600 2.4 GHz          3281   46   -41   320   73%  3103
  25 Wasp 4 x64 1800X 3.6 GHz                3257   45   -49   240   35%  3369
  26 Arasan 21.2 x64 Q6600 2.4 GHz           3250   37   -38   340   45%  3281
  27 Wasp 3.5 x64 1800X 3.6 GHz              3220   29   -31   600   32%  3348
  28 Deep Hiarcs 14 1800X 3.6 GHz            3220   24   -25   800   39%  3293
  29 Wasp 4 x64 Q6600 2.4 GHz                3209   38   -37   340   59%  3147
  30 Deep Rybka 4 x64 Q6600 2.4 GHz          3199   19   -18  1448   64%  3101
  31 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  32 Chiron 3.01 x64 Q6600 2.4 GHz           3177   27   -27   656   45%  3214
  33 Wasp 3.5 x64 Q6600 2.4 GHz              3169   36   -37   360   43%  3215
  34 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -22  1010   42%  3183
  35 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3064
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 The Baron 3.43 x64 Q6600 2.4 GHz        3022   33   -33   440   51%  3018
  38 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2882
  39 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3008
  40 Revelation Hiarcs 13.3 PXA255 500 MHz   2771   57   -52   177   66%  2660
  41 Revelation Shredder 12 PXA255 500 MHz   2705   60   -58   140   56%  2665
  42 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2545
  43 Revelation Deep Sjeng 3 PXA255 500 MHz  2601   62   -67   120   41%  2663
  44 Millennium The King Exclusive 300 MHz   2527   58   -57   144   51%  2519
  45 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2445   65   -62   120   56%  2399
  46 Revelation Ruffian 2.1 PXA255 500 MHz   2348   68   -71   100   45%  2385
  47 Millennium ChessGenius Excl. M7 300 MHz 2244   62   -57   144   62%  2157
  48 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  49 Millennium ChessGenius ARM M4 48 MHz    2073   47   -45   231   59%  2008
  50 Mephisto London 68000 12 MHz            2005   59   -58   140   53%  1982

 1 Stockfish 12 NNUE x64 1800X 3.6 GHz, 3573											
Dragon 1800X       8-9     Stoc11 1800X      21-19    Stoc10 1800X    23,5-16,5
Ko131 1800X       25-15    Ko14 1800X      27,5-12,5  Komo11 1800X    31,5-8,5 
Booot6 1800X    29,5-10,5  

 2 Dragon by Komodo x64 1800X 3.6 GHz, 3564											
SF12NU 1800X       9-8     Stoc11 1800X     6,5-6,5   Stoc10 1800X    22,5-17,5
Ko14 1800X      26,5-13,5  Booot6 1800X    78,5-21,5  Arasa21 1800X     33-7 

 7 Komodo 14 x64 1800X 3.6 GHz, 3466											
SF12NU 1800X    12,5-27,5  Dragon 1800X    13,5-26,5  Stoc11 1800X      17-23
Stoc10 1800X      17-23    Stock8 1800X    20,5-19,5  Boo64 1800X       26-14
Booot6 1800X    24,5-15,5  Wasp4 1800X       34-6     

 17 Booot 6.4 x64 1800X 3.6 GHz, 3370											
Ko14 1800X        14-26    Stock8 1800X      16-24    Komo11 1800X    17,5-22,5
Booot6 1800X      43-37    Wasp4 1800X     28,5-11,5  Wasp201 1800X     30-10

 25 Wasp 4 x64 1800X 3.6 GHz, 3257											
Stoc10 1800X     6,5-33,5  Ko14 1800X         6-34    Boo64 1800X     11,5-28,5
Booot6 1800X      15-25    Arasa21 1800X   18,5-21,5  DHiar14 1800X   25,5-14,5

 29 Wasp 4 x64 Q6600 2.4 GHz, 3209											
Arasa21 Q6600   43,5-56,5  DRybka4 Q6600     19-21    Was35 Q6600     23,5-16,5
Spike14 Q6600     24-16    DFrit12 Q6600     29-11    DJuni12 Q6600   26,5-13,5
Arasa16 Q6600   34,5-5,5   

This is the last list of the pandemic year 2020 and features some new and
interesting entrants.

First out is team Stockfish with their latest edition of the Stockfish engine,
namely Stockfish 12. This version uses a neural network architecture (NNUE), 
which now can be run on ordinary processors instead of Graphic cards. It has 
been tested with the latest free opening-book of Fauzi Akram Dabat, named:
"Aggressive 4.7 by fauzi.abk". After the first 257 games, this strong combo, 
has achieved an impressive rating of 3573, an improvement of 26 points over 
the previous version, and it keeps the leader spot in our list!

Next one out is the Komodo version from Mark Lefler and Larry Kaufman, named
Komodo 14. This version was tested with the opening book of Erdogan Günes: 
"out5-35.bin", a book which we also have used previously when testing earlier 
Komodo-versions. Komodo 14 has achieved a rating of 3466 after 320 games.
It doesn't show a clear improvement over the earlier 13-versions we have
tested and positions itself between the 13.1 and 13.02 versions at the moment.
More testing will be needed to see if this will hold, or if it will gain some 
rating when more games are played.

We can also present another version of Komodo in this rating list, namely
the latest Komodo-version, called: Dragon by Komodo. This is the first Komodo
version which uses the NNUE-technique, and the gain in strength from the 
previous version is huge. After the first 250 games, its rating is 3564! 
This is 95 points over the 13.1 version and it now trails Stockfish with a 
margin of only 9 points. Dragon by Komodo has been tested with Erdogan 
Günes opening book: "out10-35.bin".

For this rating list we can also present the latest release of the Booot
engine by Alex Morozov, named Booot 6.4. We have been testing this engine 
with Sedat Canbaz opening book: "perfect2019.abk". After the first 280
games, the increase over the 6.3.1 version is 13 points, and the rating 
is now 3370.

We have also tested the engine: Wasp 4 by John Stanback for this rating 
list. We have tested it on both our hardware levels. We have used its own 
opening book for the testing. On our 1800X-platform it has achieved a 
rating of 3257 after the first 240 games. This is an improvement of 37 points
from the earlier 3.5-version. On our Q6600-platform it has gained a rating 
of 3209, and this is 40 points stronger than the Wasp 3.5-version which we 
tested on the same Q6600-hardware. 

Since last time, Revelation Deep Sjeng 3.0 gained 7 points. Notable losses 
was Millennium The King, which lost 16 points and Stockfish 11 which lost 
11 points.

We are at the moment testing the MCTS-version of Komodo, Fabio Gobbato's 
engine: Pedone, and we will hopefully also be able to present a rating 
of the old dedicated chess computer London 68020 on our next rating list.
 
Lars Sandin   
Lars Sandin, SSDF
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: THE SSDF RATING LIST 2020-12-31

Post by Vinvin »

Lars Sandin wrote: Sun Jan 03, 2021 8:08 am

Code: Select all

THE SSDF RATING LIST 2020-12-31    155019 games played by  397 computers		
...   
Hi Lars !
I completely overlooked your post. Sorry !
Thanks for this new list !!