THE SSDF RATING LIST 2021-07-28

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2021-07-28

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2021-07-28    156884 games played by  406 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.26.3 Cuda(67362) 3060Ti           3581   41   -39   320   64%  3479
   2 Stockfish 13 x64 1800X 3.6 GHz          3573   44   -40   320   70%  3428
   3 Stockfish 12 NNUE x64 1800X 3.6 GHz     3568   32   -30   520   64%  3468
   4 Dragon by Komodo x64 1800X 3.6 GHz      3557   34   -32   460   63%  3457
   5 Stockfish 11 x64 1800X 3.6 GHz          3545   36   -34   450   70%  3399
   6 Stockfish 10 x64 1800X 3.6 GHz          3520   25   -24   880   68%  3384
   7 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3503   54   -55   160   49%  3499
   8 Stockfish 9 x64 1800X 3.6 GHz           3480   26   -24   882   70%  3334
   9 Komodo 13.1 x64 1800X 3.6 GHz           3468   30   -29   560   62%  3385
  10 Komodo 13.02 x64 1800X 3.6 GHz          3461   30   -29   600   65%  3350
  11 Komodo 14 x64 1800X 3.6 GHz             3461   34   -34   400   52%  3449
  12 Komodo 12.3 x64 1800X 3.6 GHz           3451   27   -26   760   66%  3333
  13 Stockfish 9 x64 Q6600 2.4 GHz           3443   32   -31   480   56%  3399
  14 Komodo 12.3 x64 Q6600 2.4 GHz           3431   36   -34   400   61%  3355
  15 Stockfish 8 x64 1800X 3.6 GHz           3425   20   -19  1440   71%  3269
  16 Dragon Komodo MCTS x64 1800X 3.6 GHz    3420   41   -41   280   52%  3413
  17 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz    3417   50   -48   200   56%  3374
  18 Stockfish 8 x64 Q6600 2.4 GHz           3409   31   -30   560   65%  3299
  19 Pedone 3 x64 1800X 3.6 GHz              3399   44   -45   240   43%  3442
  20 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3397   31   -30   520   57%  3345
  21 Booot 6.4 x64 1800X 3.6 GHz             3368   36   -36   360   51%  3365
  22 Deep Shredder 13 x64 1800X 3.6 GHz      3356   24   -24   880   64%  3255
  23 Pedone 3 x64 Q6600 2.4 GHz              3317   51   -48   200   60%  3248
  24 Pedone 2.1 x64 1800X 3.6 GHz            3305   42   -46   280   32%  3420
  25 Vajolet2 2.8 x64 1800X 3.6 GHz          3294   27   -28   650   38%  3377
  26 Arasan 21.2 x64 1800X 3.6 GHz           3291   25   -26   800   36%  3388
  27 Wasp 4 x64 1800X 3.6 GHz                3265   42   -45   280   33%  3376
  28 Pedone 2.1 x64 Q6600 2.4 GHz            3222   46   -44   240   59%  3159
  29 Deep Hiarcs 14 1800X 3.6 GHz            3218   24   -25   840   38%  3298
  30 Deep Rybka 4 x64 Q6600 2.4 GHz          3198   19   -18  1448   64%  3100
  31 Chiron 3.01 x64 Q6600 2.4 GHz           3177   27   -27   656   45%  3214
  32 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  33 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -22  1010   42%  3183
  34 Spike 1.4 Q6600 2.4 GHz                 3106   15   -15  2031   52%  3094
  35 Hiarcs 14 Athlon 1.2 GHz                3099   29   -29   560   55%  3064
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2883
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3008
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2771   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2705   60   -58   140   56%  2665
  41 Revelation Rybka 2.2 PXA255 500 MHz     2633   45   -43   260   63%  2545
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2598   62   -67   120   41%  2662
  43 Millennium The King Exclusive 300 MHz   2524   55   -53   164   55%  2492
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2347   68   -71   100   45%  2384
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   54   -51   180   59%  2183
  46 Mephisto London 68030 33 MHz            2194   31   -31   482   50%  2191
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2103   73   -64   115   67%  1984
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2016
  50 Mephisto London 68000 12 MHz            2005   59   -58   140   53%  1981

 1 Lc0 0.26.3 Cuda(67362) 3060Ti, 3581											
Stoc13 1800X      20-20    SF12NU 1800X    20,5-19,5  Dragon 1800X      21-19
Dra2MC 1800X      25-15    Stock9 1800X      25-15    Ko14 1800X        27-13
Ped3 1800X        33-7     Arasa21 1800X     33-7     

 2 Stockfish 13 x64 1800X 3.6 GHz, 3573											
LC0 3060Ti        20-20    SF12NU 1800X      20-20    Dragon 1800X      22-18
Komo11 1800X    29,5-10,5  Boo64 1800X     33,5-6,5   Booot6 1800X      31-9 
Ped21 1800X       35-5     Arasa21 1800X   34,5-5,5   

 7 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz, 3503											
LC0 3060Ti        15-25    SF12NU 1800X    15,5-24,5  Stock8 1800X      23-17
Dra MC 1800X    24,5-15,5  

 16 Dragon Komodo MCTS x64 1800X 3.6 GHz, 3420											
SF12NU 1800X    14,5-25,5  Dragon 1800X      16-24    Dra2MC 1800X    15,5-24,5
Ped3 1800X        20-20    Ped21 1800X     26,5-13,5  Arasa21 1800X     23-17
Wasp4 1800X     29,5-10,5  

 19 Pedone 3 x64 1800X 3.6 GHz, 3399											
LC0 3060Ti         7-33    SF12NU 1800X      11-29    Dragon 1800X    12,5-27,5
Dra MC 1800X      20-20    Ped21 1800X       22-18    DHiar14 1800X   31,5-8,5 

 23 Pedone 3 x64 Q6600 2.4 GHz, 3317											
Komo12 Q6600      15-25    DShre13 Q6600     17-23    Vaj28 Q6600       27-13
Ped21 Q6000       24-16    DShre11 Q6600   36,5-3,5   

 24 Pedone 2.1 x64 1800X 3.6 GHz, 3305											
Stoc13 1800X       5-35    SF12NU 1800X       5-35    Ko14 1800X         9-31
Dra MC 1800X    13,5-26,5  Ped3 1800X        18-22    Boo64 1800X     12,5-27,5
Wasp201 1800X     27-13    

 28 Pedone 2.1 x64 Q6600 2.4 GHz, 3222											
Ped3 Q6600        16-24    DShre13 Q6600    9,5-30,5  Wasp4 Q6600       24-16
Hia13.2 Q6600     28-12    Craf25 Q6600    33,5-6,5   DShre11 Q6600     30-10

 48 Mephisto London 68020 12 MHz, 2103											
MCG Ex           5,5-14,5  MCG               12-8     Star Sapphire   13,5-6,5 
Sapphire II      1,5-2,5   Diablo 68000       9-2     Polgar 5 MHz      17-3 
Rebell 5 MHz      18-2     

For this summer rating list we are able to present 9 new entrants.

First one out is also the first chess program we have ever tested for the 
rating list which have utilized a graphic card. The new number one on this
rating list is Leela Chess Zero, which have recieved an impressive rating of
3581 after 320 games played. We have tested Leela Chess Zero with a  
Nvidia RTX 3060 Ti graphic card. We have used the Lc0 0.26.3 version and have
used the 30 blocks x 384 filter net with the number 67362. As opening book we
have used the free "Perfect2021.abk" opening book by Sedat Canbaz.

Trailing just 8 points below, with a rating of 3573 after 320 played games,
is the 13th version of Stockfish. Like its former version, it uses 
neural network architecture (NNUE). We have chosen to omit 
the NNUE-nomenclature from the name, since NNUE is the default and strongest
setting. We have used the latest free opening book by Fauzi Akram Dabat for 
the testing of Stockfish 13 and it is named "Aggressive 4.9 by Fauzi.abk". 

In this rating list we can also present two new MCTS-versions of Komodo, both
utilizing the NNUE-technology. The first one which we tested was 
Dragon Komodo (1) MCTS, and due to some difficulties with the AVX2 version, 
we had to test the non-AVX2 version of Dragon Komodo (1) MCTS. 
After 280 played games and with a rating of 3420, it has positioned itself 
3 points ahead of its 13.2.5-version, which was non-NNUE, and also 137 points 
below its non-MCTS version of Dragon Komodo (1). The gap between the two 
(non-MCTS/MCTS) was not as significant when we tested the 13.02 version of 
Komodo, and back then it was 64 points between the two versions.

We have also tested the new Dragon Komodo 2 MCTS-version from Mark Lefler and
Larry Kaufman. This version seems to perform better and we have also have had
no problems in getting the AVX2 version to work this time. It is relatively 
early on in the testing, but Dragon Komodo 2 MCTS has recieved a rating of 3503
after the first 160 games played. This makes it 83 points stronger than the 
first version and also just 54 points shy of its non-MCTS version of Dragon
Komodo (1). We have used the same opening book for the testing of both
Dragon Komodo MCTS-versions, namely Erdogan Günes opening book "out10-35.bin".

On this rating list we can also present four new entrants from Fabio Gobbato,
tested on both the 1800X and Q6600 hardware levels. First one we tested was the
Pedone 2.1 version. This version was non-NNUE and has managed to get a rating 
of 3222 after 240 games on our Q6600 level. On our 1800X level, it has recieved
a rating of 3305 after 280 played games. The difference between the two hardware
levels is 83 points. 

Next one out was the Pedone 3.0 version, which uses NNUE in its search. Likewise 
with other NNUE-programs on the list, we have chosen to omit the NNUE-nomenclature, 
since this is the strongest setting for their respective versions. Pedone 3.0 has
recieved a rating of 3399 after 240 games played on our 1800X level, and a rating
of 3317 after 200 games played on the Q6600 level. The difference between the two 
hardware levels are nearly the same as the 2.1 version and it is 82 points.
The gap between the non-NNUE version of 2.1 and the NNUE-version of 3.0, is 
95 points for the Q6600-level and 94 points for the 1800X-level! We have used 
Pedones own opening book for the testing of version 2.1 and 3.0.  

Last one out is an oldie which at last has managed to get on the rating list 
with some manual testing. The dedicated chess computer Mephisto London 68020 
at 12 MHz, is a module which can be used in Mephistos modular boards. The modular
boards included the Modular/Exclusive/München and Bavaria wooden chess boards.
The software in the London 68020 is the Genius 3.0 program by Richard Lang, which
on a PC (Pentium 90 MHz) managed to beat Garry Kasparov in a rapid game 1994 in 
London. After the first 115 games, London 68020 has managed to get a rating 
of 2103. This is nearly 100 points stronger than the 68000-version and also 91
points weaker than the London 68030 version at 33 MHz. It trails the Mephisto
Berlin Pro 68020 at 24 MHz, with 25 points, but it is the second strongest 68020
program we have ever tested, 39 points ahead of its Vancouver 68020-version. 

We are at the moment testing several different programs which barely missed
this rating list, but will feature in the upcoming rating list which we plan
to release as soon as they have enough games to be presented. Hopefully our
next list will be out sometime in the autumn. 

Lars Sandin
Lars Sandin, SSDF
mehmet123
Posts: 670
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: THE SSDF RATING LIST 2021-07-28

Post by mehmet123 »

Thanks for the list. It was a surprise for me to see Lc0 at the top because 3060Ti isn't as strong as RTX 3080 or RTX 3090.