20 Rounds/20 Engines

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

20 Rounds/20 Engines

Post by MikeB »

The engines:

Code: Select all

set eng1 = toga-3.3.ini
set eng2 = arasan.ini
set eng3 = shredder.ini
set eng4 = hiarcs-14.ini
set eng5 = texel.ini
set eng6 = protector-v1.9.ini
set eng7 = crafty-25.1.Syzy-0611d
set eng8 = hakka322.ini
set eng9 = senpai.ini
set eng10 = kohai-1.0.ini
set eng11 = Hawkeye-1.01.ini
set eng12 = Gull-3.0.ini
set eng13 = critter.ini
set eng14 = firenzina.ini
set eng15 = Mikhail-0.04.ini
set eng16 = Stockfish-DD.ini
set eng17 = SugaR.ini
set eng18 = stockfish7.ini
set eng19 = Stockfish-070916.ini
set eng20 = komodo-10.ini

Time control 75 sec base with 1.5 sec increment , 11 games played concurrently on a 12 Core Mac Pro.
3800 games in total - each engine will play 380 games.

10 positions will be selected at random from a 2500 opening database culled from the CCRL 40/40 pgn file for games that did not end in draw and had score of 40 to 65 centipawns after the first 8 moves.  Each position will be played by all engines against each opponent from both sides.
Live updates will be available every 45 minutes (after every 95 games are completed).

Results will be available here:
https://www.dropbox.com/s/gbg4zcyzpelx1 ... a.txt?dl=1


PGN file will be available here:
https://www.dropbox.com/s/hp83f9226v3iotr/all.pgn?dl=1

First results should start in about 45 minutes

Will be using the updated Bayeselo released earlier today (see http://talkchess.com/forum/viewtopic.php?t=60761 )

Code: Select all

Date: 07/10/16 : 01:27:04
30 game(s) loaded
Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   2 Komodo 10 64-bit          3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   3 Hawkeye 1.01 OSx64        3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   4 Stockfish DD 64 SSE4.2    3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   5 Senpai 1.0                3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   6 SugaR 2.5, a derivative   3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   7 Kohai 1.0                 3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   8 Gull 3 x64 (syzygy)       3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
   9 Firenzina 2.4.4 xTreme L  3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
  10 Stockfish 7 64 POPCNT     3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
  11 Critter 1.6a 64-bit       3200    1    1     2     2.0  100.0  3200     2     0     0    0.0 
  12 Protector 1.9.0           3200    1    1     1     1.0  100.0  3200     1     0     0    0.0 
  13 Mikhail 0.04 OSx 64       3200    1    1     2     1.5   75.0  3200     1     0     1   50.0 
  14 Arasan 19.0               3200    0    0    12     0.5    4.2  3200     0    11     1    8.3 
  15 Toga II 3.3               3200    0    0    18     3.0   16.7  3200     1    13     4   22.2 
  16 Texel 1.05 64-bit         3199    4    4     1     0.5   50.0  3200     0     0     1  100.0 
  17 Hakkapeliitta TCEC v2     3199    4    4     1     0.5   50.0  3200     0     0     1  100.0 
  18 Deep HIARCS 14 WCSC       3199    4    4     1     0.5   50.0  3200     0     0     1  100.0 
  19 Deep Shredder 12 x64      3199    4    4     1     0.5   50.0  3200     0     0     1  100.0 
  20 Crafty-25.1.Syzy-0611d    3199    1    1     1     0.0    0.0  3200     0     1     0    0.0 
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

Current results:

Code: Select all

1615 of 3800 games completed...
time control: 7500+150
Date: 07/10/16 : 13:33:12
1000 game(s) loaded1615 game(s) loaded
Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3494   50   50   158   130.5   82.6  3179   113    10    35   22.2 
   2 SugaR 2.5, a derivative   3488   50   50   157   130.5   83.1  3179   112     8    37   23.6 
   3 Komodo 10 64-bit          3473   49   49   157   128.5   81.8  3180   110    10    37   23.6 
   4 Stockfish 7 64 POPCNT     3432   47   47   157   123.0   78.3  3182   104    15    38   24.2 
   5 Hawkeye 1.01 OSx64        3361   43   43   157   110.0   70.1  3185    85    22    50   31.8 
   6 Stockfish DD 64 SSE4.2    3361   44   44   157   111.5   71.0  3185    87    21    49   31.2 
   7 Gull 3 x64 (syzygy)       3291   43   43   157    98.0   62.4  3189    76    37    44   28.0 
   8 Critter 1.6a 64-bit       3249   42   42   157    90.0   57.3  3191    66    43    48   30.6 
   9 Firenzina 2.4.4 xTreme L  3195   41   41   157    79.5   50.6  3194    51    49    57   36.3 
  10 Protector 1.9.0           3190   42   42   158    78.0   49.4  3196    58    60    40   25.3 
  11 Mikhail 0.04 OSx 64       3170   42   42   157    74.5   47.5  3195    51    59    47   29.9 
  12 Hakkapeliitta TCEC v2     3140   43   43   157    68.5   43.6  3197    53    73    31   19.7 
  13 Kohai 1.0                 3092   43   43   157    59.0   37.6  3199    36    75    46   29.3 
  14 Texel 1.05 64-bit         3090   41   41   174    62.5   35.9  3202    34    83    57   32.8 
  15 Senpai 1.0                3083   43   43   157    58.0   36.9  3199    37    78    42   26.8 
  16 Deep HIARCS 14 WCSC       3023   43   43   175    52.5   30.0  3204    32   102    41   23.4 
  17 Crafty-25.1.Syzy-0611d    3001   46   46   157    44.5   28.3  3204    27    95    35   22.3 
  18 Deep Shredder 12 x64      2986   44   44   175    44.5   25.4  3206    24   110    41   23.4 
  19 Arasan 19.0               2958   45   45   174    37.5   21.6  3209    15   114    45   25.9 
  20 Toga II 3.3               2922   47   47   175    34.0   19.4  3210    18   125    32   18.3 

Live Results are available here every 45 minutes to so. Next update in about 30 minutes:
https://www.dropbox.com/s/gbg4zcyzpelx1 ... a.txt?dl=1


PGN file is available here, updated every time the results are updated:
https://www.dropbox.com/s/hp83f9226v3iotr/all.pgn?dl=1
jdart
Posts: 4433
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: 20 Rounds/20 Engines

Post by jdart »

What is Toga II 3.3? I have seen a 3.0 release but not 3.3.

--Jon
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

jdart wrote:What is Toga II 3.3? I have seen a 3.0 release but not 3.3.

--Jon
haha - I have no clue. It was something sitting in my engine file that I was working on last year. Was looking for one more or engine to make it 20 engines so I thought why not. Let's just call Toga 3 with an extra " dot 3" 8-) .

All engines here are native Mac engines.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

The next of set of 18 game between SF and K will decide who has 1st place honors at the halfway point:

Code: Select all

Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3497   48   48   170   141.5   83.2  3183   123    10    37   21.8 
   2 Komodo 10 64-bit          3482   47   47   170   141.0   82.9  3183   122    10    38   22.4 
   3 SugaR 2.5, a derivative   3478   43   43   188   154.5   82.2  3182   129     8    51   27.1 
   4 Stockfish 7 64 POPCNT     3429   42   42   188   146.0   77.7  3185   122    18    48   25.5 
   5 Stockfish DD 64 SSE4.2    3345   39   39   188   129.0   68.6  3189    98    28    62   33.0 
   6 Hawkeye 1.01 OSx64        3343   38   38   188   127.5   67.8  3189    93    26    69   36.7 
   7 Gull 3 x64 (syzygy)       3286   38   38   188   115.0   61.2  3192    88    46    54   28.7 
   8 Critter 1.6a 64-bit       3256   37   37   188   108.0   57.4  3194    75    47    66   35.1 
   9 Firenzina 2.4.4 xTreme L  3200   37   37   188    94.5   50.3  3197    59    58    71   37.8 
  10 Protector 1.9.0           3199   38   38   188    94.0   50.0  3197    68    68    52   27.7 
  11 Mikhail 0.04 OSx 64       3159   38   38   188    85.5   45.5  3199    57    74    57   30.3 
  12 Hakkapeliitta TCEC v2     3141   38   38   188    81.0   43.1  3200    60    86    42   22.3 
  13 Texel 1.05 64-bit         3100   38   38   188    70.5   37.5  3202    38    85    65   34.6 
  14 Kohai 1.0                 3087   38   38   188    68.0   36.2  3203    38    90    60   31.9 
  15 Senpai 1.0                3072   39   39   188    65.0   34.6  3204    39    97    52   27.7 
  16 Deep HIARCS 14 WCSC       3031   40   40   188    58.0   30.9  3206    34   106    48   25.5 
  17 Crafty-25.1.Syzy-0611d    3017   41   41   188    55.0   29.3  3207    33   111    44   23.4 
  18 Deep Shredder 12 x64      2996   41   41   188    50.0   26.6  3208    27   115    46   24.5 
  19 Arasan 19.0               2961   42   42   188    41.5   22.1  3210    15   120    53   28.2 
  20 Toga II 3.3               2920   44   44   188    36.5   19.4  3212    19   134    35   18.6 
An interesting moment, if they split the 18 games 50-50 , that would propel SugaR into first place. EDIT - not true - forgot about the games with the other engines, SugaR cannot finish in first , unless SF and K lose a bunch of game , almost all, to the other engines.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

If K blitz's the other 11 engines in the last 11 games, it will be in the lead based points by the slimmest of margins:

Code: Select all

Date: 07/10/16 : 15:44:48
1000 game(s) loaded
1889 game(s) loaded

Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3485   44   44   190   155.0   81.6  3185   133    13    44   23.2 
   2 SugaR 2.5, a derivative   3483   43   43   190   156.5   82.4  3185   131     8    51   26.8 
   3 Komodo 10 64-bit          3479   45   45   179   146.0   81.6  3191   126    13    40   22.3 
   4 Stockfish 7 64 POPCNT     3431   41   41   190   147.5   77.6  3188   123    18    49   25.8 
   5 Stockfish DD 64 SSE4.2    3347   39   39   189   130.0   68.8  3191    99    28    62   32.8 
   6 Hawkeye 1.01 OSx64        3339   38   38   190   127.5   67.1  3193    93    28    69   36.3 
   7 Gull 3 x64 (syzygy)       3287   38   38   189   115.5   61.1  3194    88    46    55   29.1 
   8 Critter 1.6a 64-bit       3258   37   37   190   109.0   57.4  3197    76    48    66   34.7 
   9 Protector 1.9.0           3201   37   37   189    94.5   50.0  3198    68    68    53   28.0 
  10 Firenzina 2.4.4 xTreme L  3198   37   37   190    94.5   49.7  3200    59    60    71   37.4 
  11 Mikhail 0.04 OSx 64       3161   37   37   190    86.0   45.3  3202    57    75    58   30.5 
  12 Hakkapeliitta TCEC v2     3140   38   38   189    81.0   42.9  3202    60    87    42   22.2 
  13 Texel 1.05 64-bit         3099   38   38   189    70.5   37.3  3204    38    86    65   34.4 
  14 Kohai 1.0                 3089   38   38   190    68.5   36.1  3206    38    91    61   32.1 
  15 Senpai 1.0                3071   39   39   189    65.0   34.4  3205    39    98    52   27.5 
  16 Deep HIARCS 14 WCSC       3031   40   40   189    58.0   30.7  3207    34   107    48   25.4 
  17 Crafty-25.1.Syzy-0611d    3016   41   41   189    55.0   29.1  3208    33   112    44   23.3 
  18 Deep Shredder 12 x64      2999   41   41   189    50.5   26.7  3209    27   115    47   24.9 
  19 Arasan 19.0               2965   41   41   189    42.0   22.2  3211    15   120    54   28.6 
  20 Toga II 3.3               2920   44   44   189    36.5   19.3  3213    19   135    35   18.5 
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

sometimes I find bayeselo very confusing with the ratings :

anyway - this was not a ratings contest - at the 1/2 way point:

in first place is SugaR with 156.5 points
K and SF are right behind tied for second with 155 points each

Code: Select all

1900 of 3800 games completed...
time control: 7500+150
Date: 07/10/16 : 15:49:51
1000 game(s) loaded
1900 game(s) loaded

Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3485   44   44   190   155.0   81.6  3185   133    13    44   23.2 
   2 SugaR 2.5, a derivative   3483   43   43   190   156.5   82.4  3185   131     8    51   26.8 
   3 Komodo 10 64-bit          3476   43   43   190   155.0   81.6  3185   133    13    44   23.2 
   4 Stockfish 7 64 POPCNT     3431   41   41   190   147.5   77.6  3188   123    18    49   25.8 
   5 Stockfish DD 64 SSE4.2    3347   38   38   190   130.5   68.7  3192    99    28    63   33.2 
   6 Hawkeye 1.01 OSx64        3339   38   38   190   127.5   67.1  3193    93    28    69   36.3 
   7 Gull 3 x64 (syzygy)       3288   38   38   190   116.0   61.1  3195    88    46    56   29.5 
   8 Critter 1.6a 64-bit       3258   37   37   190   109.0   57.4  3197    76    48    66   34.7 
   9 Protector 1.9.0           3200   37   37   190    94.5   49.7  3200    68    69    53   27.9 
  10 Firenzina 2.4.4 xTreme L  3198   37   37   190    94.5   49.7  3200    59    60    71   37.4 
  11 Mikhail 0.04 OSx 64       3161   37   37   190    86.0   45.3  3202    57    75    58   30.5 
  12 Hakkapeliitta TCEC v2     3140   38   38   190    81.0   42.6  3203    60    88    42   22.1 
  13 Texel 1.05 64-bit         3099   38   38   190    70.5   37.1  3205    38    87    65   34.2 
  14 Kohai 1.0                 3089   38   38   190    68.5   36.1  3206    38    91    61   32.1 
  15 Senpai 1.0                3071   39   39   190    65.0   34.2  3207    39    99    52   27.4 
  16 Deep HIARCS 14 WCSC       3030   40   40   190    58.0   30.5  3209    34   108    48   25.3 
  17 Crafty-25.1.Syzy-0611d    3019   40   40   190    55.5   29.2  3210    33   112    45   23.7 
  18 Deep Shredder 12 x64      3002   41   41   190    51.0   26.8  3210    27   115    48   25.3 
  19 Arasan 19.0               2964   41   41   190    42.0   22.1  3212    15   121    54   28.4 
  20 Toga II 3.3               2920   44   44   190    36.5   19.2  3215    19   136    35   18.4 
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

K is inching out a lead , but still very tight as only 3 and a half points separate the top 3 after 266 games.
Current results:

Code: Select all

2660 of 3800 games completed...
time control: 7500+150
Date: 07/10/16 : 21:36:42
1000 game(s) loaded
2000 game(s) loaded
2660 game(s) loaded

Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Komodo 10 64-bit          3445   33   33   266   213.5   80.3  3187   175    14    77   28.9 
   2 Stockfish 070916-x        3436   33   33   266   210.0   78.9  3188   168    14    84   31.6 
   3 SugaR 2.5, a derivative   3431   32   32   266   210.5   79.1  3188   165    10    91   34.2 
   4 Stockfish 7 64 POPCNT     3409   32   32   266   203.5   76.5  3189   161    20    85   32.0 
   5 Hawkeye 1.01 OSx64        3329   30   30   266   177.0   66.5  3193   125    37   104   39.1 
   6 Stockfish DD 64 SSE4.2    3323   30   30   266   177.0   66.5  3194   126    38   102   38.3 
   7 Gull 3 x64 (syzygy)       3298   29   29   266   167.0   62.8  3195   120    52    94   35.3 
   8 Critter 1.6a 64-bit       3256   29   29   266   152.5   57.3  3197    96    57   113   42.5 
   9 Firenzina 2.4.4 xTreme L  3218   29   29   266   138.5   52.1  3199    84    73   109   41.0 
  10 Protector 1.9.0           3192   29   29   266   129.5   48.7  3200    83    90    93   35.0 
  11 Mikhail 0.04 OSx 64       3179   29   29   266   125.5   47.2  3201    75    90   101   38.0 
  12 Hakkapeliitta TCEC v2     3146   30   30   266   114.0   42.9  3203    78   116    72   27.1 
  13 Texel 1.05 64-bit         3119   29   29   266   103.5   38.9  3204    54   113    99   37.2 
  14 Kohai 1.0                 3112   30   30   266   101.5   38.2  3205    56   119    91   34.2 
  15 Senpai 1.0                3107   30   30   266    98.5   37.0  3205    54   123    89   33.5 
  16 Crafty-25.1.Syzy-0611d    3033   32   32   266    77.5   29.1  3209    40   151    75   28.2 
  17 Deep HIARCS 14 WCSC       3031   32   32   266    77.5   29.1  3209    39   150    77   28.9 
  18 Deep Shredder 12 x64      3015   32   32   265    71.5   27.0  3209    32   154    79   29.8 
  19 Arasan 19.0               2962   33   33   266    54.5   20.5  3213    16   173    77   28.9 
  20 Toga II 3.3               2957   34   34   267    57.0   21.3  3214    29   182    56   21.0

Live Results are available here every 45 minutes to so. Next update in about 30 minutes:
https://www.dropbox.com/s/gbg4zcyzpelx1 ... a.txt?dl=1


PGN file is available here, updated every time the results are updated:
https://www.dropbox.com/s/hp83f9226v3iotr/all.pgn?dl=1
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Rounds/20 Engines

Post by MikeB »

Amazing how close S&K are..

current:

Code: Select all

time control: 7500+150
Date: 07/11/16 : 00:52:56
1000 game(s) loaded
2000 game(s) loaded
3000 game(s) loaded
3040 game(s) loaded

Rank Name                       Elo    +    - Games   Score    SC%  OppR   Won  Lost  Draw    EQ% 
   1 Stockfish 070916-x        3441   30   30   304   242.5   79.8  3187   196    15    93   30.6 
   2 Komodo 10 64-bit          3439   30   30   302   241.0   79.8  3189   196    16    90   29.8 
   3 SugaR 2.5, a derivative   3425   29   29   305   240.5   78.9  3187   187    11   107   35.1 
   4 Stockfish 7 64 POPCNT     3399   29   29   305   231.0   75.7  3189   180    23   102   33.4 
   5 Hawkeye 1.01 OSx64        3327   27   27   304   202.0   66.4  3193   143    43   118   38.8 
   6 Stockfish DD 64 SSE4.2    3322   27   27   304   202.5   66.6  3194   142    41   121   39.8 
   7 Gull 3 x64 (syzygy)       3295   27   27   304   190.5   62.7  3195   136    59   109   35.9 
   8 Critter 1.6a 64-bit       3257   26   26   304   175.0   57.6  3197   109    63   132   43.4 
   9 Firenzina 2.4.4 xTreme L  3215   26   26   304   157.5   51.8  3199    92    81   131   43.1 
  10 Protector 1.9.0           3189   27   27   304   146.5   48.2  3201    91   102   111   36.5 
  11 Mikhail 0.04 OSx 64       3179   27   27   304   143.5   47.2  3201    83   100   121   39.8 
  12 Hakkapeliitta TCEC v2     3147   27   27   304   131.0   43.1  3203    88   130    86   28.3 
  13 Kohai 1.0                 3121   27   27   304   118.5   39.0  3204    62   129   113   37.2 
  14 Texel 1.05 64-bit         3112   27   27   304   115.5   38.0  3205    57   130   117   38.5 
  15 Senpai 1.0                3102   27   27   304   111.0   36.5  3205    57   139   108   35.5 
  16 Crafty-25.1.Syzy-0611d    3037   29   29   304    89.0   29.3  3209    45   171    88   28.9 
  17 Deep HIARCS 14 WCSC       3023   29   29   304    85.0   28.0  3209    41   175    88   28.9 
  18 Deep Shredder 12 x64      3016   29   29   303    81.0   26.7  3209    34   175    94   31.0 
  19 Toga II 3.3               2977   31   31   305    70.5   23.1  3212    35   199    71   23.3 
  20 Arasan 19.0               2977   30   30   304    66.0   21.7  3212    18   190    96   31.6