FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by fastgm »

FGRL rating list - 60 min + 15 sec

Minic 2.00 (New: 2952)

FGRL rating list - 16 cores

1. Lc0 0.24.1 Leelenstein 14.2

Code: Select all

   # Engine                            :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
 -------------------------------------------------------------------------------------------------------------------
   1 Lc0 0.24.1 LS 14.2                :   3470     11    2500    1967.0   78.68   1505    924     71   36.96    93
   2 Lc0 0.24.0 LS 14                  :   3459      9    3500    2677.0   76.49   1964   1426    110   40.74    93
   3 Lc0k 0.23.2 256x20-T40-1541       :   3450      8    3500    2645.5   75.59   1932   1427    141   40.77   100
   4 Fat Fritz 1.1                     :   3431      9    3250    2453.0   75.48   1808   1290    152   39.69    57
   5 Lc0 0.24.1 384x30-T60-3010        :   3430     10    2750    2089.5   75.98   1514   1151     85   41.85    75
   6 Lc0 0.22.0 T40B.4-160             :   3425      8    3750    2705.0   72.13   1875   1660    215   44.27    56
   7 Stockfish 11 C0                   :   3425      7    3500    1796.0   51.31    502   2588    410   73.94    69
   8 Lc0 0.22.0 42850                  :   3422      8    3750    2691.5   71.77   1874   1635    241   43.60    72
   9 Stockfish 11                      :   3419      7    4000    2157.5   53.94    777   2761    462   69.03    99
  10 Lc0k 0.23.2 62172                 :   3404     10    2500    1827.0   73.08   1256   1142    102   45.68    53
  11 Lc0 LS-LS 12.2                    :   3403      8    3500    2481.0   70.89   1655   1652    193   47.20    77
  12 Lc0 0.22.0 J13B.2-188             :   3399      8    3750    2598.5   69.29   1702   1793    255   47.81    67
  13 Lc0 LS-LS 12.1                    :   3396      8    3000    2056.0   68.53   1299   1514    187   50.47    51
  14 Lc0k 0.23.2 384x30-T40-2036       :   3396      8    3500    2454.5   70.13   1681   1547    272   44.20    98
  15 Fat Fritz 1.0                     :   3383      9    3000    2012.0   67.07   1311   1402    287   46.73    88
  16 Lc0 0.22.0 32930                  :   3376      7    3750    2503.0   66.75   1592   1822    336   48.59    59
  17 Lc0 0.22.0 LS 12 preview          :   3375      9    2750    1876.0   68.22   1258   1236    256   44.95    57
  18 Stockfish 10                      :   3373      8    2750    1337.5   48.64    428   1819    503   66.15    67
  19 Lc0 0.23.2 61950                  :   3371      7    3750    2482.0   66.19   1550   1864    336   49.71    64
  20 Lc0 0.23.2 58613+                 :   3369     10    2500    1750.0   70.00   1200   1100    200   44.00    71
  21 Lc0 0.22.0 384x30-T40-1573        :   3365      9    2750    1846.0   67.13   1220   1252    278   45.53   100
  22 Lc0 0.22.0 11260                  :   3336      9    2750    1755.5   63.84   1044   1423    283   51.75    98
  23 Houdini 6.03                      :   3325      6    5000    2015.0   40.30    526   2978   1496   59.56    65
  24 Komodo 13.3                       :   3323      8    3000    1111.5   37.05    251   1721   1028   57.37   100
  25 Komodo 13.2.5                     :   3308      7    4500    1749.5   38.88    503   2493   1504   55.40   100
  26 Scorpio 3.07 NN-ens-net-20x256    :   3278      9    2500    1466.5   58.66    855   1223    422   48.92   100
  27 Ethereal 12.00                    :   3226      9    3000     769.5   25.65    142   1255   1603   41.83   100
  28 Xiphos 0.6                        :   3208      7    5000    1310.0   26.20    210   2200   2590   44.00    67
  29 Ethereal 11.75                    :   3206      7    4500    1196.0   26.58    210   1972   2318   43.82    86
  30 Fire 7.1                          :   3200      7    5000    1268.0   25.36    252   2032   2716   40.64   100
  31 Booot 6.4                         :   3137     11    3000     521.0   17.37     61    920   2019   30.67    80
  32 Laser 1.7                         :   3132      8    5000     944.0   18.88    161   1566   3273   31.32    94
  33 Andscacs 0.95                     :   3122      8    5000     903.0   18.06    167   1472   3361   29.44   100
  34 Deep Shredder 13                  :   3100      9    5000     818.0   16.36    114   1408   3478   28.16    83
  35 Booot 6.3.1                       :   3094      9    4750     767.0   16.15    118   1298   3334   27.33   ---

White advantage = 60.83 +/- 1.00
Draw rate (equal opponents) = 64.64 % +/- 0.28

Games        : 63.000 (finished)

White Wins   : 21.371 (33.9 %)
Black Wins   : 13.146 (20.9 %)
Draws        : 28.483 (45.2 %)

White Score  : 56.5 %
Black Score  : 43.5 %
http://www.fastgm.de
User avatar
xr_a_y
Posts: 1871
Joined: Sat Nov 25, 2017 2:28 pm
Location: France

Re: FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by xr_a_y »

thanks for testing at LTC !
MMarco
Posts: 195
Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante

Re: FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by MMarco »

fastgm wrote: Wed Apr 22, 2020 8:09 pm FGRL rating list - 60 min + 15 sec

Minic 2.00 (New: 2952)

FGRL rating list - 16 cores

1. Lc0 0.24.1 Leelenstein 14.2

Code: Select all

   # Engine                            :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
 -------------------------------------------------------------------------------------------------------------------
   1 Lc0 0.24.1 LS 14.2                :   3470     11    2500    1967.0   78.68   1505    924     71   36.96    93
   2 Lc0 0.24.0 LS 14                  :   3459      9    3500    2677.0   76.49   1964   1426    110   40.74    93
   3 Lc0k 0.23.2 256x20-T40-1541       :   3450      8    3500    2645.5   75.59   1932   1427    141   40.77   100
   4 Fat Fritz 1.1                     :   3431      9    3250    2453.0   75.48   1808   1290    152   39.69    57
   5 Lc0 0.24.1 384x30-T60-3010        :   3430     10    2750    2089.5   75.98   1514   1151     85   41.85    75
   6 Lc0 0.22.0 T40B.4-160             :   3425      8    3750    2705.0   72.13   1875   1660    215   44.27    56
   7 Stockfish 11 C0                   :   3425      7    3500    1796.0   51.31    502   2588    410   73.94    69
   8 Lc0 0.22.0 42850                  :   3422      8    3750    2691.5   71.77   1874   1635    241   43.60    72
   9 Stockfish 11                      :   3419      7    4000    2157.5   53.94    777   2761    462   69.03    99
  10 Lc0k 0.23.2 62172                 :   3404     10    2500    1827.0   73.08   1256   1142    102   45.68    53
  11 Lc0 LS-LS 12.2                    :   3403      8    3500    2481.0   70.89   1655   1652    193   47.20    77
  12 Lc0 0.22.0 J13B.2-188             :   3399      8    3750    2598.5   69.29   1702   1793    255   47.81    67
  13 Lc0 LS-LS 12.1                    :   3396      8    3000    2056.0   68.53   1299   1514    187   50.47    51
  14 Lc0k 0.23.2 384x30-T40-2036       :   3396      8    3500    2454.5   70.13   1681   1547    272   44.20    98
  15 Fat Fritz 1.0                     :   3383      9    3000    2012.0   67.07   1311   1402    287   46.73    88
  16 Lc0 0.22.0 32930                  :   3376      7    3750    2503.0   66.75   1592   1822    336   48.59    59
  17 Lc0 0.22.0 LS 12 preview          :   3375      9    2750    1876.0   68.22   1258   1236    256   44.95    57
  18 Stockfish 10                      :   3373      8    2750    1337.5   48.64    428   1819    503   66.15    67
  19 Lc0 0.23.2 61950                  :   3371      7    3750    2482.0   66.19   1550   1864    336   49.71    64
  20 Lc0 0.23.2 58613+                 :   3369     10    2500    1750.0   70.00   1200   1100    200   44.00    71
  21 Lc0 0.22.0 384x30-T40-1573        :   3365      9    2750    1846.0   67.13   1220   1252    278   45.53   100
  22 Lc0 0.22.0 11260                  :   3336      9    2750    1755.5   63.84   1044   1423    283   51.75    98
  23 Houdini 6.03                      :   3325      6    5000    2015.0   40.30    526   2978   1496   59.56    65
  24 Komodo 13.3                       :   3323      8    3000    1111.5   37.05    251   1721   1028   57.37   100
  25 Komodo 13.2.5                     :   3308      7    4500    1749.5   38.88    503   2493   1504   55.40   100
  26 Scorpio 3.07 NN-ens-net-20x256    :   3278      9    2500    1466.5   58.66    855   1223    422   48.92   100
  27 Ethereal 12.00                    :   3226      9    3000     769.5   25.65    142   1255   1603   41.83   100
  28 Xiphos 0.6                        :   3208      7    5000    1310.0   26.20    210   2200   2590   44.00    67
  29 Ethereal 11.75                    :   3206      7    4500    1196.0   26.58    210   1972   2318   43.82    86
  30 Fire 7.1                          :   3200      7    5000    1268.0   25.36    252   2032   2716   40.64   100
  31 Booot 6.4                         :   3137     11    3000     521.0   17.37     61    920   2019   30.67    80
  32 Laser 1.7                         :   3132      8    5000     944.0   18.88    161   1566   3273   31.32    94
  33 Andscacs 0.95                     :   3122      8    5000     903.0   18.06    167   1472   3361   29.44   100
  34 Deep Shredder 13                  :   3100      9    5000     818.0   16.36    114   1408   3478   28.16    83
  35 Booot 6.3.1                       :   3094      9    4750     767.0   16.15    118   1298   3334   27.33   ---

White advantage = 60.83 +/- 1.00
Draw rate (equal opponents) = 64.64 % +/- 0.28

Games        : 63.000 (finished)

White Wins   : 21.371 (33.9 %)
Black Wins   : 13.146 (20.9 %)
Draws        : 28.483 (45.2 %)

White Score  : 56.5 %
Black Score  : 43.5 %
http://www.fastgm.de
I find your lists very interesting, very well done.

Regarding the 16 cores one, why is that that Stockfish's draw rate is so much higher than the one's of the Lc0's, or even other AB engines?
Raphexon
Posts: 476
Joined: Sun Mar 17, 2019 12:00 pm
Full name: Henk Drost

Re: FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by Raphexon »

MMarco wrote: Thu Apr 23, 2020 2:48 pm
fastgm wrote: Wed Apr 22, 2020 8:09 pm FGRL rating list - 60 min + 15 sec

Minic 2.00 (New: 2952)

FGRL rating list - 16 cores

1. Lc0 0.24.1 Leelenstein 14.2

Code: Select all

   # Engine                            :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
 -------------------------------------------------------------------------------------------------------------------
   1 Lc0 0.24.1 LS 14.2                :   3470     11    2500    1967.0   78.68   1505    924     71   36.96    93
   2 Lc0 0.24.0 LS 14                  :   3459      9    3500    2677.0   76.49   1964   1426    110   40.74    93
   3 Lc0k 0.23.2 256x20-T40-1541       :   3450      8    3500    2645.5   75.59   1932   1427    141   40.77   100
   4 Fat Fritz 1.1                     :   3431      9    3250    2453.0   75.48   1808   1290    152   39.69    57
   5 Lc0 0.24.1 384x30-T60-3010        :   3430     10    2750    2089.5   75.98   1514   1151     85   41.85    75
   6 Lc0 0.22.0 T40B.4-160             :   3425      8    3750    2705.0   72.13   1875   1660    215   44.27    56
   7 Stockfish 11 C0                   :   3425      7    3500    1796.0   51.31    502   2588    410   73.94    69
   8 Lc0 0.22.0 42850                  :   3422      8    3750    2691.5   71.77   1874   1635    241   43.60    72
   9 Stockfish 11                      :   3419      7    4000    2157.5   53.94    777   2761    462   69.03    99
  10 Lc0k 0.23.2 62172                 :   3404     10    2500    1827.0   73.08   1256   1142    102   45.68    53
  11 Lc0 LS-LS 12.2                    :   3403      8    3500    2481.0   70.89   1655   1652    193   47.20    77
  12 Lc0 0.22.0 J13B.2-188             :   3399      8    3750    2598.5   69.29   1702   1793    255   47.81    67
  13 Lc0 LS-LS 12.1                    :   3396      8    3000    2056.0   68.53   1299   1514    187   50.47    51
  14 Lc0k 0.23.2 384x30-T40-2036       :   3396      8    3500    2454.5   70.13   1681   1547    272   44.20    98
  15 Fat Fritz 1.0                     :   3383      9    3000    2012.0   67.07   1311   1402    287   46.73    88
  16 Lc0 0.22.0 32930                  :   3376      7    3750    2503.0   66.75   1592   1822    336   48.59    59
  17 Lc0 0.22.0 LS 12 preview          :   3375      9    2750    1876.0   68.22   1258   1236    256   44.95    57
  18 Stockfish 10                      :   3373      8    2750    1337.5   48.64    428   1819    503   66.15    67
  19 Lc0 0.23.2 61950                  :   3371      7    3750    2482.0   66.19   1550   1864    336   49.71    64
  20 Lc0 0.23.2 58613+                 :   3369     10    2500    1750.0   70.00   1200   1100    200   44.00    71
  21 Lc0 0.22.0 384x30-T40-1573        :   3365      9    2750    1846.0   67.13   1220   1252    278   45.53   100
  22 Lc0 0.22.0 11260                  :   3336      9    2750    1755.5   63.84   1044   1423    283   51.75    98
  23 Houdini 6.03                      :   3325      6    5000    2015.0   40.30    526   2978   1496   59.56    65
  24 Komodo 13.3                       :   3323      8    3000    1111.5   37.05    251   1721   1028   57.37   100
  25 Komodo 13.2.5                     :   3308      7    4500    1749.5   38.88    503   2493   1504   55.40   100
  26 Scorpio 3.07 NN-ens-net-20x256    :   3278      9    2500    1466.5   58.66    855   1223    422   48.92   100
  27 Ethereal 12.00                    :   3226      9    3000     769.5   25.65    142   1255   1603   41.83   100
  28 Xiphos 0.6                        :   3208      7    5000    1310.0   26.20    210   2200   2590   44.00    67
  29 Ethereal 11.75                    :   3206      7    4500    1196.0   26.58    210   1972   2318   43.82    86
  30 Fire 7.1                          :   3200      7    5000    1268.0   25.36    252   2032   2716   40.64   100
  31 Booot 6.4                         :   3137     11    3000     521.0   17.37     61    920   2019   30.67    80
  32 Laser 1.7                         :   3132      8    5000     944.0   18.88    161   1566   3273   31.32    94
  33 Andscacs 0.95                     :   3122      8    5000     903.0   18.06    167   1472   3361   29.44   100
  34 Deep Shredder 13                  :   3100      9    5000     818.0   16.36    114   1408   3478   28.16    83
  35 Booot 6.3.1                       :   3094      9    4750     767.0   16.15    118   1298   3334   27.33   ---

White advantage = 60.83 +/- 1.00
Draw rate (equal opponents) = 64.64 % +/- 0.28

Games        : 63.000 (finished)

White Wins   : 21.371 (33.9 %)
Black Wins   : 13.146 (20.9 %)
Draws        : 28.483 (45.2 %)

White Score  : 56.5 %
Black Score  : 43.5 %
http://www.fastgm.de
I find your lists very interesting, very well done.

Regarding the 16 cores one, why is that that Stockfish's draw rate is so much higher than the one's of the Lc0's, or even other AB engines?
http://www.fastgm.de/h2h16-60.html

SF11 has only been tested against the neural nets while the neural nets are slaughtering weaker engines.
MMarco
Posts: 195
Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante

Re: FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by MMarco »

Raphexon wrote: Thu Apr 23, 2020 8:50 pm
MMarco wrote: Thu Apr 23, 2020 2:48 pm
I find your lists very interesting, very well done.

Regarding the 16 cores one, why is that that Stockfish's draw rate is so much higher than the one's of the Lc0's, or even other AB engines?
http://www.fastgm.de/h2h16-60.html

SF11 has only been tested against the neural nets while the neural nets are slaughtering weaker engines.
Oh! I see. Thank you for the information.
jjoshua2
Posts: 99
Joined: Sat Mar 10, 2018 6:16 am

Re: FGRL rating lists, 60 min + 15 sec - Minic 2.00 & 16 cores - Leelenstein 14.2

Post by jjoshua2 »

fastgm wrote: Wed Apr 22, 2020 8:09 pm FGRL rating list - 60 min + 15 sec
Thanks for the update! It is helpful to see and verify progress!