FGRL - 16 Cores rating list with NN-Engines

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

FGRL - 16 Cores rating list with NN-Engines

Post by fastgm »

New 16 Cores rating list with NN-Engines:

Code: Select all

Playing conditions

CPU:                 Dual Intel Xeon E5-2670v3 @ 2.6 GHz, 24 Cores
GPU:                 NVidia GeForce RTX 2070
OS:                  Windows 10 64-Bit
Tool:                Cutechess-Cli
Leela Ratio:         ~ 1.0
A/B-Engines:         16 Cores, 64 Bit PEXT/BMI2, default settings
NN-Engines:          default settings
Hash-Table:          A/B-Engines 512 MB
NN-Cache:            default settings
Lc0-backend:         cudnn-fp16
Time control:        60 seconds + 0.6 seconds
Tablebases:          No, but tablebase adjudication with 6 pieces
Openings:            Hert_250_lowdraws.epd, changing colors
Ponder:              Off
Learning:            Off
Large Memory Pages:  Off

Ordo v1.2.6: Fire 7.1 3200

   # Engine              :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
   ---------------------------------------------------------------------------------------------------
   1 Lc0 0.22.0 42850    :   3425     10    2500    1892.0   75.68   1405    974    121   38.96   100
   2 Stockfish 10        :   3379     16     750     374.5   49.93    125    499    126   66.53    64
   3 Lc0 0.22.0 32930    :   3376      9    2500    1764.5   70.58   1196   1137    167   45.48   100
   4 Lc0 0.22.0 11260    :   3338      9    2500    1657.0   66.28   1032   1250    218   50.00    79
   5 Houdini 6.03        :   3330     16     750     324.5   43.27     96    457    197   60.93    96
   6 Komodo 13.2.5       :   3309     16     750     303.5   40.47     85    437    228   58.27   100
   7 Fire 7.1            :   3200     18     750     203.0   27.07     44    318    388   42.40    59
   8 Xiphos 0.6          :   3197     17     750     200.5   26.73     36    329    385   43.87    67
   9 Ethereal 11.75      :   3191     18     750     195.5   26.07     28    335    387   44.67   100
  10 Laser 1.7           :   3144     19     750     160.0   21.33     25    270    455   36.00    88
  11 Andscacs 0.95       :   3126     21     750     148.0   19.73     26    244    480   32.53    81
  12 Deep Shredder 13    :   3112     20     750     139.0   18.53     15    248    487   33.07    54
  13 Booot 6.3.1         :   3110     21     750     138.0   18.40     26    224    500   29.87   ---

White advantage = 57.00 +/- 3.14
Draw rate (equal opponents) = 62.46 % +/- 0.79

Games        : 7.500 (finished)

White Wins   : 2.535 (33.8 %)
Black Wins   : 1.604 (21.4 %)
Draws        : 3.361 (44.8 %)

White Score  : 56.2 %
Black Score  : 43.8 %
http://fastgm.de/16-60-0.6.html
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: FGRL - 16 Cores rating list with NN-Engines

Post by Laskos »

fastgm wrote: Fri Dec 06, 2019 11:14 pm New 16 Cores rating list with NN-Engines:

Code: Select all

Playing conditions

CPU:                 Dual Intel Xeon E5-2670v3 @ 2.6 GHz, 24 Cores
GPU:                 NVidia GeForce RTX 2070
OS:                  Windows 10 64-Bit
Tool:                Cutechess-Cli
Leela Ratio:         ~ 1.0
A/B-Engines:         16 Cores, 64 Bit PEXT/BMI2, default settings
NN-Engines:          default settings
Hash-Table:          A/B-Engines 512 MB
NN-Cache:            default settings
Lc0-backend:         cudnn-fp16
Time control:        60 seconds + 0.6 seconds
Tablebases:          No, but tablebase adjudication with 6 pieces
Openings:            Hert_250_lowdraws.epd, changing colors
Ponder:              Off
Learning:            Off
Large Memory Pages:  Off

Ordo v1.2.6: Fire 7.1 3200

   # Engine              :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
   ---------------------------------------------------------------------------------------------------
   1 Lc0 0.22.0 42850    :   3425     10    2500    1892.0   75.68   1405    974    121   38.96   100
   2 Stockfish 10        :   3379     16     750     374.5   49.93    125    499    126   66.53    64
   3 Lc0 0.22.0 32930    :   3376      9    2500    1764.5   70.58   1196   1137    167   45.48   100
   4 Lc0 0.22.0 11260    :   3338      9    2500    1657.0   66.28   1032   1250    218   50.00    79
   5 Houdini 6.03        :   3330     16     750     324.5   43.27     96    457    197   60.93    96
   6 Komodo 13.2.5       :   3309     16     750     303.5   40.47     85    437    228   58.27   100
   7 Fire 7.1            :   3200     18     750     203.0   27.07     44    318    388   42.40    59
   8 Xiphos 0.6          :   3197     17     750     200.5   26.73     36    329    385   43.87    67
   9 Ethereal 11.75      :   3191     18     750     195.5   26.07     28    335    387   44.67   100
  10 Laser 1.7           :   3144     19     750     160.0   21.33     25    270    455   36.00    88
  11 Andscacs 0.95       :   3126     21     750     148.0   19.73     26    244    480   32.53    81
  12 Deep Shredder 13    :   3112     20     750     139.0   18.53     15    248    487   33.07    54
  13 Booot 6.3.1         :   3110     21     750     138.0   18.40     26    224    500   29.87   ---

White advantage = 57.00 +/- 3.14
Draw rate (equal opponents) = 62.46 % +/- 0.79

Games        : 7.500 (finished)

White Wins   : 2.535 (33.8 %)
Black Wins   : 1.604 (21.4 %)
Draws        : 3.361 (44.8 %)

White Score  : 56.2 %
Black Score  : 43.8 %
http://fastgm.de/16-60-0.6.html
Wow, thanks!
User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: FGRL - 16 Cores rating list with NN-Engines

Post by pohl4711 »

Great job.
Especially, because your test-settings are quite close to my NN-ratinglist (nearly same thinking-time, same openings(!)), but my hardware has only (around) 40% n/s compared to your hardware. So, it is perfect for a comparsion of the results of your and my testings!

https://www.sp-cc.de/lc0-testing.htm

That is a fantastic opportunity!!!
Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Re: FGRL - 16 Cores rating list with NN-Engines

Post by Jouni »

Excellent work again! With full RR tournament Stockfish 10 will be still number 1? And SF dev version is 54 ELO stronger with 8 cores 60 + 0,6 testing meaning 3433 in this list!
Jouni