FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by fastgm »

New: 1. Lc0k 0.23.2 256x20-T40-1541

Lc0k = Kiudee settings: FpuValue=0.443, PolicyTemperature=1.607, CPuct=2.147, CPuctBase=18368, CPuctFactor=2.815

Code: Select all

   # Engine                         :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
 ----------------------------------------------------------------------------------------------------------------
   1 Lc0k 0.23.2 256x20-T40-1541    :   3448     11    2500    1935.5   77.42   1470    931     99   37.24   100
   2 Lc0 0.22.0 T40B.4-160          :   3422     10    2750    2017.5   73.36   1429   1177    144   42.80    61
   3 Lc0 0.22.0 42850               :   3420     10    2750    2012.0   73.16   1440   1144    166   41.60    51
   4 Stockfish 11                   :   3420      7    3000    1622.0   54.07    590   2064    346   68.80   100
   5 Lc0 0.23.2 62172+              :   3403     10    2500    1827.0   73.08   1256   1142    102   45.68    64
   6 Lc0 0.22.0 J13B.2-188          :   3400      9    2750    1954.5   71.07   1321   1267    162   46.07    79
   7 Lc0 LS-LS12.1                  :   3395      9    2750    1938.5   70.49   1275   1327    148   48.25    98
   8 Fat Fritz 1.0                  :   3382      9    2750    1900.0   69.09   1290   1220    240   44.36    88
   9 Lc0 0.22.0 LS12 preview        :   3374      9    2750    1876.0   68.22   1258   1236    256   44.95    53
  10 Lc0 0.22.0 32930               :   3373      9    2750    1874.5   68.16   1228   1293    229   47.02    58
  11 Stockfish 10                   :   3372      8    2750    1337.5   48.64    428   1819    503   66.15    68
  12 Lc0 0.23.2 61950               :   3369      9    2750    1862.0   67.71   1206   1312    232   47.71    59
  13 Lc0 0.23.2 58613+              :   3368      9    2500    1750.0   70.00   1200   1100    200   44.00    70
  14 Lc0 0.22.0 384x30-T40-1573     :   3364      9    2750    1846.0   67.13   1220   1252    278   45.53   100
  15 Lc0 0.22.0 11260               :   3336      9    2750    1755.5   63.84   1044   1423    283   51.75    98
  16 Houdini 6.03                   :   3323      8    3250    1336.5   41.12    342   1989    919   61.20    99
  17 Komodo 13.2.5                  :   3309      8    3250    1275.0   39.23    357   1836   1057   56.49   100
  18 Xiphos 0.6                     :   3204      9    3250     861.5   26.51    145   1433   1672   44.09    54
  19 Ethereal 11.75                 :   3203      9    3250     859.5   26.45    139   1441   1670   44.34    69
  20 Fire 7.1                       :   3200      9    3250     848.0   26.09    167   1362   1721   41.91   100
  21 Laser 1.7                      :   3130     10    3250     628.0   19.32    103   1050   2097   32.31    90
  22 Andscacs 0.95                  :   3121     10    3250     602.0   18.52    116    972   2162   29.91   100
  23 Deep Shredder 13               :   3101     10    3250     549.0   16.89     72    954   2224   29.35    80
  24 Booot 6.3.1                    :   3094     11    3250     532.0   16.37     80    904   2266   27.82   ---

White advantage = 61.43 +/- 1.42
Draw rate (equal opponents) = 63.73 % +/- 0.35

Games        : 35.000 (finished)

White Wins   : 11.917 (34.0 %)
Black Wins   :  7.259 (20.7 %)
Draws        : 15.824 (45.2 %)

White Score  : 56.7 %
Black Score  : 43.3 %
http://www.fastgm.de
User avatar
pohl4711
Posts: 2432
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by pohl4711 »

Nice!
Cleary stronger (out of errorbars) than Stockfish. With bullettime and a valid Leela-Ratio of 1.0.
After years and years of Stockfish dominating the computerchess, finally a new world's number 1.
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by JJJ »

Yes, but only 28 elo at leela ratio 1.
So Stockfish has still a chance to overcome Leela one day.
Jouni
Posts: 3278
Joined: Wed Mar 08, 2006 8:15 pm

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by Jouni »

In TCEC Stockfish has 176 threads. Who is then favourite? I have impression, that more GPUs don't help much Lc0.
Jouni
mmt
Posts: 343
Joined: Sun Aug 25, 2019 8:33 am
Full name: .

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by mmt »

Am I missing something or you haven't listed time controls? From your site, it seems they are 60s+0.6s?
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by jp »

pohl4711 wrote: Wed Feb 12, 2020 7:03 am a valid Leela-Ratio of 1.0.
It's not "valid". It's "arbitrary" at best, and probably very heavily in favor of Leela by any reasonable measure. (e.g. if you follow crem's suggestion, you find it gives way too much hardware power to Leela.)
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by JJJ »

jp wrote: Thu Feb 13, 2020 3:39 am
pohl4711 wrote: Wed Feb 12, 2020 7:03 am a valid Leela-Ratio of 1.0.
It's not "valid". It's "arbitrary" at best, and probably very heavily in favor of Leela by any reasonable measure. (e.g. if you follow crem's suggestion, you find it gives way too much hardware power to Leela.)
One day, Leela with a standard good graphic card will be stronger than Stockfish on any number of core. So it will be 500$ GPU >>>>> 20K $ CPU. So Leela ratio doesn't really matter anymore.
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by jp »

JJJ wrote: Thu Feb 13, 2020 4:57 am One day, Leela with a standard good graphic card will be stronger than Stockfish on any number of core. So it will be 500$ GPU >>>>> 20K $ CPU.
Maybe. I don't know. I can't really predict such things.


But this article suggests gamers disagree with you. The author is arguing it's not as bad as they think and it "seems like solid progress to us", which is hardly a ringing endorsement of your prediction.
Something we’ve been hearing a lot this year is that PC gaming is not in great shape, how there’s a lack of development and progress on the hardware front... But are things really that bad?
For example... So at least on the CPU front, things have without question never been better.

Memory and storage pricing is also amazing right now, but what about graphics cards? It’s GPUs that we suspect most gamers are focusing on when complaining about the current state of the PC gaming industry.
We've come to terms with the fact that we’re not going to get 20 to 30% performance gains year on year anymore. Some have come to expect those kind of gains no matter what, but we must wonder where they were during the five years of 28nm GPUs? Let's also consider Nvidia lacked real competition for a few years and naturally that didn't help with pricing or performance.
The performance uplift offered by the GeForce RTX 2060 Super over the ~3.5 year old GTX 1070 isn’t overly impressive, but a 35% performance boost isn’t insignificant either. The Radeon 5700 XT boost is more noteworthy, 48% faster on average when compared to the GTX 1070. That’s a very reasonable performance gain after 3 years.
https://www.techspot.com/article/1953-t ... 0-usd-gpu/
jjoshua2
Posts: 99
Joined: Sat Mar 10, 2018 6:16 am

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by jjoshua2 »

jp wrote: Thu Feb 13, 2020 9:01 am The performance uplift offered by the GeForce RTX 2060 Super over the ~3.5 year old GTX 1070 isn’t overly impressive, but a 35% performance boost isn’t insignificant either.
I find it hilarious your example of a small performance uplift is the one that is like 200-300% for lc0 and other AI applications :)

And you are absolutely right that traditional rasterization approaches is reaching a dead end in games, with diminishing returns. That's why there is a sudden focus on new approaches like ray tracing and AI enhancements like smarter upscaling.
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: FGRL - 16 Cores rating list - 1. Lc0k 0.23.2 256x20-T40-1541

Post by jp »

jjoshua2 wrote: Sun Feb 16, 2020 2:27 am
jp wrote: Thu Feb 13, 2020 9:01 am The performance uplift offered by the GeForce RTX 2060 Super over the ~3.5 year old GTX 1070 isn’t overly impressive, but a 35% performance boost isn’t insignificant either.
I find it hilarious your example of a small performance uplift is the one that is like 200-300% for lc0 and other AI applications :)
Note that is not my example. I am not the author of that article. As I said in my post, I can't predict such things (not that he is forecasting in his article).