LCZero progress

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   197.4   39.9   223.0     326    68
   2 LC0 173_101eeb41 N64k    :   142.7   60.7    53.5     126    42
   3 LC0 173_101eeb41 N32k    :     0.0   ----    49.5     200    25

White advantage = 41.90 +/- 15.92
Draw rate (equal opponents) = 50.00 % +/- 0.00

majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   197.6   38.7   240.0     350    69
   2 LC0 173_101eeb41 N64k    :   127.9   56.5    60.5     150    40
   3 LC0 173_101eeb41 N32k    :     0.0   ----    49.5     200    25

White advantage = 43.32 +/- 15.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: LCZero progress

Post by Milos »

majortom wrote: Wed May 16, 2018 12:00 am

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   197.6   38.7   240.0     350    69
   2 LC0 173_101eeb41 N64k    :   127.9   56.5    60.5     150    40
   3 LC0 173_101eeb41 N32k    :     0.0   ----    49.5     200    25

White advantage = 43.32 +/- 15.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Interesting how from the very start of that gauntlet LC0 64k performance is on +2SD i.e. on plus side of error margin and is constantly dropping. My guess is that it will drop below 100Elo once all 200 games are played.
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   196.9   40.5   258.5     372    69
   2 LC0 173_101eeb41 N64k    :   104.2   50.7    64.0     172    37
   3 LC0 173_101eeb41 N32k    :     0.0   ----    49.5     200    25

White advantage = 37.55 +/- 14.51
Draw rate (equal opponents) = 50.00 % +/- 0.00

majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Started 2 gauntlets ID302 vs. ID239 & ID125. ID302 does not look very strong:

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 LC0 239_0df31cb9 N714    :   226.6   29.3   307.5     447    69
   2 LC0 302_ade7ac45 N714    :   168.2   64.8    37.0      71    52
   3 LC0 173_101eeb41 N2k     :   142.6   28.9   215.0     400    54
   4 LC0 125_738edc3d N2k     :     0.0   ----   111.5     424    26

White advantage = 24.57 +/- 9.53
Draw rate (equal opponents) = 50.00 % +/- 0.00
yanquis1972
Posts: 1766
Joined: Wed Jun 03, 2009 12:14 am

Re: LCZero progress

Post by yanquis1972 »

71 games played vs 400?

what rating system is that, btw?
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: LCZero progress

Post by jp »

yanquis1972 wrote: Thu May 17, 2018 9:49 pm what rating system is that, btw?
It's just standard elo difference.
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 LC0 239_0df31cb9 N714    :   223.0   30.9   320.0     475    67
   2 LC0 302_ade7ac45 N714    :   188.9   48.3    63.0     114    55
   3 LC0 173_101eeb41 N2k     :   140.7   30.7   215.0     400    54
   4 LC0 125_738edc3d N2k     :     0.0   ----   116.0     439    26

White advantage = 27.80 +/- 9.85
Draw rate (equal opponents) = 50.00 % +/- 0.00
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   113.4   36.4   131.0     200    66
   2 LC0 173_101eeb41 N64k    :     0.0   ----    69.0     200    35

White advantage = 35.05 +/- 19.41
Draw rate (equal opponents) = 50.00 % +/- 0.00
Games

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   196.7   41.2   281.5     400    70
   2 LC0 173_101eeb41 N64k    :    83.2   51.9    69.0     200    35
   3 LC0 173_101eeb41 N32k    :     0.0   ----    49.5     200    25

White advantage = 35.25 +/- 14.17
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

 # PLAYER                     :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30     :  1056.6  131.8   193.0     200    97
   2 Stockfish 130418 D15     :   471.2   79.1  1165.0    1600    73
   3 LC0 173_101eeb41 N64k    :   357.4   85.0    69.0     200    35
   4 LC0 173_101eeb41 N32k    :   274.0   89.4    49.5     200    25
   5 LC0 173_101eeb41 N16k    :   222.7   93.4    39.5     200    20
   6 LC0 173_101eeb41 N8k     :   180.7   90.2    32.5     200    16
   7 LC0 173_101eeb41 N4k     :   105.7   99.3    22.5     200    11
   8 LC0 173_101eeb41 N2k     :    39.4  103.6    16.0     200     8
   9 LC0 173_101eeb41 N1k     :     0.0   ----    13.0     200     7

White advantage = 39.92 +/- 9.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
357.4 / 6 ≈ 60 elo with doubling nodes.
Last edited by majortom on Fri May 18, 2018 11:11 pm, edited 2 times in total.
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

LCZero ID173 - 128 000 playouts per move vs. SF 130418 at 15 depth:

Code: Select all

   # PLAYER                    :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15      :   112.9   36.3   171.0     266    64
   2 LC0 173_101eeb41 N128k    :    37.0   68.4    26.0      66    39
   3 LC0 173_101eeb41 N64k     :     0.0   ----    69.0     200    35

White advantage = 25.93 +/- 16.91
Draw rate (equal opponents) = 50.00 % +/- 0.00