LCZero progress

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 LC0 330_de60388a N91k    :   170.6  180.6    12.0      18    67
   2 Stockfish 130418 D15     :     0.0   ----     6.0      18    33

White advantage = -170.80 +/- 85.32
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 LC0 330_de60388a N91k :170.6 18 (+  9,=  6,-  3), 66.7 %

Stockfish 130418 D15    : 18 (+  9,=  6,-  3), 66.7 %

2 Stockfish 130418 D15  :  0.0 18 (+  3,=  6,-  9), 33.3 %

LC0 330_de60388a N91k   : 18 (+  3,=  6,-  9), 33.3 %
Shortest game - #11.

Broadcast
Games
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Started match LC0 367_9efeefb3 with 714 playouts per move vs. Stockfish 130418 with depth=15:

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   662.0  127.4   920.0    1044    88
   2 LC0 367_9efeefb3 N714    :   435.4  159.1     9.5      44    22
   3 LC0 330_de60388a N714    :   426.5  135.7    41.5     200    21
   4 LC0 302_ade7ac45 N714    :   350.3  140.3    29.0     200    15
   5 LC0 239_0df31cb9 N714    :   307.8  132.3    23.5     200    12
   6 LC0 173_101eeb41 N2k     :   233.1  137.7    16.0     200     8
   7 LC0 125_738edc3d N2k     :     0.0   ----     4.5     200     2

White advantage = 20.08 +/- 12.29
Draw rate (equal opponents) = 50.00 % +/- 0.00

FWCC
Posts: 117
Joined: Wed Aug 22, 2007 4:39 pm

Re: LCZero progress

Post by FWCC »

So is she starting to beat SF? What GPU how set playouts?
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: LCZero progress

Post by Milos »

FWCC wrote: Sun Jun 03, 2018 1:58 am So is she starting to beat SF? What GPU how set playouts?
Yea with 100k playouts she totally destroys SF depth 15. With just a measly 2500x time advantage when running 1060 vs. 4 core CPU. :lol: :lol: :lol:
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

After 160 games:

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   661.8  124.8  1010.5    1160    87
   2 LC0 367_9efeefb3 N714    :   438.2  135.7    35.0     160    22
   3 LC0 330_de60388a N714    :   426.4  131.7    41.5     200    21
   4 LC0 302_ade7ac45 N714    :   350.2  137.6    29.0     200    15
   5 LC0 239_0df31cb9 N714    :   307.7  132.1    23.5     200    12
   6 LC0 173_101eeb41 N2k     :   233.0  139.6    16.0     200     8
   7 LC0 125_738edc3d N2k     :     0.0   ----     4.5     200     2

White advantage = 17.61 +/- 10.15
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 Stockfish 130418 D15  :661.8 1160 (+917,=187,- 56), 87.1 %

LC0 367_9efeefb3 N714   : 160 (+104,= 42,- 14), 78.1 %
LC0 330_de60388a N714   : 200 (+134,= 49,- 17), 79.3 %
LC0 302_ade7ac45 N714   : 200 (+152,= 38,- 10), 85.5 %
LC0 239_0df31cb9 N714   : 200 (+161,= 31,-  8), 88.3 %
LC0 173_101eeb41 N2k    : 200 (+173,= 22,-  5), 92.0 %
LC0 125_738edc3d N2k    : 200 (+193,=  5,-  2), 97.8 %

2 LC0 367_9efeefb3 N714 :438.2 160 (+ 14,= 42,-104), 21.9 %

Stockfish 130418 D15    : 160 (+ 14,= 42,-104), 21.9 %

3 LC0 330_de60388a N714 :426.4 200 (+ 17,= 49,-134), 20.8 %

Stockfish 130418 D15    : 200 (+ 17,= 49,-134), 20.8 %

4 LC0 302_ade7ac45 N714 :350.2 200 (+ 10,= 38,-152), 14.5 %

Stockfish 130418 D15    : 200 (+ 10,= 38,-152), 14.5 %

5 LC0 239_0df31cb9 N714 :307.7 200 (+  8,= 31,-161), 11.8 %

Stockfish 130418 D15    : 200 (+  8,= 31,-161), 11.8 %

6 LC0 173_101eeb41 N2k  :233.0 200 (+  5,= 22,-173),  8.0 %

Stockfish 130418 D15    : 200 (+  5,= 22,-173),  8.0 %

7 LC0 125_738edc3d N2k  :  0.0 200 (+  2,=  5,-193),  2.3 %

Stockfish 130418 D15    : 200 (+  2,=  5,-193),  2.3 %
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 LC0 330_de60388a N91k    :   191.6  148.3    16.5      23    72
   2 Stockfish 130418 D15     :     0.0   ----     6.5      23    28

White advantage = -133.30 +/- 73.33
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 LC0 330_de60388a N91k :191.6 23 (+ 13,=  7,-  3), 71.7 %

Stockfish 130418 D15    : 23 (+ 13,=  7,-  3), 71.7 %

2 Stockfish 130418 D15  :  0.0 23 (+  3,=  7,- 13), 28.3 %

LC0 330_de60388a N91k   : 23 (+  3,=  7,- 13), 28.3 %
Broadcast
Games
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Stockfish 130418 at depth=15 vs. Stockfish 130418 at depth=20:

Code: Select all

   # PLAYER                  :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D20    :   326.0   50.2   173.0     200    87
   2 Stockfish 130418 D15    :     0.0   ----    27.0     200    14

White advantage = 15.03 +/- 26.35
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 Stockfish 130418 D20 :326.0 200 (+146,= 54,-  0), 86.5 %

Stockfish 130418 D15   : 200 (+146,= 54,-  0), 86.5 %

2 Stockfish 130418 D15 :  0.0 200 (+  0,= 54,-146), 13.5 %

Stockfish 130418 D20   : 200 (+  0,= 54,-146), 13.5 %
Games
Last edited by majortom on Sun Jun 03, 2018 2:32 pm, edited 1 time in total.
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                  :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D30    :   582.7   85.4   193.0     200    97
   2 Stockfish 130418 D20    :   326.6   53.7   173.0     200    87
   3 Stockfish 130418 D15    :     0.0   ----    34.0     400     9

White advantage = 23.21 +/- 20.65
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 Stockfish 130418 D30 :582.7 200 (+186,= 14,-  0), 96.5 %

Stockfish 130418 D15   : 200 (+186,= 14,-  0), 96.5 %

2 Stockfish 130418 D20 :326.6 200 (+146,= 54,-  0), 86.5 %

Stockfish 130418 D15   : 200 (+146,= 54,-  0), 86.5 %

3 Stockfish 130418 D15 :  0.0 400 (+  0,= 68,-332),  8.5 %

Stockfish 130418 D30   : 200 (+  0,= 14,-186),  3.5 %
Stockfish 130418 D20   : 200 (+  0,= 54,-146), 13.5 %
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   219.8   39.6   155.5     200    78
   2 LC0 367_9efeefb3 N714    :     0.0   ----    44.5     200    22

White advantage = 17.76 +/- 21.95
Draw rate (equal opponents) = 50.00 % +/- 0.00
Games
majortom
Posts: 669
Joined: Mon Nov 04, 2013 10:19 pm

Re: LCZero progress

Post by majortom »

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   235.6   43.2   314.0     400    79
   2 LC0 367_9efeefb3 N714    :    15.6   57.7    44.5     200    22
   3 LC0 330_de60388a N714    :     0.0   ----    41.5     200    21

White advantage = 20.82 +/- 15.79
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

   # PLAYER                   :  RATING  ERROR  POINTS  PLAYED   (%)
   1 Stockfish 130418 D15     :   662.2  141.8  1041.0    1200    87
   2 LC0 367_9efeefb3 N714    :   442.2  142.4    44.5     200    22
   3 LC0 330_de60388a N714    :   426.6  148.7    41.5     200    21
   4 LC0 302_ade7ac45 N714    :   350.3  153.3    29.0     200    15
   5 LC0 239_0df31cb9 N714    :   307.8  155.4    23.5     200    12
   6 LC0 173_101eeb41 N2k     :   233.1  145.5    16.0     200     8
   7 LC0 125_738edc3d N2k     :     0.0   ----     4.5     200     2

White advantage = 21.28 +/- 10.91
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

1 Stockfish 130418 D15  :662.2 1200 (+942,=198,- 60), 86.8 %

LC0 367_9efeefb3 N714   : 200 (+129,= 53,- 18), 77.8 %
LC0 330_de60388a N714   : 200 (+134,= 49,- 17), 79.3 %
LC0 302_ade7ac45 N714   : 200 (+152,= 38,- 10), 85.5 %
LC0 239_0df31cb9 N714   : 200 (+161,= 31,-  8), 88.3 %
LC0 173_101eeb41 N2k    : 200 (+173,= 22,-  5), 92.0 %
LC0 125_738edc3d N2k    : 200 (+193,=  5,-  2), 97.8 %

2 LC0 367_9efeefb3 N714 :442.2 200 (+ 18,= 53,-129), 22.3 %

Stockfish 130418 D15    : 200 (+ 18,= 53,-129), 22.3 %

3 LC0 330_de60388a N714 :426.6 200 (+ 17,= 49,-134), 20.8 %

Stockfish 130418 D15    : 200 (+ 17,= 49,-134), 20.8 %

4 LC0 302_ade7ac45 N714 :350.3 200 (+ 10,= 38,-152), 14.5 %

Stockfish 130418 D15    : 200 (+ 10,= 38,-152), 14.5 %

5 LC0 239_0df31cb9 N714 :307.8 200 (+  8,= 31,-161), 11.8 %

Stockfish 130418 D15    : 200 (+  8,= 31,-161), 11.8 %

6 LC0 173_101eeb41 N2k  :233.1 200 (+  5,= 22,-173),  8.0 %

Stockfish 130418 D15    : 200 (+  5,= 22,-173),  8.0 %

7 LC0 125_738edc3d N2k  :  0.0 200 (+  2,=  5,-193),  2.3 %

Stockfish 130418 D15    : 200 (+  2,=  5,-193),  2.3 %