Discussion of computer chess matches and engine tournaments.
Moderators: hgm , Rebel , chrisw
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Mon May 14, 2018 11:15 pm
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 197.4 39.9 223.0 326 68
2 LC0 173_101eeb41 N64k : 142.7 60.7 53.5 126 42
3 LC0 173_101eeb41 N32k : 0.0 ---- 49.5 200 25
White advantage = 41.90 +/- 15.92
Draw rate (equal opponents) = 50.00 % +/- 0.00
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Wed May 16, 2018 12:00 am
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 197.6 38.7 240.0 350 69
2 LC0 173_101eeb41 N64k : 127.9 56.5 60.5 150 40
3 LC0 173_101eeb41 N32k : 0.0 ---- 49.5 200 25
White advantage = 43.32 +/- 15.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Milos
Posts: 4190 Joined: Wed Nov 25, 2009 1:47 am
Post
by Milos » Wed May 16, 2018 2:35 am
majortom wrote: ↑ Wed May 16, 2018 12:00 am
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 197.6 38.7 240.0 350 69
2 LC0 173_101eeb41 N64k : 127.9 56.5 60.5 150 40
3 LC0 173_101eeb41 N32k : 0.0 ---- 49.5 200 25
White advantage = 43.32 +/- 15.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Interesting how from the very start of that gauntlet LC0 64k performance is on +2SD i.e. on plus side of error margin and is constantly dropping. My guess is that it will drop below 100Elo once all 200 games are played.
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Thu May 17, 2018 1:05 am
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 196.9 40.5 258.5 372 69
2 LC0 173_101eeb41 N64k : 104.2 50.7 64.0 172 37
3 LC0 173_101eeb41 N32k : 0.0 ---- 49.5 200 25
White advantage = 37.55 +/- 14.51
Draw rate (equal opponents) = 50.00 % +/- 0.00
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Thu May 17, 2018 9:28 pm
Started 2 gauntlets ID302 vs. ID239 & ID125. ID302 does not look very strong:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 LC0 239_0df31cb9 N714 : 226.6 29.3 307.5 447 69
2 LC0 302_ade7ac45 N714 : 168.2 64.8 37.0 71 52
3 LC0 173_101eeb41 N2k : 142.6 28.9 215.0 400 54
4 LC0 125_738edc3d N2k : 0.0 ---- 111.5 424 26
White advantage = 24.57 +/- 9.53
Draw rate (equal opponents) = 50.00 % +/- 0.00
yanquis1972
Posts: 1766 Joined: Wed Jun 03, 2009 12:14 am
Post
by yanquis1972 » Thu May 17, 2018 9:49 pm
71 games played vs 400?
what rating system is that, btw?
jp
Posts: 1470 Joined: Mon Apr 23, 2018 7:54 am
Post
by jp » Thu May 17, 2018 10:04 pm
yanquis1972 wrote: ↑ Thu May 17, 2018 9:49 pm
what rating system is that, btw?
It's just standard elo difference.
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Fri May 18, 2018 9:05 am
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 LC0 239_0df31cb9 N714 : 223.0 30.9 320.0 475 67
2 LC0 302_ade7ac45 N714 : 188.9 48.3 63.0 114 55
3 LC0 173_101eeb41 N2k : 140.7 30.7 215.0 400 54
4 LC0 125_738edc3d N2k : 0.0 ---- 116.0 439 26
White advantage = 27.80 +/- 9.85
Draw rate (equal opponents) = 50.00 % +/- 0.00
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Fri May 18, 2018 9:35 pm
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 113.4 36.4 131.0 200 66
2 LC0 173_101eeb41 N64k : 0.0 ---- 69.0 200 35
White advantage = 35.05 +/- 19.41
Draw rate (equal opponents) = 50.00 % +/- 0.00
Games
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 196.7 41.2 281.5 400 70
2 LC0 173_101eeb41 N64k : 83.2 51.9 69.0 200 35
3 LC0 173_101eeb41 N32k : 0.0 ---- 49.5 200 25
White advantage = 35.25 +/- 14.17
Draw rate (equal opponents) = 50.00 % +/- 0.00
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 1056.6 131.8 193.0 200 97
2 Stockfish 130418 D15 : 471.2 79.1 1165.0 1600 73
3 LC0 173_101eeb41 N64k : 357.4 85.0 69.0 200 35
4 LC0 173_101eeb41 N32k : 274.0 89.4 49.5 200 25
5 LC0 173_101eeb41 N16k : 222.7 93.4 39.5 200 20
6 LC0 173_101eeb41 N8k : 180.7 90.2 32.5 200 16
7 LC0 173_101eeb41 N4k : 105.7 99.3 22.5 200 11
8 LC0 173_101eeb41 N2k : 39.4 103.6 16.0 200 8
9 LC0 173_101eeb41 N1k : 0.0 ---- 13.0 200 7
White advantage = 39.92 +/- 9.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
357.4 / 6 ≈ 60 elo with doubling nodes.
Last edited by majortom on Fri May 18, 2018 11:11 pm, edited 2 times in total.
majortom
Posts: 669 Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom » Fri May 18, 2018 11:07 pm
LCZero ID173 - 128 000 playouts per move vs. SF 130418 at 15 depth:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D15 : 112.9 36.3 171.0 266 64
2 LC0 173_101eeb41 N128k : 37.0 68.4 26.0 66 39
3 LC0 173_101eeb41 N64k : 0.0 ---- 69.0 200 35
White advantage = 25.93 +/- 16.91
Draw rate (equal opponents) = 50.00 % +/- 0.00