LCZero: Progress and Scaling. Relation to CCRL Elo
Posted: Wed Mar 28, 2018 11:30 am
First, the scaling with time control.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:
LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):
The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat
The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================
The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:
LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):
- 0.1s / move:
7.5 - 92.5
1s / move:
9.0 - 91.0
10s / move
11.5 - 88.5
40s / move
16.5 - 83.5
The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat
The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================
The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.