TalkChess.com

First, the scaling with time control.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:


LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):

• 0.1s / move:
  7.5 - 92.5
  
  1s / move:
  9.0 - 91.0
  
  10s / move
  11.5 - 88.5
  
  40s / move
  16.5 - 83.5

===================

The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat

The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================

The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.

Laskos wrote:First, the scaling with time control.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:


LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):

• 0.1s / move:
  7.5 - 92.5
  
  1s / move:
  9.0 - 91.0
  
  10s / move
  11.5 - 88.5
  
  40s / move
  16.5 - 83.5

===================

The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat

The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================

The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.

do you know the elo of the strongest ai chess software today ?

duncan wrote:

Laskos wrote:First, the scaling with time control.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:


LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):

• 0.1s / move:
  7.5 - 92.5
  
  1s / move:
  9.0 - 91.0
  
  10s / move
  11.5 - 88.5
  
  40s / move
  16.5 - 83.5

===================

The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat

The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================

The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.

do you know the elo of the strongest ai chess software today ?

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

Look at 1 core performances, as LCZero is on one core too. Stockfish 9 on one core is about 3500 CCRL Elo.

Laskos wrote:

duncan wrote:

Laskos wrote:First, the scaling with time control.
NN with backing up the average score MCTS used in LCZero seems to scale a bit better than Alpha-Beta conventional modern engine like Zurichess. I took Zurichess Appenzeller 64-bit (Elo 1821 CCRL 40/4'), a modern conventional engine of the Zurichess line of engines, which in 2 years became pretty strong, and played 4 matches against yesterday's network 44 for LCZero, at 0.1s/move, 1s/move, 10s/move and 40s/move (a total factor of 400 in time control), and the results show a bit better scaling of LCZero:


LCZero versus Zurichess Appenzeller (Elo 1821 CCRL):

• 0.1s / move:
  7.5 - 92.5
  
  1s / move:
  9.0 - 91.0
  
  10s / move
  11.5 - 88.5
  
  40s / move
  16.5 - 83.5

===================

The last time control is already fairly long time control, and at this time control LCZero v.44 seems about 1500 CCRL Elo points. For random player (0 Elo points in LCZero framework) I used my result of -150 CCRL Elo points:
http://www.talkchess.com/forum/viewtopi ... _view=flat

The transformation from LCZero framework Elo points to CCRL Elo points is close to X/2.5 - 150.
====================

The progress:
As of now, the progress does not seem to be plateauing. If it continues in the same fashion, and the framework continues its work, by the 20th of April we can expect LCZero to be about 2750 CCRL Elo points. I plotted here the progress, which doesn't show as of now plateauing, and the extrapolation to 20th of April.

do you know the elo of the strongest ai chess software today ?

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

Look at 1 core performances, as LCZero is on one core too. Stockfish 9 on one core is about 3500 CCRL Elo.

I meant software which uses neural networks.is it giraffe ?

duncan wrote: I meant software which uses neural networks.is it giraffe ?

Giraffe, but it had a very different kind of learning and search.

Now, with this post of Carlos Canavessi http://www.talkchess.com/forum/viewtopi ... 9&start=44 and the release of CPU and GPU versions, I have something odd happening. Although my GPU is weak, probably some 10 times slower than the best GTX cards, I didn't expect GPU-engine to perform so badly compared to CPU-only engine. In other GPU intensive tasks, it helps greatly over my Haswell four core i7 CPU + integrated GPU. Is LCZero using efficiently GPU?

Old LCZero shows the following: New GPU LCZero shows the following (identical): New CPU version shows:

Using the old LCZero (actually the one from 1-2 days ago), and new CPU and GPU Windows binaries, I got the following:

CPU LCZero has some 5 times higher NPS than GPU LCZero, and is much stronger. The old and the new Windows GPU version seem to perform comparably. With the old LCZero, I got

LCZero Old versus Zurichess Appenzeller (Elo 1821 CCRL):
1s/move:
9.0 - 91.0



Now, with the CPU version, I get a much better result:

LCZero CPU (one core) versus Zurichess Appenzeller (Elo 1821 CCRL):
1s/move:
33.0 - 67.0

Which gives a rating of about 1700 CCRL Elo points for CPU version. I have to revise my plot for progress and extrapolation, using stronger on my PC CPU version. From 27th to 28th of March, LCZero advanced very little, maybe it is a sign of plateauing? If not, the extrapolation on one core (for CPU version on my Haswell) would look as following:

When you analyse in Arena, how many rollouts / sec are you getting on with the CPU and GPU versions, please?

I'm getting 2000 - 5000 on GPU

Werewolf wrote:When you analyse in Arena, how many rollouts / sec are you getting on with the CPU and GPU versions, please?

I'm getting 2000 - 5000 on GPU

Interesting. I am getting about 150 on GPU and 600 on CPU.

Laskos wrote:

Werewolf wrote:When you analyse in Arena, how many rollouts / sec are you getting on with the CPU and GPU versions, please?

I'm getting 2000 - 5000 on GPU

Interesting. I am getting about 150 on GPU and 600 on CPU.

That does seem low for the GPU, though it might just be your card. The Titan V is at least 3x faster than my card which is eye opening.

By the way, do you know why there is such big regression on this site from time to time?

http://lczero.org/networks

Werewolf wrote:
By the way, do you know why there is such big regression on this site from time to time?

http://lczero.org/networks

It was caused by a bug discussed here.
https://groups.google.com/forum/#!topic ... vf9p3biLRk
Now it's fixed.