LC0 scales significantly better than standard engines of similar strength.CMCanavessi wrote:I get about 1kn/s, and tc is 1 min + 1 sec so it's very similar to the match games leela plays between networks.
The scaling, i don't know, haven't made any tests.
I am bit puzzled by their ratings here http://lczero.org/networks . I am not even sure how they decide to promote a network with such "ratings". Although my current methodology is very flawed, only against one standard similar in strength engine and at very short time control, I have the following:
My matches are of 500 games.
ID101 compared to ID83
Their rating in self-games: -30 Elo points
My rating: +75 Elo points (20 Elo points standard deviation)
ID109 compared to ID101
Their rating in self games: +100 Elo points
My rating: +0 Elo points (20 Elo points standard deviation)
I use a varied, but solid short opening suite 3moves_GM. They seem to overfit on certain openings, finding local optima, playing most of the games on them, and training less on many other viable openings. I don't know whether they will soon find it problematic what to promote or not. 300,000 games with +0 Elo against a standard engine is not that good.