Page 4 of 4

Re: Similarity tester - 2nd generation - BETA

Posted: Mon Aug 26, 2019 7:13 pm
by Laskos
Branko Radovanovic wrote: Mon Aug 26, 2019 6:56 pm
Rebel wrote: Mon Aug 26, 2019 10:53 am Did some Lc0 testing - http://rebel13.nl/html/kai.html

SF vs Lc0 very low similarity.
Indeed, and that's not surprising. No real difference between SF8 and SF10 vs NNs - that seems to prove my impression was not correct, though. And, finally, of all AB engines SF is the most similar to Lc0 (while remaining very far nevertheless) - that would again make sense to me.
Check this recent thread:
http://talkchess.com/forum3/viewtopic.php?f=7&t=71610

Re: Similarity tester - 2nd generation - BETA

Posted: Tue Aug 27, 2019 11:34 am
by Branko Radovanovic
chrisw wrote: Mon Aug 26, 2019 8:52 am
Branko Radovanovic wrote: Mon Aug 26, 2019 2:11 am My impression - not sure if that's true or not, so I'd like to see it tested - is that SF10's play is more similar to LC0 than e.g. SF9 was. That would make sense because if LC0's style is the "chess truth", devoid of preconceptions, one would expect AB engines to gradually approach it.
not necessarily, if chess is a draw, or basically a stable game, as people claim. There’s many ways to get to a draw.
A very good point. If chess is a draw, there are indeed many ways to get it with perfect play, playing against a perfect player, and all are equally good.

However, things get more complicated for non-perfect play. While, with perfect play, 1.d4 might be a draw, and - for all we know - 1.Na3 might be a draw too, I'd argue that for a non-perfect player 1.d4 is a much better choice than 1.Na3. So, while perfect players might draw each other with possibly wildly different styles of play, the reality is that "real-world-good" moves should be preferred over "not-so-real-world-good" moves, which significantly constrains one's choices. But in the end I have to agree: whether these practical limitations will eventually produce One True Playing Style or not remains to be seen.

Re: Similarity tester - 2nd generation - BETA

Posted: Tue Aug 27, 2019 8:40 pm
by chrisw
Branko Radovanovic wrote: Tue Aug 27, 2019 11:34 am
chrisw wrote: Mon Aug 26, 2019 8:52 am
Branko Radovanovic wrote: Mon Aug 26, 2019 2:11 am My impression - not sure if that's true or not, so I'd like to see it tested - is that SF10's play is more similar to LC0 than e.g. SF9 was. That would make sense because if LC0's style is the "chess truth", devoid of preconceptions, one would expect AB engines to gradually approach it.
not necessarily, if chess is a draw, or basically a stable game, as people claim. There’s many ways to get to a draw.
A very good point. If chess is a draw, there are indeed many ways to get it with perfect play, playing against a perfect player, and all are equally good.

However, things get more complicated for non-perfect play. While, with perfect play, 1.d4 might be a draw, and - for all we know - 1.Na3 might be a draw too, I'd argue that for a non-perfect player 1.d4 is a much better choice than 1.Na3. So, while perfect players might draw each other with possibly wildly different styles of play, the reality is that "real-world-good" moves should be preferred over "not-so-real-world-good" moves, which significantly constrains one's choices. But in the end I have to agree: whether these practical limitations will eventually produce One True Playing Style or not remains to be seen.
LC0 chess can never be “truth” because it is a statistical machine which can never output e4 with p = 1.0
MCTS is statistical. The NN outputs are statistical.

Re: Similarity tester - 2nd generation - BETA

Posted: Thu Aug 29, 2019 1:10 pm
by jp
chrisw wrote: Tue Aug 27, 2019 8:40 pm LC0 chess can never be “truth” because it is a statistical machine which can never output e4 with p = 1.0
MCTS is statistical. The NN outputs are statistical.
And in the present it's even odder to make any suggestions about truth, when Lc0 is losing games, as are all other engines.