My take on the whole "End of an era" thing.
Moderators: hgm, Rebel, chrisw
-
- Posts: 27790
- Joined: Fri Mar 10, 2006 10:06 am
- Location: Amsterdam
- Full name: H G Muller
Re: My take on the whole "End of an era" thing.
More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
-
- Posts: 4315
- Joined: Tue Apr 03, 2012 4:28 pm
Re: My take on the whole "End of an era" thing.
Er, people who play chess from the usual opening position?hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
It’s true that current NNs are not good at playing lost positions nor good at playing wildly wonpositions but the former is lost anyway and the latter won, so so what?
-
- Posts: 1470
- Joined: Mon Apr 23, 2018 7:54 am
Re: My take on the whole "End of an era" thing.
More to the point, NN engines are good in the opening phase and get worse the longer the game goes on. That would be good for users who want an analysis engine if they suggested genuinely good opening novelties, but so far they haven't.chrisw wrote: ↑Wed May 01, 2019 2:31 pmEr, people who play chess from the usual opening position?hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
But as we've discussed in other threads, in endgames they can turn wins into draws and draws into losses.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: My take on the whole "End of an era" thing.
Well, Chess as a board game is defined as from default starting position. Number of positions reached in standard Chess is IIRC larger than a square root of total number of arbitrary positions using an allowed number of Chess pieces. But you are right, the vast majority of these arbitrary positions is badly analyzed by NN-based engines. I don't know if that can be corrected, hand-crafted eval is simply more generalist and possesses a higher level of abstraction.hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: My take on the whole "End of an era" thing.
Obviously the inferiority of NN engines for analyzing (that is in arbitrary position) depends on the dimension and structure of NN. In the case of an NN engine with bigger and better structured NN this issue is smaller.hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
We can hope the development of NN engine will reduce this issue.
-
- Posts: 27790
- Joined: Fri Mar 10, 2006 10:06 am
- Location: Amsterdam
- Full name: H G Muller
Re: My take on the whole "End of an era" thing.
The point is that people tend to play their own moves from that position, unless they happen to be operator for a NN engine in a computer tournament. And then they would like to get expert advice from an engine on the positions that result. LC0 is not very good at that; it will often come up with tactical blunders.chrisw wrote: ↑Wed May 01, 2019 2:31 pmEr, people who play chess from the usual opening position?hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: My take on the whole "End of an era" thing.
Not only that. On weird, unusual, "constructed" positions, Lc0 can be pretty bad both positionally and tactically, and I am not sure that can be corrected in the zero or quasi-zero framework. Large disbalances, endgames are other cases where Lc0 often sucks, but maybe that can be corrected.hgm wrote: ↑Wed May 01, 2019 3:54 pmThe point is that people tend to play their own moves from that position, unless they happen to be operator for a NN engine in a computer tournament. And then they would like to get expert advice from an engine on the positions that result. LC0 is not very good at that; it will often come up with tactical blunders.chrisw wrote: ↑Wed May 01, 2019 2:31 pmEr, people who play chess from the usual opening position?hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
-
- Posts: 1470
- Joined: Mon Apr 23, 2018 7:54 am
Re: My take on the whole "End of an era" thing.
Whether there's a better structure for an NN is an interesting question, but just making the NN bigger and bigger isn't a better solution than just making a traditional engine search deeper and deeper.corres wrote: ↑Wed May 01, 2019 3:15 pm Obviously the inferiority of NN engines for analyzing (that is in arbitrary position) depends on the dimension and structure of NN. In the case of an NN engine with bigger and better structured NN this issue is smaller.
We can hope the development of NN engine will reduce this issue.
-
- Posts: 4315
- Joined: Tue Apr 03, 2012 4:28 pm
Re: My take on the whole "End of an era" thing.
A/B engines with hand crafted evaluations working on general principles are very good at applying their principles onto all kind of chess positions. But, at same time, there are huge holes in hand crafted evaluations based around a) fortresses and similar and b) marrying together the forcedly material part of the evaluation with other aspects relating to the king and similar dynamic concepts. Result is a sometimes complete blindness and stupidity.Laskos wrote: ↑Wed May 01, 2019 4:12 pmNot only that. On weird, unusual, "constructed" positions, Lc0 can be pretty bad both positionally and tactically, and I am not sure that can be corrected in the zero or quasi-zero framework. Large disbalances, endgames are other cases where Lc0 often sucks, but maybe that can be corrected.hgm wrote: ↑Wed May 01, 2019 3:54 pmThe point is that people tend to play their own moves from that position, unless they happen to be operator for a NN engine in a computer tournament. And then they would like to get expert advice from an engine on the positions that result. LC0 is not very good at that; it will often come up with tactical blunders.chrisw wrote: ↑Wed May 01, 2019 2:31 pmEr, people who play chess from the usual opening position?hgm wrote: ↑Wed May 01, 2019 2:11 pm More important is that the NN-based engines aren't really very good at Chess in general: they seem to be quite inferior for analyzing arbitrary positions. The one thing they are good at is playing games from the opening position, because that allows them to avoid the large fraction of positions where they would suck. But who wants that?
NN engines have other problems, but they are quite good at fortresses and king aspects.
I mean what do you guys want? Endlessly expressing dissatisfaction.
-
- Posts: 1470
- Joined: Mon Apr 23, 2018 7:54 am
Re: My take on the whole "End of an era" thing.
But are they? Has anyone looked? What eval does Lc give for the fortress positions that are shown in this forum like this one: viewtopic.php?f=2&t=70507 ?