There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)
This is current standing of 4 engines RR and there will be two engines in 50 games final!
https://imgur.com/JesXld9
Leela doing well in chess 960 in TCEC!
Moderators: hgm, Rebel, chrisw
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: Leela doing well in chess 960 in TCEC!
Stockfish's NN has not been trained at all on Chess960 and so is quite bad at it. NNUE gained a lot of strength in classical but almost none in FRC.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Leela doing well in chess 960 in TCEC!
It will perform well on things it will be trained for. With older nets, it under-performed by more than 50 Elo points in FRC compared to standard chess.Nay Lin Tun wrote: ↑Mon Nov 23, 2020 12:38 am There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)
This is current standing of 4 engines RR and there will be two engines in 50 games final!
https://imgur.com/JesXld9
-
- Posts: 195
- Joined: Sun Apr 12, 2020 1:09 am
- Full name: Marc-O Moisan-Plante
Re: Leela doing well in chess 960 in TCEC!
According to one of Leela dev on discord:Laskos wrote: ↑Mon Nov 23, 2020 1:35 amIt will perform well on things it will be trained for. With older nets, it under-performed by more than 50 Elo points in FRC compared to standard chess.Nay Lin Tun wrote: ↑Mon Nov 23, 2020 12:38 am There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)
This is current standing of 4 engines RR and there will be two engines in 50 games final!
https://imgur.com/JesXld9
Apparently, J92-330 didn't received much training at FRC, if any.Tilps wrote: It has seen some FRC positions - specifically from tcec FRC1 IIRC
but its network is not FRC adapted
so its still clueless about the specifics of FRC castling
(like which of opponents rooks can still be castled with)
...
the real question is whether any of the training window [with FRC games] was used to train J92 nets
even if T60 did learn to change its weights abit - and then subsequently didn't unlearn it
that doesn't mean much for J92
So much for the theory "Leela is an opening book"?
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: Leela doing well in chess 960 in TCEC!
Leela is a book for FRC as well !!!
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: Leela doing well in chess 960 in TCEC!
Comparing Leela against two others NN that are not trained on FRC either, and Komodo that's not tuned on FRC and is much weaker in standard chess, doesn't show that it doesn't lose elo in FRC.
In FRC semi-league 2, Leela drew all 6 games against Ethereal, and without putting it in a difficult position out of the opening in any game. This is an indication of underperformance, considering that Leela beats Eth by 200 elo at FastGM 16 cores in standard chess.
In FRC semi-league 2, Leela drew all 6 games against Ethereal, and without putting it in a difficult position out of the opening in any game. This is an indication of underperformance, considering that Leela beats Eth by 200 elo at FastGM 16 cores in standard chess.
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: Leela doing well in chess 960 in TCEC!
What is your vote for FRC final ?Alayan wrote: ↑Mon Nov 23, 2020 2:01 pm Comparing Leela against two others NN that are not trained on FRC either, and Komodo that's not tuned on FRC and is much weaker in standard chess, doesn't show that it doesn't lose elo in FRC.
In FRC semi-league 2, Leela drew all 6 games against Ethereal, and without putting it in a difficult position out of the opening in any game. This is an indication of underperformance, considering that Leela beats Eth by 200 elo at FastGM 16 cores in standard chess.
Now, majority of tcec mobs are voting for lco!!
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: Leela doing well in chess 960 in TCEC!
Leela might well beat Stockfish. NNUE without training on FRC positions seem to suffer a lot there.
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: Leela doing well in chess 960 in TCEC!
TCEC S19 Sufi showed that " Leela did not lose Stockfish in well balanced opening positions in the first half, but she lose Stockfish in TCEC custom opening positions, one sided almost losing positions in the second half ".
To solve TCEC specific Sufi problem, Leela team had trained T60 with all those TCEC sufi opening books from the last 4 seasons plus FRC positions
-
- Posts: 3550
- Joined: Thu Jun 07, 2012 11:02 pm
Re: Leela doing well in chess 960 in TCEC!
I'm not following this, but if Dragon by Komodo is in the FRC final then that would be my pick for the winner.