Leela doing well in chess 960 in TCEC!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Leela doing well in chess 960 in TCEC!

Post by Nay Lin Tun »

There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)

This is current standing of 4 engines RR and there will be two engines in 50 games final!

https://imgur.com/JesXld9
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: Leela doing well in chess 960 in TCEC!

Post by Alayan »

Stockfish's NN has not been trained at all on Chess960 and so is quite bad at it. NNUE gained a lot of strength in classical but almost none in FRC.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Leela doing well in chess 960 in TCEC!

Post by Laskos »

Nay Lin Tun wrote: Mon Nov 23, 2020 12:38 am There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)

This is current standing of 4 engines RR and there will be two engines in 50 games final!

https://imgur.com/JesXld9
It will perform well on things it will be trained for. With older nets, it under-performed by more than 50 Elo points in FRC compared to standard chess.
MMarco
Posts: 195
Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante

Re: Leela doing well in chess 960 in TCEC!

Post by MMarco »

Laskos wrote: Mon Nov 23, 2020 1:35 am
Nay Lin Tun wrote: Mon Nov 23, 2020 12:38 am There were some myths (or data) that Leela will not be good at chess 960.
Now she is the only engine in TCEC chess 960 (FRC) without a loss in the whole tourney so far!
(Afaik, there were a few FRC positions in the book that was briefly used in T60 but training with a book was stopped because there was no improvement for Leela using a book in training)

This is current standing of 4 engines RR and there will be two engines in 50 games final!

https://imgur.com/JesXld9
It will perform well on things it will be trained for. With older nets, it under-performed by more than 50 Elo points in FRC compared to standard chess.
According to one of Leela dev on discord:
Tilps wrote: It has seen some FRC positions - specifically from tcec FRC1 IIRC
but its network is not FRC adapted
so its still clueless about the specifics of FRC castling
(like which of opponents rooks can still be castled with)
...
the real question is whether any of the training window [with FRC games] was used to train J92 nets
even if T60 did learn to change its weights abit - and then subsequently didn't unlearn it
that doesn't mean much for J92
Apparently, J92-330 didn't received much training at FRC, if any.

So much for the theory "Leela is an opening book"? 🙂
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: Leela doing well in chess 960 in TCEC!

Post by Nay Lin Tun »

Leela is a book for FRC as well !!! :P :mrgreen: :twisted:
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: Leela doing well in chess 960 in TCEC!

Post by Alayan »

Comparing Leela against two others NN that are not trained on FRC either, and Komodo that's not tuned on FRC and is much weaker in standard chess, doesn't show that it doesn't lose elo in FRC.

In FRC semi-league 2, Leela drew all 6 games against Ethereal, and without putting it in a difficult position out of the opening in any game. This is an indication of underperformance, considering that Leela beats Eth by 200 elo at FastGM 16 cores in standard chess.
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: Leela doing well in chess 960 in TCEC!

Post by Nay Lin Tun »

Alayan wrote: Mon Nov 23, 2020 2:01 pm Comparing Leela against two others NN that are not trained on FRC either, and Komodo that's not tuned on FRC and is much weaker in standard chess, doesn't show that it doesn't lose elo in FRC.

In FRC semi-league 2, Leela drew all 6 games against Ethereal, and without putting it in a difficult position out of the opening in any game. This is an indication of underperformance, considering that Leela beats Eth by 200 elo at FastGM 16 cores in standard chess.
What is your vote for FRC final ?

Now, majority of tcec mobs are voting for lco!! :mrgreen: :twisted: :wink:
Alayan
Posts: 550
Joined: Tue Nov 19, 2019 8:48 pm
Full name: Alayan Feh

Re: Leela doing well in chess 960 in TCEC!

Post by Alayan »

Leela might well beat Stockfish. NNUE without training on FRC positions seem to suffer a lot there.
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: Leela doing well in chess 960 in TCEC!

Post by Nay Lin Tun »

Alayan wrote: Mon Nov 23, 2020 4:57 pm Leela might well beat Stockfish. NNUE without training on FRC positions seem to suffer a lot there.
TCEC S19 Sufi showed that " Leela did not lose Stockfish in well balanced opening positions in the first half, but she lose Stockfish in TCEC custom opening positions, one sided almost losing positions in the second half ".

To solve TCEC specific Sufi problem, Leela team had trained T60 with all those TCEC sufi opening books from the last 4 seasons plus FRC positions :P :) :shock:
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Leela doing well in chess 960 in TCEC!

Post by Modern Times »

I'm not following this, but if Dragon by Komodo is in the FRC final then that would be my pick for the winner.