100 Elo nosedive

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

100 Elo nosedive

Post by Dann Corbit » Wed Nov 14, 2018 10:15 pm

https://lczero.org/

I imagine someone will say it does not really mean that.
But that sure is what the graph looks like.

I wonder if someone made a naughty patch.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
Leto
Posts: 2028
Joined: Thu May 04, 2006 1:40 am
Location: Dune

Re: 100 Elo nosedive

Post by Leto » Thu Nov 15, 2018 1:12 am

If you test the individual nets against a non-LCZ engine you'll probably notice no or little elo gain the past few days despite what the self elo says. Unless it starts gaining some real elo soon I think they might have to do the second LR drop. I'm no expert in NN nets but I imagine when you see a sharp increase in self-play elo all it probably means is that LCZ has found a winning opening against the older nets, and then when the self-play elo sharply decreases it probably means that a weakness has been found in the winning opening. I might be wrong though...

Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: 100 Elo nosedive

Post by Dann Corbit » Thu Nov 15, 2018 1:16 am

That is an interesting theory. So they don't use opening books at all in testing?
Seems to me like it might be a good idea to force lots of oddball stuff like long and short castled sides, and things that might be puzzling like fianchetto bishops found in the Indian openings.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
CMCanavessi
Posts: 832
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: 100 Elo nosedive

Post by CMCanavessi » Thu Nov 15, 2018 3:03 am

Temperature decay is the key. Temperature (aka "randomness") starts very high in self-play games and is decreased as the game evolves. That makes an opening book not necessary, as you will see a lot of variation in the beginning of the game.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

ernest
Posts: 1833
Joined: Wed Mar 08, 2006 7:30 pm

Re: 100 Elo nosedive

Post by ernest » Thu Nov 15, 2018 10:46 pm

Dann Corbit wrote:
Wed Nov 14, 2018 10:15 pm
https://lczero.org/

I imagine someone will say it does not really mean that.
But that sure is what the graph looks like.

I wonder if someone made a naughty patch.
Well, your graph just got updated ! :D :roll:

I wonder if anybody can say something sensible about this data...

Looks more and more Lc0 is a hoax... that works !!!

Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: 100 Elo nosedive

Post by Dann Corbit » Fri Nov 16, 2018 1:03 am

Well, that hoax played pretty well in TCEC.
;-)
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Leo
Posts: 769
Joined: Fri Sep 16, 2016 4:55 pm
Location: USA/Minnesota
Full name: Leo

Re: 100 Elo nosedive

Post by Leo » Fri Nov 16, 2018 1:59 am

LCO needs a little help. Maybe a pill.
images_edited-1.jpg
images_edited-1.jpg (63.33 KiB) Viewed 1105 times
BrainFish-2 190310 bmi2 Elo 3576.

Dann Corbit
Posts: 9780
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: 100 Elo nosedive

Post by Dann Corbit » Fri Nov 16, 2018 2:25 am

He could never lift that pill out of there. He always had to get Polly the poodle to do it for him.
He should have just given her the ring.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Leo
Posts: 769
Joined: Fri Sep 16, 2016 4:55 pm
Location: USA/Minnesota
Full name: Leo

Re: 100 Elo nosedive

Post by Leo » Fri Nov 16, 2018 2:29 am

Dann Corbit wrote:
Fri Nov 16, 2018 2:25 am
He could never lift that pill out of there. He always had to get Polly the poodle to do it for him.
He should have just given her the ring.
lol
BrainFish-2 190310 bmi2 Elo 3576.

ernest
Posts: 1833
Joined: Wed Mar 08, 2006 7:30 pm

Re: 100 Elo nosedive

Post by ernest » Fri Nov 16, 2018 2:34 am

Dann Corbit wrote:
Fri Nov 16, 2018 1:03 am
Well, that hoax played pretty well in TCEC.
That's what I said... it works !

Not sure anybody has a deep understanding about how it progresses... 8-)

Post Reply