LCZero Accomplishments and Goals Thus Far

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

jp
Posts: 1482
Joined: Mon Apr 23, 2018 7:54 am

Re: LCZero Accomplishments and Goals Thus Far

Post by jp »

hgm wrote:
duncan wrote:using the metric elo/byte ?
Indeed, but at source-code level. So Elo/character.

Not a metric that the average buyer of a Chess engine would give a hoot about, of course.
I am confident we can configure Stockfish using cutting-edge industry techniques to get the desired Min-Max match result for any metric the average buyer gives a hoot about.
User avatar
hgm
Posts: 28354
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: LCZero Accomplishments and Goals Thus Far

Post by hgm »

Not sure what that means, and why anyone would give a hoot about it...

It doesn't seem related to the discussed topics at all.
mar
Posts: 2659
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: LCZero Accomplishments and Goals Thus Far

Post by mar »

I don't care how Leela performs on a toaster, on my hw it seems to perform at ~2900 CCRL (ID 227) even at a fast 40 moves in 1 minute, no way it's 2100 :D
Fully utilizing available hardware is hardly "unfair".

She will smoke 3k engines in next TCEC.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: LCZero Accomplishments and Goals Thus Far

Post by Laskos »

mar wrote:I don't care how Leela performs on a toaster, on my hw it seems to perform at ~2900 CCRL (ID 227) even at a fast 40 moves in 1 minute, no way it's 2100 :D
Fully utilizing available hardware is hardly "unfair".

She will smoke 3k engines in next TCEC.
Try 40 moves in 1 hour, it will be 3100 or so.
lucasart
Posts: 3241
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: LCZero Accomplishments and Goals Thus Far

Post by lucasart »

mar wrote:I don't care how Leela performs on a toaster, on my hw it seems to perform at ~2900 CCRL (ID 227) even at a fast 40 moves in 1 minute, no way it's 2100 :D
Fully utilizing available hardware is hardly "unfair".

She will smoke 3k engines in next TCEC.
Don't underestimate the toaster. With the internet of things, we might see toasters able to connect to large servers or bitcoin mining farms with enormous computing power…

Toasters could be the future of chess ;)
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
User avatar
hgm
Posts: 28354
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: LCZero Accomplishments and Goals Thus Far

Post by hgm »

As one robot said to the other: "I will explain this in such simple terms that even a washing machine can understand it!". :lol:
FWCC
Posts: 117
Joined: Wed Aug 22, 2007 4:39 pm

Re: LCZero Accomplishments and Goals Thus Far

Post by FWCC »

We must also remember we will compare LCZero with the latest Stockfish Dev. Version not some watered down old version like DeepMind. We will be more in the know. In order to use mainstream hardware with success we must push Leela beyond A0.In time will she pass A0?
User avatar
hgm
Posts: 28354
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: LCZero Accomplishments and Goals Thus Far

Post by hgm »

Oh, if the goal is just to make a strong engine, I am sure you can do much better than AlphaZero, algorithm wise. By not presenting the NN just with a raw position, but already pre-processing the position in a way known to be relevant for Chess, such as number of attackers / protectors of each square, the lowest attacker/protector of each square, pinned pieces and discovered attacks, etc. I am pretty sure it must recognize such elementary features to be any good, and then it would not have to learn recognizing them (in a way that even after it has learned it will be quite calculationally intensive).

Of course in practice you will also have to bridge the hardware gap between GPUs and TPUs.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: LCZero Accomplishments and Goals Thus Far

Post by Milos »

hgm wrote:Oh, if the goal is just to make a strong engine, I am sure you can do much better than AlphaZero, algorithm wise. By not presenting the NN just with a raw position, but already pre-processing the position in a way known to be relevant for Chess, such as number of attackers / protectors of each square, the lowest attacker/protector of each square, pinned pieces and discovered attacks, etc. I am pretty sure it must recognize such elementary features to be any good, and then it would not have to learn recognizing them (in a way that even after it has learned it will be quite calculationally intensive).
Lol, you are sure. When you are so sure, why don't you contribute with some code to LC0 git. Doesn't have to be main inefficient OpenCL code of Gian-Carlo, you can contribute to TF brench of it. Just implement your net in keras and add it to the repository so we can all test how strong it becomes. I'm pretty convinced ppl would test whatever you post no matter how much "out of spirit" of original A0 it was.

But somehow, I have a feeling you won't because you have no clue how. You know just to go around and splash your "wisdom". :lol:
User avatar
hgm
Posts: 28354
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: LCZero Accomplishments and Goals Thus Far

Post by hgm »

I missed how much you are offering to pay me for that?

Actually I did play against a Shogi program that played by an NN + preprocessing along the lines I outlined above, and without any search it was able to beat my alpha-beta searcher at ~2min/move. (The NN needed ~10 sec/move, as it was playing on the CPU of a laptop.)

No reason to suppose the same couldn't work in Chess. But of course you are as ignorant about progress in Shogi as about almost anything else...