3497 elo Leela, possibly 4th best chess engine now!!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Uri Blass
Posts: 10282
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Uri Blass »

Henk wrote: Tue Aug 07, 2018 2:30 pm But its performance on WCCC was a huge disappointment and that was only a few weeks ago.
I do not think that it was a huge disappointment.
It had some good results and it could get a draw position against komodo only to lose on time.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Laskos »

Jouni wrote: Tue Aug 07, 2018 4:24 pm Even if Leela were at Stockfish dev level I am not interested yet! Because 1. You need additional hardware - no thanks and 2. it can't solve any difficult test position.
The additional hardware issue is a bogus one. We are too much into CPU paradigm, while the things in the last 2-3 years changed seriously. Now GPUs are much trendier in frontlines like cryptocurrencies and Deep Learning. Many people in these fields spend 70-80% on GPUs and 10-20% on CPUs. I compared apples to apples price-wise: my GPU GTX 1060 6GB is very close in price to my CPU i7-4790, maybe 10% cheaper. I am already considering buying a second GTX 1060 GPU, probably when the next Nvidia line will appear on the market, so price-wise, my PC will become GPU dominated. I personally know folks in bitcoin mining having arrays of 10-20 GPUs and only one Xeon CPU.
Your second point is referring to tactical test suites, very popular on Talkchess. I am not sure why such a plethora of people here are fascinated by these puzzles, most of the puzzles posted here almost never occur in real games. It's probably an inertia from magazines of the distant past with "solve mate in 3", and people of Talkchess cannot adjust to present times. On my positional test-suite, some of the nets of Leela are performing very well, just behind top 3 engines.

Buy a reasonable GPU, that would be my advice.
Karol Majewski
Posts: 106
Joined: Sat Jul 09, 2011 4:18 pm

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Karol Majewski »

OK, so I have this CPU version of LC0 v 0.16 (blas). How strong is it on a single CPU with the latest network (573)?
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Laskos »

Karol Majewski wrote: Tue Aug 07, 2018 5:24 pm OK, so I have this CPU version of LC0 v 0.16 (blas). How strong is it on a single CPU with the latest network (573)?
Maybe Fruit 2.1 level in CCRL 40/4 conditions. Haven't checked on CPU long time. Also, always specify TC.
oreopoulos
Posts: 110
Joined: Fri Apr 25, 2008 10:56 pm

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by oreopoulos »

A comparison is easy to make and the unit of measurement is, of course, the Wattage. It may not be in favor of CPU's but that is a measure of computing effort

Personally, I do not use the engines as "horses" but only as analysis tools. LC0 has a much better position understanding than any other engine by a mile.
It still has a lot of tactical issues but those will be ironed out as training continues. It has also a lot to learn in endgames, especially what is drawn and what is not, but I am sure it will generalize greatly in that aspect too.

An extra benefit is that the solution scales perfectly with hardware increase.
flither
Posts: 19
Joined: Thu Aug 02, 2018 11:16 pm
Full name: Raf Levsky

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by flither »

My phones' battery holds 13Wh. SF 010718 on my phone can run on 8 cores for 4 hours straight with approx 5000knps until battery is dead, so it's eating ~3 watts per hour/5000knps. PC running SF at 10x5000knps=50000knps should consume 30 watts per hour than. Does it make any sense regarding wattage comparisons, or I missed something?
flither
Posts: 19
Joined: Thu Aug 02, 2018 11:16 pm
Full name: Raf Levsky

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by flither »

...and Leela is not 3497 Elo. People, stop spreading fabricated ratings :roll:
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Laskos »

flither wrote: Tue Aug 07, 2018 10:23 pm ...and Leela is not 3497 Elo. People, stop spreading fabricated ratings :roll:
No, last time I checked, it was 6200+ Elo on main server nets. So, it's more than twice as strong as Magnus Carlsen, who is barely 2850 Elo. But if you add Carlsen + Caruana + Aronian, they will have more Elo than Leela.
flither
Posts: 19
Joined: Thu Aug 02, 2018 11:16 pm
Full name: Raf Levsky

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by flither »

Free-roaming Elo lol. I lost track of it already :mrgreen: But it's good advertisement I have to admit
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: 3497 elo Leela, possibly 4th best chess engine now!!

Post by Milos »

Laskos wrote: Tue Aug 07, 2018 5:29 pm
Karol Majewski wrote: Tue Aug 07, 2018 5:24 pm OK, so I have this CPU version of LC0 v 0.16 (blas). How strong is it on a single CPU with the latest network (573)?
Maybe Fruit 2.1 level in CCRL 40/4 conditions. Haven't checked on CPU long time. Also, always specify TC.
Lc0 0.16 on 1060 (net 570) that gets 7200nps is around 29% vs. latest SFdev on single core on 40/4 TC. That is roughly 250Elo below SFdev.
Lc0 0.16 blas on single core is around 24nps. That is like 300x or like 8.3 doublings weaker than on 1060. If we assume a doubling is like 60 Elo (conservative) that is at least another 500Elo in addition to those 250Elo. Assuming latest SFdev on 40/4 single core is around 3520Elo, Lc0 0.16 single core is not stronger than 2750Elo, which is around Fruit 2.1.