Trying out the Leela Hybrid engine (NN with AB)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
yanquis1972
Posts: 1762
Joined: Tue Jun 02, 2009 10:14 pm

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by yanquis1972 » Fri Feb 22, 2019 5:21 pm

do you mean lower ST (if you're referring to the threshold value)?

User avatar
Laskos
Posts: 9311
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Laskos » Fri Feb 22, 2019 5:53 pm

I think it's important to keep in mind that we assume Auxiliary engine must just help Lc0 tactically, and ideally it's much weaker than both Lc0 and its opponent. Many might be be tempted to use Auxiliary engine the level of SF, while their Lc0 is weaker than SF in some conditions. Even on my powerful GPU set-up this might occur. So, I took as Auxiliary engine Arasan 19.01 on 1 thread, an AB engine some 800-900 Elo points weaker than both Lc0 t30 and SF on 4 cores. It still helps a lot, solving many more positions on trimmed WAC tactical test suite and not harming almost at all the positional abilities of Lc0 (on my positional test-suite). But I changed some settings to get such a result with a weak Auxiliary engine:

AuxEngineBoost=20.00
AuxEngineDepth=10
AuxEngineThreshold=10
AuxEngineFollowPvDepth=3

In games, it increases Lc0 t30 strength against SF10 (4 cores) by some 35-40 Elo points, and the weak Arasan 19.01 on 1 thread helps almost as much as SF10 as an auxiliary engine (SF10 adds some 40-50 Elo points). The games were at bullet TC.

With SF10 as an auxiliary engine, many settings will work, as it is close in strength or stronger than Lc0, but with a weak auxiliary AB engine, finding correct settings is trickier. It has to know when it can intervene, and this is usually the case of gross tactical mistakes of Lc0. Still, endgames are bad.

User avatar
Eduard
Posts: 197
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Eduard » Fri Feb 22, 2019 6:53 pm

Why is it not possible for the AuxEngine to use endgame tablebases?

User avatar
Eduard
Posts: 197
Joined: Fri Oct 26, 2018 10:58 pm
Location: Germany
Full name: Eduard Nemeth
Contact:

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Eduard » Fri Feb 22, 2019 10:36 pm

I see that it is also possible to combine two neural networks. One as the main engine and one as the AuxEngine. Interesting.

glennsamuel32
Posts: 84
Joined: Sat Dec 04, 2010 4:31 pm
Location: 223

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by glennsamuel32 » Sat Feb 23, 2019 5:08 am

KillerDucky wrote:
Tue Feb 19, 2019 8:59 pm
I'm not a C++ programmer or an expert on chess engines, so I tried to keep it simple.
Thanks, super effort for a first attempt !!
Works fine without any issues for me on Fritz 15, even with ponder on for both engines.

Could you elaborate on what "AuxEngineFollowPvDepth" means ?

User avatar
WinPooh
Posts: 243
Joined: Fri Mar 17, 2006 7:01 am
Location: Russia
Full name: Vladimir Medvedev
Contact:

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by WinPooh » Sat Feb 23, 2019 9:17 am

Eduard wrote:
Fri Feb 22, 2019 10:36 pm
I see that it is also possible to combine two neural networks. One as the main engine and one as the AuxEngine. Interesting.
And then add a third NN to decide which one to use.
But... isn't it equivalent to having just one, larger, network?

jjoshua2
Posts: 20
Joined: Sat Mar 10, 2018 5:16 am

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by jjoshua2 » Sat Feb 23, 2019 5:57 pm

Eduard wrote:
Fri Feb 22, 2019 10:36 pm
I see that it is also possible to combine two neural networks. One as the main engine and one as the AuxEngine. Interesting.
I tried that and it seemed to work for me.

KillerDucky
Posts: 12
Joined: Fri Mar 23, 2018 1:31 am

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by KillerDucky » Sun Feb 24, 2019 12:23 am

v0.21.0-fish-v0.4 released! Just one feature addition and one minor bug fix.

* Add support for AuxEngine to use Syzygy endgame tablebases. Automagic if you configure Lc0 to use Syzygy and AuxEngine supports them.
* Fix a bug with boosting Policy to larger than 100%. Also set maximum AuxEngineBoost to 100%. Internally Lc0 uses a compressed format for Policy so values larger than 100% do not work.

User avatar
sincerelybrent
Posts: 47
Joined: Fri Feb 15, 2019 10:41 pm
Full name: Brent M

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by sincerelybrent » Sun Feb 24, 2019 12:43 am

Terrific! Have a 0.3 gauntlet going atm. Will download soon. Thanks for all of your hard work on this, KillerD

supersharp77
Posts: 726
Joined: Sat Jul 05, 2014 5:54 am
Location: Southwest USA

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by supersharp77 » Sun Feb 24, 2019 4:57 am

AdminX wrote:
Tue Feb 19, 2019 1:52 pm
LeelaFish is a modified version of the Lc0 engine that gets help from an outside (auxiliary) engine. Leela uses the AuxEngine's PV to boost the Policy of those moves.
https://github.com/killerducky/lc0/wiki/LeelaFish

Downloaded it from the github site yesterday tried to get it to work this morning...got a cuda dll error with one LC0 compile and my AVG (antivirus) ate the second compile and said "Will check exe with the home (AVG) site and get back to me"
haven't heard back from AVG all day...anyone get it to work in cpu? Thx AR :D :wink:

Post Reply