Trying out the Leela Hybrid engine (NN with AB)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by corres »

I have made a binary from a modified source of Leelafish in which I used fixed move time instead of fixed depth.
My experience is using too much Stockfish it does not enhance the Elo of Leelafish but it decreases it.
I think there is a great difference in style between Stockfish and Leela and because of this too much Stockfish disturbs the own evaluation of Leela. To find an optimum where the gain of Elo is on its maximum is not an easy task because it depends on a lot of parameters, mainly from the thinking time, duration of the game and the parameters of the helper engine.
Gregory Owett
Posts: 249
Joined: Fri Mar 10, 2006 10:26 am
Location: France

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Gregory Owett »

For you, what is the best auxiliary engine ?
User avatar
sincerelybrent
Posts: 47
Joined: Fri Feb 15, 2019 11:41 pm
Full name: Brent M

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by sincerelybrent »

Gregory Owett wrote: Wed Feb 27, 2019 2:29 pm For you, what is the best auxiliary engine ?
So far, Houdini 6 w/ "tactical mode=1" > Stockfishes. Haven't tried CFish, yet, but I'm going to soon.
Gregory Owett
Posts: 249
Joined: Fri Mar 10, 2006 10:26 am
Location: France

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Gregory Owett »

Thanks, I will try them!
KillerDucky
Posts: 12
Joined: Fri Mar 23, 2018 2:31 am

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by KillerDucky »

v0.21.0-fish-v0.6 released!

Note the new name AuxEngineFile, you'll need to update your GUI to use that option instead of the old one.

* Rename AuxEnginePath to AuxEngineFile (helps chess GUIs know to select a file not a directory).
* Fix some crashes parsing AuxEngine pv output.

I tested a few engines and verified they're fixed with this release. Please let me know any engines that still don't work (including a log file with AuxEngineVerbosity=10 would be helpful too).
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Eduard »

With CPU-version Komodo works now, thank you!
CositasBuenas
Posts: 107
Joined: Tue Aug 03, 2010 7:36 pm

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by CositasBuenas »

Windows Defender Antivirus raises the alarm and refuses the download (v0.6). What to do?
Michael
CositasBuenas
Posts: 107
Joined: Tue Aug 03, 2010 7:36 pm

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by CositasBuenas »

I think there is a memory leak. Would you please check this!
Regards, Michael
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by dkappe »

Some thoughts:

- Just when you want to see if leelafish prevents a “brilliant positional sacrifice,” you can’t lay your hands on one. Has anyone got a collection of leela positional stunners they can test against?
- lowering threshold means many more positions will be looked at. Since the aux engine is the bottleneck, you need to lower the depth to process them all, or have several engine instances running in parallel.
- there’s a paper that sought to guide mcts with ab search (https://dke.maastrichtuniversity.nl/m.w ... _final.pdf). As I recall, 3 ply was the winner. Now there was no nn guiding the mcts, but I’m curious if depth 3 and threshold 1 (or 0) does better than 15/100 or if the truth lies somewhere in between.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by corres »

dkappe wrote: Thu Feb 28, 2019 4:40 pm Some thoughts:

- Just when you want to see if leelafish prevents a “brilliant positional sacrifice,” you can’t lay your hands on one. Has anyone got a collection of leela positional stunners they can test against?
- lowering threshold means many more positions will be looked at. Since the aux engine is the bottleneck, you need to lower the depth to process them all, or have several engine instances running in parallel.
- there’s a paper that sought to guide mcts with ab search (https://dke.maastrichtuniversity.nl/m.w ... _final.pdf). As I recall, 3 ply was the winner. Now there was no nn guiding the mcts, but I’m curious if depth 3 and threshold 1 (or 0) does better than 15/100 or if the truth lies somewhere in between.
In this case Stockfish is not the optimal choice for Leelafish because Stockfish works as a Stockfish
if depth > 12.
Maybe we need a specialized Stockfish for Leelafish, I think.
But this question can be decided by tests only.