this will be the merge of a lifetime : SF 80 Elo+

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Joerg Oster
Posts: 937
Joined: Fri Mar 10, 2006 4:29 pm
Location: Germany

Re: When to check NNUE box

Post by Joerg Oster »

zullil wrote: Sat Aug 08, 2020 3:11 pm
Sven wrote: Sat Aug 08, 2020 2:56 pm
JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Actually 2.5 pawns, since the formula also uses a fixed score of 200 for pawns (usually 256 in SF).
Yes, but things have already changed due to new patches. Wish someone would maintain a Stockfish+NNUEonly fork. :wink:
https://github.com/joergoster/Stockfish ... nue_always :D
Jörg Oster
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: When to check NNUE box

Post by Ovyron »

zullil wrote: Sat Aug 08, 2020 3:58 pm Yes, I can modify source code before compiling so that "Use NNUE" means "Use NNUE only". But that's going to get old very quickly. :wink:
So, basically you just want someone that doesn't find this getting old quickly to maintain a Stockfish fork and do this for you? :mrgreen:
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: When to check NNUE box

Post by zullil »

Ovyron wrote: Sat Aug 08, 2020 4:31 pm
zullil wrote: Sat Aug 08, 2020 3:58 pm Yes, I can modify source code before compiling so that "Use NNUE" means "Use NNUE only". But that's going to get old very quickly. :wink:
So, basically you just want someone that doesn't find this getting old quickly to maintain a Stockfish fork and do this for you? :mrgreen:
Yes :D Like my new hero, Joerg!

(Though eventually I should spend the time to learn how to use git fully myself. :oops: )
Last edited by zullil on Sat Aug 08, 2020 4:39 pm, edited 1 time in total.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: When to check NNUE box

Post by zullil »

Joerg Oster wrote: Sat Aug 08, 2020 4:20 pm
zullil wrote: Sat Aug 08, 2020 3:11 pm
Sven wrote: Sat Aug 08, 2020 2:56 pm
JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Actually 2.5 pawns, since the formula also uses a fixed score of 200 for pawns (usually 256 in SF).
Yes, but things have already changed due to new patches. Wish someone would maintain a Stockfish+NNUEonly fork. :wink:
https://github.com/joergoster/Stockfish ... nue_always :D
Thanks, Joerg!
User avatar
M ANSARI
Posts: 3707
Joined: Thu Mar 16, 2006 7:10 pm

Re: When to check NNUE box

Post by M ANSARI »

JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.

Hmmm ... ok now I understand it better. I was under the impression that a more sophisticated algo was used to decide when to turn NN off. I think there will be a lot more easy ELO points gained as this formula gets modified and tested. Maybe a 20mb is too small a network and things would be better with a larger network as per Lc0. Maybe the number of pieces remaining on the board or the number of possible good branching moves available are better identifiers of when to cut NN off. Will certainly be an interesting period as this gets developed further. It is pretty incredible what a game changer Alpha Zero and AI has been in revolutionizing chess engines. I sort of expected this to happen eventually but in 20 years or so from now ... but this is happening today!
Geonerd
Posts: 79
Joined: Fri Mar 10, 2017 1:44 am

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Geonerd »

MikeB wrote: Thu Aug 06, 2020 2:32 pm
Amen - I love it when I see an atheist quoting the Bible ... an old friend of my said this once - lets just say the atheist view is correct - well ,when we die, we die and and we all go back to dust
. But just say there is a God, then atheist gets to spend his eternal years in hell and the rest of us are in the Glory of God for eternal time - what would a risk averse person do?
<Thread Hijack!>

Pascal's Wager is an awfully thin rationale for believing. As the wise Homer Simpson observed: "But Marge, suppose we've chosen the wrong god? Every time we go to church we're just making him madder and madder!"

And, seriously, do you really think any god that would torture his own creations is worthy of worship? That's a pretty twisted world view! ;)

<We now return to the normal TC bickering and sniping! :P >
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leo »

Geonerd wrote: Sat Aug 08, 2020 9:16 pm
MikeB wrote: Thu Aug 06, 2020 2:32 pm
Amen - I love it when I see an atheist quoting the Bible ... an old friend of my said this once - lets just say the atheist view is correct - well ,when we die, we die and and we all go back to dust
. But just say there is a God, then atheist gets to spend his eternal years in hell and the rest of us are in the Glory of God for eternal time - what would a risk averse person do?
<Thread Hijack!>

Pascal's Wager is an awfully thin rationale for believing. As the wise Homer Simpson observed: "But Marge, suppose we've chosen the wrong god? Every time we go to church we're just making him madder and madder!"

And, seriously, do you really think any god that would torture his own creations is worthy of worship? That's a pretty twisted world view! ;)

<We now return to the normal TC bickering and sniping! :P >
I can see that God does not live up to your standards or expectations. Nothing like the created poking his finger in the eye of the Creator.
Advanced Micro Devices fan.
Cornfed
Posts: 511
Joined: Sun Apr 26, 2020 11:40 pm
Full name: Brian D. Smith

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Cornfed »

Strikes me as ideal for researching positions that arise at the ‘end of opening’ phase.
How best to set this up for simple analysis of options in those positions?
Also, taking Chessbase as an example, is all one need to do: download the file containing

1.Eval folder
2. SF-nnue-avx2.exe
Sf-nnue-bmi2.exe
Sf-nnue-popcount.exe

Save that onto your hard drive. I save mine in: This PC ->Documents ->ChessBase-> Engines (Local).
Then activate one (lets say popcount), “add engine” to ChessBase engine options with properties options “Use NNUE” checked, EvalFile: ./eval/nn.bin; and I have chosen Analysis Contempt – “Off”

….and then analyze the position you want to delve into?
carldaman
Posts: 2283
Joined: Sat Jun 02, 2012 2:13 am

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by carldaman »

It defeats the purpose if the NNUE cannot always be set to active [as an option], because then you're at the mercy of the engine only using NNUE when it chooses. Hopefully the SF team will wake up to the fact that people also use the engine for analysis.
User avatar
Deberger
Posts: 91
Joined: Sat Nov 02, 2019 6:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Deberger »

carldaman wrote: Sat Aug 08, 2020 10:57 pm It defeats the purpose if the NNUE cannot always be set to active [as an option], because then you're at the mercy of the engine only using NNUE when it chooses. Hopefully the SF team will wake up to the fact that people also use the engine for analysis.
With a trivial change to the source code, you can build your own executable which always uses NNUE.

However this change can never yield stronger analysis.

Over time, using "always NNUE" will be gradually weaker and weaker as the nets are optimized for their intended use in balanced positions.
Last edited by Deberger on Sun Aug 09, 2020 2:12 am, edited 2 times in total.