Page 1 of 6

SF-NN embedded

Posted: Thu Aug 27, 2020 7:49 am
by MikeB
Beta - built for AMD Ryzen CPUs - has the NN file embedded - code by the highly talented Stephan Nicolet, a long time Stockfish contributor and maintainer - \

his PR https://github.com/official-stockfish/S ... /pull/3070

some beta exe's built... both the official Stockfish and the Honey engines - all are pkx'ed to reduce download size to about 13 MB...optimized for the Ryzen CPUs

https://github.com/MichaelB7/Stockfish/ ... ta_amd.zip 75MB download - 6 engines)

source for the honey-embedded

https://github.com/MichaelB7/Stockfish/tree/honey-embed

feel free to kick the tires...

also since Stockfish-XIr5 is no longer an exact functional clone of SF, internally it has been renamed "Oki Maguro" roughly translated meaning the "Big Tuna". In honor and appreciation of our Japanese friends who gave us NN for Stockfish.

Code: Select all

# Sto*r5.exe



   ####            #     #                              ####        .-'`````'-.   #     # ###
  #    # #   #  #  ##   ##   ##    ####  #    # #####  #    #   (\  /   \   /   \   #   #  #
  #    # #  #   #  # # # #  #  #  #    # #    # #    # #    #  ) \/   (@) (@)   \   # #    #
  #    # ###    #  #  #  # #    # #      #    # #    # #    # (__(       W       )   #     #
  #    # #  #   #  #     # ###### #  ### #    # #####  #    #    (  V v V V v V  )  # #    #
  #    # #   #  #  #     # #    # #    # #    # #   #  #    #     \  A A A A A  /  #   #   #
   ####  #    # #  #     # #    #  ####   ####  #    #  ####       \/\-.,,,.-/\/  #     # ###


    Oki Maguro XIr5  by Stockfish Developers as noted in the AUTHORS file

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 12:35 pm
by pferd
But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 3:38 pm
by MikeB
pferd wrote: Thu Aug 27, 2020 12:35 pm But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
Technically, you are correct
A user's experience loading the Evalfile will vary based on his own level of expertise, OS, GUI etc. Anecdotally , the SF team has heard from a number of users that have had issues. Embedding the file makes most of those issues go away. There will also be a side benefit of pairing the correct EvalFile with the correct version of the exe. As changes are mading going forward, there is no guarantee that a EvalFile created in 2020 will work with a SF exe created in 2021. These are just some of the comments I have read. I personally, like you , have not had any issues, but I can certainly see some benefit in embedding the correct EvalfIle with the correct SF executable for the reasons stated above, i.e., simplicity of use and correct exe pairing. YMMV.

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 4:59 pm
by Deberger
pferd wrote: Thu Aug 27, 2020 12:35 pm But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 5:25 pm
by Joerg Oster
Deberger wrote: Thu Aug 27, 2020 4:59 pm
pferd wrote: Thu Aug 27, 2020 12:35 pm But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030
So I guess you don't use syzygy tablebases?

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 5:31 pm
by Deberger
Joerg Oster wrote: Thu Aug 27, 2020 5:25 pm
Deberger wrote: Thu Aug 27, 2020 4:59 pm
pferd wrote: Thu Aug 27, 2020 12:35 pm But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030
So I guess you don't use syzygy tablebases?

I DO use syzygy table bases :-)

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 5:50 pm
by Joerg Oster
Deberger wrote: Thu Aug 27, 2020 5:31 pm I DO use syzygy table bases :-)
:D
So how is specifying a path to the TB files so much different
from providing a path to a network file?

Joking aside ...
I have 5man syzygy files in a folder separated from the 6man files.
Whenever I want to use 5man bases only, I provide one path.
If I want to use both, I simply pass both folders to Stockfish.
Not really rocket science ... 8-)

But now with this NNUE network file, it looks like both, users and devs,
simply forgot all basic knowledge and try to solve something which isn't really broken, imho.

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 6:02 pm
by Deberger
Joerg Oster wrote: Thu Aug 27, 2020 5:50 pm
Deberger wrote: Thu Aug 27, 2020 5:31 pm I DO use syzygy table bases :-)
:D
So how is specifying a path to the TB files so much different
from providing a path to a network file?

Joking aside ...
I have 5man syzygy files in a folder separated from the 6man files.
Whenever I want to use 5man bases only, I provide one path.
If I want to use both, I simply pass both folders to Stockfish.
Not really rocket science ... 8-)

But now with this NNUE network file, it looks like both, users and devs,
simply forgot all basic knowledge and try to solve something which isn't really broken, imho.
It IS broken at the moment.

ERROR: NNUE evaluation used, but the network file was not loaded

This is unsatisfactory behavior for modern software.

- - -

spellcheck file.txt

ERROR: Copy a spelling dictionary to the dict directory and configure spellcheck to point to the dict directory.

- - -

wysiwyg file.doc

ERROR: Copy some font files to the fonts directory and configure wysiwyg to point to the fonts directory.

- - -

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 7:54 pm
by MikeB
They will figure it out ... this is all volunteer work, feel free to contribute if you see a better way, the door is wide open ...

Re: SF-NN embedded

Posted: Thu Aug 27, 2020 8:50 pm
by Deberger
MikeB wrote: Thu Aug 27, 2020 7:54 pm They will figure it out ... this is all volunteer work, feel free to contribute if you see a better way, the door is wide open ...
I would be satisfied with any of the 5 proposed solutions,

https://github.com/official-stockfish/S ... ssues/3030

including this embedded option (number 5).