SF-NN embedded

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
MikeB
Posts: 4489
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

SF-NN embedded

Post by MikeB » Thu Aug 27, 2020 5:49 am

Beta - built for AMD Ryzen CPUs - has the NN file embedded - code by the highly talented Stephan Nicolet, a long time Stockfish contributor and maintainer - \

his PR https://github.com/official-stockfish/S ... /pull/3070

some beta exe's built... both the official Stockfish and the Honey engines - all are pkx'ed to reduce download size to about 13 MB...optimized for the Ryzen CPUs

https://github.com/MichaelB7/Stockfish/ ... ta_amd.zip 75MB download - 6 engines)

source for the honey-embedded

https://github.com/MichaelB7/Stockfish/tree/honey-embed

feel free to kick the tires...

also since Stockfish-XIr5 is no longer an exact functional clone of SF, internally it has been renamed "Oki Maguro" roughly translated meaning the "Big Tuna". In honor and appreciation of our Japanese friends who gave us NN for Stockfish.

Code: Select all

# Sto*r5.exe



   ####            #     #                              ####        .-'`````'-.   #     # ###
  #    # #   #  #  ##   ##   ##    ####  #    # #####  #    #   (\  /   \   /   \   #   #  #
  #    # #  #   #  # # # #  #  #  #    # #    # #    # #    #  ) \/   (@) (@)   \   # #    #
  #    # ###    #  #  #  # #    # #      #    # #    # #    # (__(       W       )   #     #
  #    # #  #   #  #     # ###### #  ### #    # #####  #    #    (  V v V V v V  )  # #    #
  #    # #   #  #  #     # #    # #    # #    # #   #  #    #     \  A A A A A  /  #   #   #
   ####  #    # #  #     # #    #  ####   ####  #    #  ####       \/\-.,,,.-/\/  #     # ###


    Oki Maguro XIr5  by Stockfish Developers as noted in the AUTHORS file
Image

pferd
Posts: 126
Joined: Thu Jul 24, 2014 12:49 pm

Re: SF-NN embedded

Post by pferd » Thu Aug 27, 2020 10:35 am

But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.

User avatar
MikeB
Posts: 4489
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: SF-NN embedded

Post by MikeB » Thu Aug 27, 2020 1:38 pm

pferd wrote:
Thu Aug 27, 2020 10:35 am
But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
Technically, you are correct
A user's experience loading the Evalfile will vary based on his own level of expertise, OS, GUI etc. Anecdotally , the SF team has heard from a number of users that have had issues. Embedding the file makes most of those issues go away. There will also be a side benefit of pairing the correct EvalFile with the correct version of the exe. As changes are mading going forward, there is no guarantee that a EvalFile created in 2020 will work with a SF exe created in 2021. These are just some of the comments I have read. I personally, like you , have not had any issues, but I can certainly see some benefit in embedding the correct EvalfIle with the correct SF executable for the reasons stated above, i.e., simplicity of use and correct exe pairing. YMMV.
Image

User avatar
Deberger
Posts: 70
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: SF-NN embedded

Post by Deberger » Thu Aug 27, 2020 2:59 pm

pferd wrote:
Thu Aug 27, 2020 10:35 am
But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030

Joerg Oster
Posts: 791
Joined: Fri Mar 10, 2006 3:29 pm
Location: Germany

Re: SF-NN embedded

Post by Joerg Oster » Thu Aug 27, 2020 3:25 pm

Deberger wrote:
Thu Aug 27, 2020 2:59 pm
pferd wrote:
Thu Aug 27, 2020 10:35 am
But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030
So I guess you don't use syzygy tablebases?
Jörg Oster

User avatar
Deberger
Posts: 70
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: SF-NN embedded

Post by Deberger » Thu Aug 27, 2020 3:31 pm

Joerg Oster wrote:
Thu Aug 27, 2020 3:25 pm
Deberger wrote:
Thu Aug 27, 2020 2:59 pm
pferd wrote:
Thu Aug 27, 2020 10:35 am
But why do we need embedding at all?

I had no trouble with downloading the eval file and to adjust the EvalFile setting correctly.
We need a robust installation for NNUE data.

1) ./configure
2) make
3) sudo make install

All done? Nope:

4) Manually copy the NNUE file to some directory
5) Configure the GUI to point to the NNUE directory

This is unsatisfactory.

There are plenty of multi-platform programs with supplemental data.

Developers just need to chose a scheme and implement.

https://github.com/official-stockfish/S ... ssues/3030
So I guess you don't use syzygy tablebases?

I DO use syzygy table bases :-)

Joerg Oster
Posts: 791
Joined: Fri Mar 10, 2006 3:29 pm
Location: Germany

Re: SF-NN embedded

Post by Joerg Oster » Thu Aug 27, 2020 3:50 pm

Deberger wrote:
Thu Aug 27, 2020 3:31 pm
I DO use syzygy table bases :-)
:D
So how is specifying a path to the TB files so much different
from providing a path to a network file?

Joking aside ...
I have 5man syzygy files in a folder separated from the 6man files.
Whenever I want to use 5man bases only, I provide one path.
If I want to use both, I simply pass both folders to Stockfish.
Not really rocket science ... 8-)

But now with this NNUE network file, it looks like both, users and devs,
simply forgot all basic knowledge and try to solve something which isn't really broken, imho.
Jörg Oster

User avatar
Deberger
Posts: 70
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: SF-NN embedded

Post by Deberger » Thu Aug 27, 2020 4:02 pm

Joerg Oster wrote:
Thu Aug 27, 2020 3:50 pm
Deberger wrote:
Thu Aug 27, 2020 3:31 pm
I DO use syzygy table bases :-)
:D
So how is specifying a path to the TB files so much different
from providing a path to a network file?

Joking aside ...
I have 5man syzygy files in a folder separated from the 6man files.
Whenever I want to use 5man bases only, I provide one path.
If I want to use both, I simply pass both folders to Stockfish.
Not really rocket science ... 8-)

But now with this NNUE network file, it looks like both, users and devs,
simply forgot all basic knowledge and try to solve something which isn't really broken, imho.
It IS broken at the moment.

ERROR: NNUE evaluation used, but the network file was not loaded

This is unsatisfactory behavior for modern software.

- - -

spellcheck file.txt

ERROR: Copy a spelling dictionary to the dict directory and configure spellcheck to point to the dict directory.

- - -

wysiwyg file.doc

ERROR: Copy some font files to the fonts directory and configure wysiwyg to point to the fonts directory.

- - -

User avatar
MikeB
Posts: 4489
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: SF-NN embedded

Post by MikeB » Thu Aug 27, 2020 5:54 pm

They will figure it out ... this is all volunteer work, feel free to contribute if you see a better way, the door is wide open ...
Image

User avatar
Deberger
Posts: 70
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: SF-NN embedded

Post by Deberger » Thu Aug 27, 2020 6:50 pm

MikeB wrote:
Thu Aug 27, 2020 5:54 pm
They will figure it out ... this is all volunteer work, feel free to contribute if you see a better way, the door is wide open ...
I would be satisfied with any of the 5 proposed solutions,

https://github.com/official-stockfish/S ... ssues/3030

including this embedded option (number 5).

Post Reply