NN in Scorpio 3.0.11 is not loaded

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Daniel Shawul
Posts: 4186
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: NN in Scorpio 3.0.11 is not loaded

Post by Daniel Shawul »

bastiball wrote: Mon Feb 08, 2021 4:37 pm
Daniel Shawul wrote: Mon Feb 08, 2021 4:28 pm Well good, it means the installation is correct.
Please post the analysis output so that I have a better understanding.

1) Make sure you have "scorpio.bat" as the engine in Arena, not scorpio.exe
2) Try both xboard and uci modes to see if the GUI is messing up the settings somehow.
I prefer xboard mode as some GUIs keep engine settings of UCI engines which could mess things up
https://ibb.co/zPyyvpj
There is an "EgbbProbe not loaded" message there too so the installation is incorrect despite what I said earlier.
It is not an issue with installing scorpio in a GUI.
I suggest you reinstall Scorpio from scratch and post the output of the installation here.
Download install.bat only and put it in a directory you want Scorpio installed, then run install.bat and post
its output here. It should do an analysis from start position during installation.

Is your machine old ? Scorpio needs AVX2 support which many machine do support.
bastiball
Posts: 5360
Joined: Tue Oct 20, 2020 4:18 am
Full name: Basti Dangca

Re: NN in Scorpio 3.0.11 is not loaded

Post by bastiball »

Daniel Shawul wrote: Mon Feb 08, 2021 4:46 pm
bastiball wrote: Mon Feb 08, 2021 4:37 pm
Daniel Shawul wrote: Mon Feb 08, 2021 4:28 pm Well good, it means the installation is correct.
Please post the analysis output so that I have a better understanding.

1) Make sure you have "scorpio.bat" as the engine in Arena, not scorpio.exe
2) Try both xboard and uci modes to see if the GUI is messing up the settings somehow.
I prefer xboard mode as some GUIs keep engine settings of UCI engines which could mess things up
https://ibb.co/zPyyvpj
There is an "EgbbProbe not loaded" message there too so the installation is incorrect despite what I said earlier.
It is not an issue with installing scorpio in a GUI.
I suggest you reinstall Scorpio from scratch and post the output of the installation here.
Download install.bat only and put it in a directory you want Scorpio installed, then run install.bat and post
its output here. It should do an analysis from start position during installation.

Is your machine old ? Scorpio needs AVX2 support which many machine do support.
Yes, it does not support avx2. Here's the instruction of my laptop
Instructions sets: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, EM64T, AES, SHA
Basti Dangca
CCRL testing group
Daniel Shawul
Posts: 4186
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: NN in Scorpio 3.0.11 is not loaded

Post by Daniel Shawul »

Well I guess that is the problem.
The CPU version of Scorpio, both NN and NNUE are compiled with AVX2 support.
Sorry about that!
bastiball
Posts: 5360
Joined: Tue Oct 20, 2020 4:18 am
Full name: Basti Dangca

Re: NN in Scorpio 3.0.11 is not loaded

Post by bastiball »

Daniel Shawul wrote: Mon Feb 08, 2021 5:00 pm Well I guess that is the problem.
The CPU version of Scorpio, both NN and NNUE are compiled with AVX2 support.
Sorry about that!
Well, it guess so. Thanks for the info :))
Basti Dangca
CCRL testing group
User avatar
Sylwy
Posts: 4856
Joined: Fri Apr 21, 2006 4:19 pm
Location: IAȘI - the historical capital of MOLDOVA
Full name: Silvian Rucsandescu

Re: NN in Scorpio 3.0.11 is not loaded

Post by Sylwy »

Daniel Shawul wrote: Mon Feb 08, 2021 3:19 pm
Sylwy wrote: Mon Feb 08, 2021 12:03 pm I will do a test just for Scorpio 3.0.11 NNUE !
MCTS=0
NN=0
NNUE=1 (the original dh-o.2.bin net)
NNUE_scale=256

I am very curious ! :lol: :wink: :lol:

Image
You have to change the "nnue_type 0", then you will get a message "NNUE loaded" instead of "NNCPU loaded".
The dh-0.2.bin net is a Stockfish style net so use "nnue_type 0"
The only net I know that needs "nnue_type 1" is a private net I have.
WOW ! Thank you ! I did not know that.That's why I use (now) the old SF net (nn-04cf2b4ed1da.nnue), ""nnue_type 0" and "nnue_scale 128".
With "nnue_type 1" and dh-0.2.bin net Scorpio 3.0.11 plays weakly with white and locks with black.

Scorpio 3.0.11 NNUE plays very well. Here's the situation in my test after 15 games (will be 100 games at TC=4'+2"-12-15 minutes per game):

Image

83% ........impressive ! MCTS-NN-NNUE-Scorpio egbbs.......great engine ! Congratulations !
dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: NN in Scorpio 3.0.11 is not loaded

Post by dkappe »

Sylwy wrote: Mon Feb 08, 2021 5:52 pm
With "nnue_type 1" and dh-0.2.bin net Scorpio 3.0.11 plays weakly with white and locks with black.

Scorpio 3.0.11 NNUE plays very well. Here's the situation in my test after 15 games (will be 100 games at TC=4'+2"-12-15 minutes per game):

Image

83% ........impressive ! MCTS-NN-NNUE-Scorpio egbbs.......great engine ! Congratulations !
The Dark Horse nets suffered from the same problem that as many of the nets I trained on non-stockfish data: they didn’t return evaluations at the optimal magnitude for stockfish search. I’ve fixed this for several nets — toga, night nurse, Harmon — but had yet to go back to the latest Dark Horse net. Anyhow, fixed now. https://www.patreon.com/posts/47295609

It’s likely still weaker than the SF nets, but plays a very different style of game. Let me know if this helps.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
User avatar
Gabor Szots
Posts: 1452
Joined: Sat Jul 21, 2018 7:43 am
Location: Budapest, Hungary
Full name: Gabor Szots

Re: NN in Scorpio 3.0.11 is not loaded

Post by Gabor Szots »

Daniel Shawul wrote: Mon Feb 08, 2021 3:31 pm This issue with Fritz/Chessbase is noted in the INSTALL.md and a workaround is provided there
https://github.com/dshawul/Scorpio/blob ... g-in-a-gui
It is Fritz's fault that it can not accept engines executed via a script -- i mean it excludes many python engines, scorpio and others

So what you have to do for Fritz is intall the scorpio executable as the engine i.e. scorpio.exe but provide the path to the the dependencies
scorpio needs by setting the "Path" environment varialble. Search for "Environment variables" dialog box in the start button of windows.

If you have a GPU or you want to run scorpio with NN on CPU, do not edit anything after installation. It should set up everything for you automatically.
To run Scorpio with NNUE on CPU, you have to modify the scorpio.ini as I explained before.
The parameters in scorpio.ini are explained the comments but I suggest you follow the simple install instructions instead of editing scorpio.ini manually, unless it is absolutely necessary f.i. when you want to use it as a NNUE engine.
Thank you, Daniel.
Gabor Szots
CCRL testing group
Daniel Shawul
Posts: 4186
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: NN in Scorpio 3.0.11 is not loaded

Post by Daniel Shawul »

Sylwy wrote: Mon Feb 08, 2021 5:52 pm
Daniel Shawul wrote: Mon Feb 08, 2021 3:19 pm
Sylwy wrote: Mon Feb 08, 2021 12:03 pm I will do a test just for Scorpio 3.0.11 NNUE !
MCTS=0
NN=0
NNUE=1 (the original dh-o.2.bin net)
NNUE_scale=256

I am very curious ! :lol: :wink: :lol:

Image
You have to change the "nnue_type 0", then you will get a message "NNUE loaded" instead of "NNCPU loaded".
The dh-0.2.bin net is a Stockfish style net so use "nnue_type 0"
The only net I know that needs "nnue_type 1" is a private net I have.
WOW ! Thank you ! I did not know that.That's why I use (now) the old SF net (nn-04cf2b4ed1da.nnue), ""nnue_type 0" and "nnue_scale 128".
With "nnue_type 1" and dh-0.2.bin net Scorpio 3.0.11 plays weakly with white and locks with black.

Scorpio 3.0.11 NNUE plays very well. Here's the situation in my test after 15 games (will be 100 games at TC=4'+2"-12-15 minutes per game):

Image

83% ........impressive ! MCTS-NN-NNUE-Scorpio egbbs.......great engine ! Congratulations !
Glad it worked for you now.
The dh-0.2.bin is also strong but you need to set "nnue_type 0" for it too, along with nnue_scale 256.
"nnue_type 1" is only for experimental nets I have that uses a slightly different architecture than SF's.
dh-0.2.bin is a stockfish style net so you should use "nnue_type 0" for it.
dkappe
Posts: 1632
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: NN in Scorpio 3.0.11 is not loaded

Post by dkappe »

Daniel,

See the scaled DH net above.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
Angle
Posts: 342
Joined: Sat Oct 31, 2020 1:04 am
Full name: Aleksey Glebov

Re: NN in Scorpio 3.0.11 is not loaded

Post by Angle »

Daniel Shawul wrote: Mon Feb 08, 2021 8:31 am
I added Scorpio to my new tournament conceived for NN(UE) engines only.
Note that the default installation uses NN by default, it will use a 12b on CPU or a 20b on GPU if you have one.
So if you want to use NNUE on CPU, you have to modify some things. Edit scorpio.ini like below, or add them to the command line of the engine

Code: Select all

mt           4     # I think you have 4 threads machine
montecarlo   0
use_nn       0
use_nnue     1
nnue_scale  256    # If you use dh-0.2.bin net that comes with the installation or 128 if you use a SF NNUE net
I have a GTX 1050 card which seems to work good with the 20b net for openings/middle game and ME.uff net for endings (with the default ini parameters). The only change that I have made is reducing hash tables because Scorpio takes over 3 GB by default while my laptop has only 8 GB in total. So I allocated 256 MB for the CPU's (main ht) and also 256 MB for each of the networks. I believe this would be enough because I run tournaments with blitz TC such as 30s+3s or 40/2.

However, I am not sure that the large 20x256 net is optimal for my GTX card at fast TC. Later on I will experiment with the 12x128 net and also with the NNUE 'running on CPU's to compare the results.

You can follow the tournament with Scorpio NN here:
http://talkchess.com/forum3/viewtopic.php?f=6&t=76525
Incredibly fast systems miscount incredibly fast.