The most stupid idea by the Stockfish Team

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Gabor Szots
Posts: 656
Joined: Sat Jul 21, 2018 5:43 am
Location: Szentendre, Hungary
Full name: Gabor Szots

Re: The most stupid idea by the Stockfish Team

Post by Gabor Szots » Mon Aug 31, 2020 11:02 am

AndrewGrant wrote:
Mon Aug 31, 2020 10:42 am
Gabor Szots wrote:
Mon Aug 31, 2020 10:17 am
AndrewGrant wrote:
Sun Aug 30, 2020 10:04 am
There is utility in packaging them together. The vast majority of Stockfish users are not people who frequent any forums like this.

If you really want to be ahead of the curve, just compile your own Stockfishs yourself.
There is a glitch in that, at least for me: the dev compile is 4 times as fast as mine. OK, I admit am totally new to compiling.
That would be because you selected a suboptimal make target. It is far more complex now that there are a dozen different targets to account for the vector maths that some processors have. If you told me your CPU, I could probably look at the makefile and tell you the right one, but I've not followed all the changes :)
Thanks Andrew. I did not use a makefile but this command line:
g++ -std=c++17 -DNDEBUG -DNNUE_EMBEDDING_OFF *.cpp syzygy/tbprobe.cpp nnue/evaluate_nnue.cpp nnue/features/half_kp.cpp -O3 -march=native -oStockfish_20_8_30-x64-SzG.exe
I have a somewhat old Haswell CPU (i5-4690K). But don't bother, I do this only for fun, I'm OK with the official builds.
Gabor Szots
CCRL testing group

mmt
Posts: 312
Joined: Sun Aug 25, 2019 6:33 am
Full name: .

Re: The most stupid idea by the Stockfish Team

Post by mmt » Mon Aug 31, 2020 11:29 am

I had to double-check that I was not reading a thread started 20 years ago. That's when 21 MB was a sizable download. Right now, a medium web page size is 2 MB.

Dann Corbit
Posts: 11702
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: The most stupid idea by the Stockfish Team

Post by Dann Corbit » Mon Aug 31, 2020 4:21 pm

Do you know how long it takes barracuda to check a 20MB zip file for viruses?
Now imagine that there are 3 or more binaries in the zip file.
Now imagine that you want to send the file to 30 different places.
Yes, I know this is only my problem.

You see no pain in it because there is no pain for you, but there is pain for other people.
It is true that these people are on the fringe so it is not important to worry about them according to the 80/20 rule.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

syzygy
Posts: 4818
Joined: Tue Feb 28, 2012 10:56 pm

Re: The most stupid idea by the Stockfish Team

Post by syzygy » Mon Aug 31, 2020 9:08 pm

Gabor Szots wrote:
Mon Aug 31, 2020 10:17 am
AndrewGrant wrote:
Sun Aug 30, 2020 10:04 am
There is utility in packaging them together. The vast majority of Stockfish users are not people who frequent any forums like this.

If you really want to be ahead of the curve, just compile your own Stockfishs yourself.
There is a glitch in that, at least for me: the dev compile is 4 times as fast as mine. OK, I admit am totally new to compiling.
You could try Cfish and just type "make pgo". The Makefile will then figure out the best settings for your system itself.

maxdeg
Posts: 222
Joined: Thu Mar 10, 2016 5:17 pm
Location: Canada

Re: The most stupid idea by the Stockfish Team

Post by maxdeg » Mon Aug 31, 2020 10:48 pm

syzygy wrote:
Mon Aug 31, 2020 9:08 pm
Gabor Szots wrote:
Mon Aug 31, 2020 10:17 am
AndrewGrant wrote:
Sun Aug 30, 2020 10:04 am
There is utility in packaging them together. The vast majority of Stockfish users are not people who frequent any forums like this.

If you really want to be ahead of the curve, just compile your own Stockfishs yourself.
There is a glitch in that, at least for me: the dev compile is 4 times as fast as mine. OK, I admit am totally new to compiling.
You could try Cfish and just type "make pgo". The Makefile will then figure out the best settings for your system itself.
+3
:D

Thank you very much RDM - worked perfectly.
One question if I may - how do I uniquely identify 'my' Cfish compile much as Gabor did with Stockfish.

syzygy
Posts: 4818
Joined: Tue Feb 28, 2012 10:56 pm

Re: The most stupid idea by the Stockfish Team

Post by syzygy » Mon Aug 31, 2020 11:00 pm

maxdeg wrote:
Mon Aug 31, 2020 10:48 pm
One question if I may - how do I uniquely identify 'my' Cfish compile much as Gabor did with Stockfish.
What do you mean by identifying your Cfish compile?

If you want know what options were used to compile your Cfish, you can look at the output of "make" or you can start cfish.exe from the command line and type "compiler".

maxdeg
Posts: 222
Joined: Thu Mar 10, 2016 5:17 pm
Location: Canada

Re: The most stupid idea by the Stockfish Team

Post by maxdeg » Mon Aug 31, 2020 11:05 pm

syzygy wrote:
Mon Aug 31, 2020 11:00 pm
maxdeg wrote:
Mon Aug 31, 2020 10:48 pm
One question if I may - how do I uniquely identify 'my' Cfish compile much as Gabor did with Stockfish.
What do you mean by identifying your Cfish compile?

If you want know what options were used to compile your Cfish, you can look at the output of "make" or you can start cfish.exe from the command line and type "compiler".
Thank you.

Gabor Szots
Posts: 656
Joined: Sat Jul 21, 2018 5:43 am
Location: Szentendre, Hungary
Full name: Gabor Szots

Re: The most stupid idea by the Stockfish Team

Post by Gabor Szots » Tue Sep 01, 2020 5:52 am

syzygy wrote:
Mon Aug 31, 2020 9:08 pm
You could try Cfish and just type "make pgo". The Makefile will then figure out the best settings for your system itself.
I did (using the master) but got these messages:
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:26: pipe: No error
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:386: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:390: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:390: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:449: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:449: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:465: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:499: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:533: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:643: pipe: Bad file descriptor
'grep' is not recognized as an internal or external command,
operable program or batch file.
curl was unexpected at this time.
shasum was unexpected at this time.
-f was unexpected at this time.
mingw32-make: *** [Makefile:814: net] Error 255
Thanks anyway.
Gabor Szots
CCRL testing group

syzygy
Posts: 4818
Joined: Tue Feb 28, 2012 10:56 pm

Re: The most stupid idea by the Stockfish Team

Post by syzygy » Tue Sep 01, 2020 8:22 am

Gabor Szots wrote:
Tue Sep 01, 2020 5:52 am
syzygy wrote:
Mon Aug 31, 2020 9:08 pm
You could try Cfish and just type "make pgo". The Makefile will then figure out the best settings for your system itself.
I did (using the master) but got these messages:
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:26: pipe: No error
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:386: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:390: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:390: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:449: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:449: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:465: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:499: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:533: pipe: Bad file descriptor
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:643: pipe: Bad file descriptor
'grep' is not recognized as an internal or external command,
operable program or batch file.
curl was unexpected at this time.
shasum was unexpected at this time.
-f was unexpected at this time.
mingw32-make: *** [Makefile:814: net] Error 255
Thanks anyway.
Looks like your MSYS2 installation is not how it is expected.

Perhaps you are compiling from a regular command prompt where you should open a terminal window with bash prompt? I'm not using MSYS2 myself, perhaps someone else here can explain what is wrong.

Guenther
Posts: 3555
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: The most stupid idea by the Stockfish Team

Post by Guenther » Tue Sep 01, 2020 9:25 am

syzygy wrote:
Tue Sep 01, 2020 8:22 am
Gabor Szots wrote:
Tue Sep 01, 2020 5:52 am
syzygy wrote:
Mon Aug 31, 2020 9:08 pm
You could try Cfish and just type "make pgo". The Makefile will then figure out the best settings for your system itself.
I did (using the master) but got these messages:
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:26: pipe: No error
process_begin: CreateProcess(NULL, uname -s, ...) failed.
...
'grep' is not recognized as an internal or external command,
operable program or batch file.
curl was unexpected at this time.
shasum was unexpected at this time.
-f was unexpected at this time.
mingw32-make: *** [Makefile:814: net] Error 255
Thanks anyway.
Looks like your MSYS2 installation is not how it is expected.

Perhaps you are compiling from a regular command prompt where you should open a terminal window with bash prompt? I'm not using MSYS2 myself, perhaps someone else here can explain what is wrong.
Thanks it works like a charm here (also msys2 - completely fresh install, after a dumb antivirus update killed
first curl, then pacman and then even more, w/o any possibility of restoring the false positives, uahhh.
I changed my whole antivirus environment after this unhappy 'accident')

I guess Gabors toolchain is incomplete and grep seems lacking at all.

Is CFish now at the same commit level again as SF dev currently?
It seems it is faster than my SFdev compile w/o nnue included. Need to check this more precisely.

@Gabor
It seems your msys2 installation never was really complete, as grep is already in the 'base' group.
https://packages.msys2.org/group/

I suggest running all those commands again one by one, it will only load, what is missing or otherwise update.

Code: Select all

pacman -Syu
pacman -S mingw-w64-x86_64-gcc
pacman -S mingw-w64-x86_64-make
pacman -S mingw-w64-x86_64-toolchain
pacman -S libraries
If you ever want to compile e.g. cutechess you need this too

Code: Select all

pacman -S mingw-w64-x86_64-qt5-static

Post Reply