Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

abgursu
Posts: 91
Joined: Thu May 14, 2020 3:34 pm
Full name: A. B. Gursu

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by abgursu »

AlexChess wrote: Fri Jun 11, 2021 3:41 pm
Modern Times wrote: Thu Jun 10, 2021 2:15 am
AndrewGrant wrote: Wed Jun 09, 2021 8:38 pm
Thanks. Its nice to see that Pure lists are back ( At least for FRC ) . That is what I always looked at back in the day. I'de love to see those for each list, and actually have that be the default. Its simply a greater quality list by removing sampling biases :)
Yes agreed. The pure list never went away on FRC, but there is some sort of bug which means we had to turn them off for the other two lists. I'm trying to fix that for 40/15. One big issue with them is the number of games. Yes you reduce potential bias from testing against multiple versions of the same family, but you increase significantly in some cases the statistical margins of error because of less games.
For example Cfish is Stockfish optimized in C running 30% faster. ShashChess 17.1 implements Alexander Shashin mathematical theory and it's very strong. Corchess is perfect for long time analysis. But also the free (derivatives, NOT clones or they would score exactly like SF) Fisherov 0.98, Zeus 11, Eman 7.22, AI 15.00, KillFish CTR Hybrid v1.4 are deprecated because they do not release source being based on Stockfish GPL 3.0 (exactly like commercials Fat fritz 2 and Houdini 6 before they have been forced to drop the source code in github by the Stockfish team and fans) ...but often they score better than latest Stockfish 13-dev. Not considering them brings to a very partial list of all top engines. [Source] https://chessengines.blogspot.com/p/rating-jcer.html ...For me the most complete and trusted computer rating list *not 3600 Elo but 3000-3200 ELO* for top engines.
Andrew is totally right about SF "Clones". Even I had an clone in 2019, and I don't know how to code at an intermediate level. All I did was a search in fishtest for promising yellow patches (or one green one red) and some copy paste from other engines and some changes in evaluations. It's not a hard job but it has no value whatsoever.
I consider CFish, some Experience engines like Eman and BrainLearn (for also having MCTS) valuable even through I know there isn't a huge elo gain in experience.
User avatar
AlexChess
Posts: 1533
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

I know that is not the same than writing a top level engine from scratch, but having tested all of them, I think that others fine tuned SF derivates deserve my attention and I'll continue to test all their new updates with the most promising NNUEs . I only criticize programmers not sharing their source code to improve all other engines.

PS: Ethereal 13.00 ssse3 (official github build by Andrew) needs his own NNUE, differently from 12.75 NNUE.
Using SF test NNUEs with it has given bad results to me (a lot of loses) also if the evaluation values seem consistent.
I have stopped this engine test on Ryzen 3900x.

Regards, AlexChess
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum TROLLS KINDERGARTEN
AndrewGrant
Posts: 1789
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant »

AlexChess wrote: Fri Jun 11, 2021 8:53 pm PS: Ethereal 13.00 ssse3 (official github build by Andrew) needs his own NNUE, differently from 12.75 NNUE.
Using SF test NNUEs with it has given bad results to me (a lot of loses) also if the evaluation values seem consistent.
I have stopped this engine test on Ryzen 3900x.
Yeah Networks are not compatible. My stuff has absolutely nothing to do with Stockfish.
Also, the github builds are not NNUE. Hence it being the "Standard" version.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
Chessqueen
Posts: 5619
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by Chessqueen »

AndrewGrant wrote: Fri Jun 11, 2021 9:17 pm
AlexChess wrote: Fri Jun 11, 2021 8:53 pm PS: Ethereal 13.00 ssse3 (official github build by Andrew) needs his own NNUE, differently from 12.75 NNUE.
Using SF test NNUEs with it has given bad results to me (a lot of loses) also if the evaluation values seem consistent.
I have stopped this engine test on Ryzen 3900x.
Yeah Networks are not compatible. My stuff has absolutely nothing to do with Stockfish.
Also, the github builds are not NNUE. Hence it being the "Standard" version.
So what is the estimated Elo of Ethereal 13.00 NNUE ? Is it about 700 Elo weaker than stockfish 12 NNUE or about equal to igel 3.0.5 :?:

1 Stockfish 13 64-bit 4CPU 3547 +18 −18 76.7% −176.6 46.5% 1090
95.4%
2 Fat Fritz 2 (in SF) 64-bit 4CPU 3526 +18 −18 71.4% −135.1 55.3% 952
99.6%
3 Dragon by Komodo 64-bit 4CPU 3495 +15 −15 66.9% −103.0 60.3% 1323
100.0%
4 Igel 3.0.5 64-bit 4CPU 3418 +20 −20 46.4% +21.9 74.0% 672
77.6%
5 RubiChess 2.1 64-bit 4CPU 3408 +20 −20 47.1% +17.9 69.6% 681
80.5%
6 Houdini 6 64-bit 4CPU 3398 +10 −10 57.4% −46.7 62.3% 3246
59.2%
7 SlowChess Blitz 2.5 64-bit 4CPU 3395 +17 −17 46.6% +21.1 66.1% 919
62.4%
8 Ethereal 12.75 64-bit 4CPU 3392 +15 −15 48.8% +9.2 68.9% 1278
70.9%
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
User avatar
Graham Banks
Posts: 41627
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by Graham Banks »

Chessqueen wrote: Fri Jun 11, 2021 9:27 pmSo what is the estimated Elo of Ethereal 13.00 NNUE ? Is it about 700 Elo weaker than stockfish 12 NNUE or about equal to igel 3.0.5 :?:
About 20 Elo stronger than Igel 3.0.5 and 115 Elo weaker than Stockfish 12.
gbanksnz at gmail.com
Chessqueen
Posts: 5619
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by Chessqueen »

Graham Banks wrote: Sat Jun 12, 2021 12:58 am
Chessqueen wrote: Fri Jun 11, 2021 9:27 pmSo what is the estimated Elo of Ethereal 13.00 NNUE ? Is it about 700 Elo weaker than stockfish 12 NNUE or about equal to igel 3.0.5 :?:
About 20 Elo stronger than Igel 3.0.5 and 115 Elo weaker than Stockfish 12.
Thanks you, So Ethereal 13.00 NNUE 3438 CCRL, compared to igel 3.0.5 3418 3418, therefore most people will download Igel 3.0.5 and test those two in 100 games. :roll:
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
User avatar
AlexChess
Posts: 1533
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

AndrewGrant wrote: Fri Jun 11, 2021 9:17 pm
AlexChess wrote: Fri Jun 11, 2021 8:53 pm PS: Ethereal 13.00 ssse3 (official github build by Andrew) needs his own NNUE, differently from 12.75 NNUE.
Using SF test NNUEs with it has given bad results to me (a lot of loses) also if the evaluation values seem consistent.
I have stopped this engine test on Ryzen 3900x.
Yeah Networks are not compatible. My stuff has absolutely nothing to do with Stockfish.
Also, the github builds are not NNUE. Hence it being the "Standard" version.
Ok I cant wait to have a 13.x build stable on MY system (or a Windows 10, mac M1 or Linux native ARM64 NEON build like Igel 3.0.5)
Meanwhile I will continue to test Ethereal 12.75 NNUE (Etherlito) that is very strong also on modern computers (nehalem) hardware :D

Regards, AlexChess
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum TROLLS KINDERGARTEN
User avatar
AlexChess
Posts: 1533
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

Graham Banks wrote: Sat Jun 12, 2021 12:58 am
Chessqueen wrote: Fri Jun 11, 2021 9:27 pmSo what is the estimated Elo of Ethereal 13.00 NNUE ? Is it about 700 Elo weaker than stockfish 12 NNUE or about equal to igel 3.0.5 :?:
About 20 Elo stronger than Igel 3.0.5 and 115 Elo weaker than Stockfish 12.
Thanks Graham! I confirm your ranking, but for me ALL the best engines are in the 3000-3400 ELO range on high-end hardware.

Regards, AlexChess
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum TROLLS KINDERGARTEN
Modern Times
Posts: 3557
Joined: Thu Jun 07, 2012 11:02 pm

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by Modern Times »

AlexChess wrote: Sat Jun 12, 2021 7:18 am
Thanks Graham! I confirm your ranking, but for me ALL the best engines are in the 3000-3400 ELO range on high-end hardware.

Regards, AlexChess
SSDF disagree with you:

http://www.ssdf.bosjo.net/list.htm

Stockfish 13 will be 3600+ for them when they test that.

I just ignore the absolute Elo values and just look at the differences between engines. The absolute values are different on most of the lists depending on how the scale the lists and what ratings tool they use.
User avatar
AlexChess
Posts: 1533
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

...SSDF is a little obsolete :)

It was my reliable source 30 years ago to have the exact ranking of Mephisto, Kasparov, Fidelity and Novag dedicated chess computers... (only one hardware and 1 opening book for each) . Now Stockfish-dev and test NNUEs are updated every day and they are stuck at Stockfish 12.

You are right, the only way is to compare the absolute ranking, not the ELO until you fix an unique standard for both humans and computers.

Regards, AlexChess
Last edited by AlexChess on Sat Jun 12, 2021 8:41 am, edited 5 times in total.
Chess engines and dedicated chess computers fan since 1981 :D Mac mini M1 8GB-256GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum TROLLS KINDERGARTEN