Commercial Release of Ethereal 13.25 (NNUE)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

AndrewGrant
Posts: 1754
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Commercial Release of Ethereal 13.25 (NNUE)

Post by AndrewGrant »

Please see: http://chess.grantnet.us/Ethereal/

Ethereal 13.25 (NNUE) has been released. In addition to the usual updates to the search and evaluation algorithms, Ethereal is new using a newly trained NNUE, which factors in game results to achieve smoother and more stable evaluations in the endgame. Ethereal continues its legacy of stability and reliability for analysis and engine play.

Ethereal 13.25 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team. With it, Ethereal adds new ideas and techniques to extend existing machine learning algorithms, and adds original practices into the implementation. These new approaches in software design allow for older processors to outperform NNUEs found in other engines, while still harnessing the full power of the AVX/AVX2 instruction sets for CPUs with support.

Additionally, Ethereal is the first engine to offer a secondary Network trained exclusively for Fischer Random Chess (FRC). This Network outperforms the standard Network by significant margins in FRC play, showcasing a creative style by Ethereal, not reliant on Opening Theory. These Neural Networks offer up to +60 elo over Ethereal 13.00 in self-play for Standard Chess, the culmination of over 317,000,000 games played between various versions of Ethereal.

The commercial NNUE version requires a CPU with the SSSE3 instruction set (which almost all CPUs have), and will not run on systems lacking these instructions. AVX/AVX2 have become ubiquitous in modern processor design, and are necessary to capitalize on the full strength of Neural Network technology. If you are unsure if your system is supported, please reach out to me via email at andrew@grantnet.us for assistance.

Stripe will verify your payment of $40 USD. Afterwards, you will receive an email from andrew@grantnet.us or andrewgrantethereal@gmail.com within 24 hours containing a download link for the Standard/Fischer NNUE Networks, as well as the binary or executable files for Windows and Linux. You should select the binary matching your Operating System. Users with Intel CPUs containing BMI2 support (Also known as PEXT), should use the pext binary for optimal performance. AMD CPU users should use the popcnt binary, unless they have a 5XXX series Ryzen. AVX2 binaries will be the fastest, followed by AVX, and finally SSSE3. You should use the fastest your CPU allows.

If Stripe is not possible for you, PayPal is also an option. Using PayPal as a merchant account proved to be unworkable. However, you can send a payment of $40 USD to andrew@grantnet.us via the "Send & Request" button. This process is not yet automated, so I will have to build and send binaries by hand. If you are able to use Stripe, that is my preference. PayPal charges greater fees for foreign currency conversions, and I do not pass any fees on to the buyer.

If you purchased Ethereal 13.00, you should have received an email containing updates to 13.25. If you did not, and the email cannot be found in your spam folder, please reach out to me via andrew@grantnet.us or andrewgrantethereal@gmail.com.

---

Code: Select all

// Regression test using a drawish book
ELO   | 57.45 +- 1.78 (95%)
CONF  | 60.0+0.60s Threads=1 Hash=64MB
GAMES | N: 40000 W: 9019 L: 2465 D: 28516
http://chess.grantnet.us/test/12863/
---

While Ethereal without NNUE still exists, and can be compiled directly from the source with ease, I have not provided binary files. This is because the strength of NNUE makes the standard version obsolete for high tier game-play, like rating lists, tournaments, and correspondence analysis. In the future I may add support for machines lacking AVX2 support, but have not done so at this time. All new CPUs being released contain the instruction set for many years now. As Neural Network technology takes over computer chess, those lacking modern vector support will have difficulty seeing the same gains as those with advanced vector support.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
AndrewGrant
Posts: 1754
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by AndrewGrant »

Once again occupying a hard middle ground between the GPU Engines / SF / Komodo, and the rest of the field. Thanks to CCRL for testing :)
Image
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by CMCanavessi »

Awesome! :mrgreen:
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
Modern Times
Posts: 3547
Joined: Thu Jun 07, 2012 11:02 pm

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by Modern Times »

It is here as well, not that many games though.

http://ccrl.chessdom.com/ccrl/4040/rati ... e_cpu.html
cucumber
Posts: 144
Joined: Sun Oct 14, 2018 8:21 pm
Full name: JSmith

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by cucumber »

No idea how you keep making so much progress. Congrats on the release and all of the progress you've made!
gaard
Posts: 447
Joined: Mon Jun 07, 2010 3:13 am
Location: Holland, MI
Full name: Martin W

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by gaard »

AndrewGrant wrote: Fri Aug 06, 2021 5:55 am Please see: http://chess.grantnet.us/Ethereal/

Ethereal 13.25 (NNUE) has been released. In addition to the usual updates to the search and evaluation algorithms, Ethereal is new using a newly trained NNUE, which factors in game results to achieve smoother and more stable evaluations in the endgame. Ethereal continues its legacy of stability and reliability for analysis and engine play.

Ethereal 13.25 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team. With it, Ethereal adds new ideas and techniques to extend existing machine learning algorithms, and adds original practices into the implementation. These new approaches in software design allow for older processors to outperform NNUEs found in other engines, while still harnessing the full power of the AVX/AVX2 instruction sets for CPUs with support.

Additionally, Ethereal is the first engine to offer a secondary Network trained exclusively for Fischer Random Chess (FRC). This Network outperforms the standard Network by significant margins in FRC play, showcasing a creative style by Ethereal, not reliant on Opening Theory. These Neural Networks offer up to +60 elo over Ethereal 13.00 in self-play for Standard Chess, the culmination of over 317,000,000 games played between various versions of Ethereal.

The commercial NNUE version requires a CPU with the SSSE3 instruction set (which almost all CPUs have), and will not run on systems lacking these instructions. AVX/AVX2 have become ubiquitous in modern processor design, and are necessary to capitalize on the full strength of Neural Network technology. If you are unsure if your system is supported, please reach out to me via email at andrew@grantnet.us for assistance.

Stripe will verify your payment of $40 USD. Afterwards, you will receive an email from andrew@grantnet.us or andrewgrantethereal@gmail.com within 24 hours containing a download link for the Standard/Fischer NNUE Networks, as well as the binary or executable files for Windows and Linux. You should select the binary matching your Operating System. Users with Intel CPUs containing BMI2 support (Also known as PEXT), should use the pext binary for optimal performance. AMD CPU users should use the popcnt binary, unless they have a 5XXX series Ryzen. AVX2 binaries will be the fastest, followed by AVX, and finally SSSE3. You should use the fastest your CPU allows.

If Stripe is not possible for you, PayPal is also an option. Using PayPal as a merchant account proved to be unworkable. However, you can send a payment of $40 USD to andrew@grantnet.us via the "Send & Request" button. This process is not yet automated, so I will have to build and send binaries by hand. If you are able to use Stripe, that is my preference. PayPal charges greater fees for foreign currency conversions, and I do not pass any fees on to the buyer.

If you purchased Ethereal 13.00, you should have received an email containing updates to 13.25. If you did not, and the email cannot be found in your spam folder, please reach out to me via andrew@grantnet.us or andrewgrantethereal@gmail.com.

---

Code: Select all

// Regression test using a drawish book
ELO   | 57.45 +- 1.78 (95%)
CONF  | 60.0+0.60s Threads=1 Hash=64MB
GAMES | N: 40000 W: 9019 L: 2465 D: 28516
http://chess.grantnet.us/test/12863/
---

While Ethereal without NNUE still exists, and can be compiled directly from the source with ease, I have not provided binary files. This is because the strength of NNUE makes the standard version obsolete for high tier game-play, like rating lists, tournaments, and correspondence analysis. In the future I may add support for machines lacking AVX2 support, but have not done so at this time. All new CPUs being released contain the instruction set for many years now. As Neural Network technology takes over computer chess, those lacking modern vector support will have difficulty seeing the same gains as those with advanced vector support.
Congrats, Andrew.

How would you compare Ethereal to SF or Dragon in terms of quantifiable metrics? More or less tactical? And positionally? Strengths and weaknesses? I understand that as chess engines get stronger it becomes increasingly difficult to quantify useful metrics or qualities like these. I am most interested in how Ethereal might complement SF and Dragon, aside from the ridiculously high level of play.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by MikeB »

+1 Thank you Andrew!
Image
User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by pohl4711 »

AndrewGrant wrote: Fri Aug 06, 2021 5:55 am
Ethereal 13.25 (NNUE) has been released.
A.Grant asked for a pre-release testrun of Ethereal 13.25 (7000 games as usual) for my ratinglist. Of course, I did it. And now, I released the result on my website:

https://www.sp-cc.de

Nice progress (+54 Elo to Ethereal 13.00, fits very well to A.Grants regression-tests), now, Ethereal gets close in strength to Stockfish 11. Impressive.
Damir
Posts: 2801
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by Damir »

Thanks a lot for the free update Andy. I just saw you sent me a mail. :)
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Commercial Release of Ethereal 13.25 (NNUE)

Post by Rebel »

Ethereal 13.25 gained 106 elo over version 12.75.

Provisional top-10 after 3000 games -

Code: Select all

       Gambit Rating List       : Provisional

       # PLAYER                 :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)     W     D     L  D(%)
       1 Stockfish 14           :  3684.3   11.9  2963.0    3700    80      99  2300  1326    74    36
       2 Komodo-Dragon 2        :  3583.3   13.3  3006.5    4100    73      59  2153  1707   240    42
       3 Lc0-v27                :  3528.5   21.8   501.0     800    63      97   307   388   105    49
       4 Ethereal 13.25-NNUE    :  3460.4   10.4  1690.5    3000    56      99   986  1409   605    47
       5 SlowChess 2.6          :  3416.7   12.3  1514.5    3200    47      99   770  1489   941    47
       6 RubiChess 2.2          :  3403.9   11.7  1462.0    3000    49      70   753  1418   829    47
       7 Koivisto 6.0-sse2      :  3393.5   12.0  1465.5    2600    56     100   877  1177   546    45
       8 Pedone 3.1             :  3357.8   13.4  1710.5    3900    44      53   894  1633  1373    42
       9 Igel 3.0.5             :  3357.2   13.2  1486.0    3900    38      70   600  1772  1528    45
      10 Nemorino 6.00          :  3307.9   10.8  1507.5    3900    39      90   776  1463  1661    38
And so Ethereal is back as the number 3 non-derivative CPU engine after Stockfish and Komodo.

Well done Andrew.

The links are:
13.25 - https://prodeo.actieforum.com/t358-gamb ... sults#4025
13.00 - https://prodeo.actieforum.com/t358-gamb ... sults#4015
90% of coding is debugging, the other 10% is writing bugs.