Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

AndrewGrant
Posts: 1955
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant »

mehmet123 wrote: Tue Jun 15, 2021 10:53 pm New Stockfish NNUE nets ara trained on Leela games. Isn't it time to give up a conservative stance on Ethereal NNUE nets.
"Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."

I'll stick to that. I'm the last person doing it on my own.

And food for thought: Stockfish folks training on Leela data is far less concerning to me than other engines reusing the entire SF pipeline.
mehmet123
Posts: 681
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by mehmet123 »

AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm
"Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."
I'll stick to that. I'm the last person doing it on my own.
And food for thought: Stockfish folks training on Leela data is far less concerning to me than other engines reusing the entire SF pipeline.
We respect your decision. Is there any chance of us seeing an unofficial version with the feature to use large networks?
AndrewGrant
Posts: 1955
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant »

mehmet123 wrote: Tue Jun 15, 2021 11:26 pm
AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm
"Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."
I'll stick to that. I'm the last person doing it on my own.
And food for thought: Stockfish folks training on Leela data is far less concerning to me than other engines reusing the entire SF pipeline.
We respect your decision. Is there any chance of us seeing an unofficial version with the feature to use large networks?
Large networks? Define large. Mine are the original halfkp size of 2x256 => 32 =>32 => 1. You cannot plug any one else's Network into Ethereal, since they are not compatible.
willmorton
Posts: 30
Joined: Thu Sep 17, 2020 9:19 pm
Full name: William Morton

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by willmorton »

AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm "Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."

I'll stick to that. I'm the last person doing it on my own.
so all the others who have said their nets were trained on their engines' games lied?
AndrewGrant
Posts: 1955
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant »

willmorton wrote: Wed Jun 16, 2021 8:00 am
AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm "Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."

I'll stick to that. I'm the last person doing it on my own.
so now all the others who have said their nets were trained on their engines' games lied?
No no, not at all. Its all of the above, not just the data. So the only to NOT be trained on other data while also NOT using the Stockfish pipeline while also NOT using the Stockfish implementation while also BEING high level. I have no doubt that the other networks are trained on the data their authors claim. Sorry if there was any confusion there.
User avatar
AlexChess
Posts: 1562
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

AndrewGrant wrote: Wed Jun 16, 2021 8:07 am
willmorton wrote: Wed Jun 16, 2021 8:00 am
AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm "Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."

I'll stick to that. I'm the last person doing it on my own.
so now all the others who have said their nets were trained on their engines' games lied?
No no, not at all. Its all of the above, not just the data. So the only to NOT be trained on other data while also NOT using the Stockfish pipeline while also NOT using the Stockfish implementation while also BEING high level. I have no doubt that the other networks are trained on the data their authors claim. Sorry if there was any confusion there.
Hi!

Which is the size of the commercial NNUEs? Is it possible to train a custom net for the 13.00 github version, since it's different from Stockfish?

Regards,
AlexChess
Chess engines and dedicated chess computers fan since 1981 :D macOS Sequoia 16GB-512GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum
AndrewGrant
Posts: 1955
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AndrewGrant »

AlexChess wrote: Wed Jun 16, 2021 9:40 am
AndrewGrant wrote: Wed Jun 16, 2021 8:07 am
willmorton wrote: Wed Jun 16, 2021 8:00 am
AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm "Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."

I'll stick to that. I'm the last person doing it on my own.
so now all the others who have said their nets were trained on their engines' games lied?
No no, not at all. Its all of the above, not just the data. So the only to NOT be trained on other data while also NOT using the Stockfish pipeline while also NOT using the Stockfish implementation while also BEING high level. I have no doubt that the other networks are trained on the data their authors claim. Sorry if there was any confusion there.
Which is the size of the commercial NNUEs? Is it possible to train a custom net for the 13.00 github version, since it's different from Stockfish?

Regards,
AlexChess
Fat Fritz 2 was using 2x512 => 32 => 32 => 1 I believe? I cannot say for sure, but something like double the weights on the input layer.
Komodo ... I do not know the specifics. And if I did, I don't think they have said much publically, so I would not disclose that.

Yes, one could train their own Network for Ethereal. Such a person would need to take a peek at the NNUE code to figure out the format, as its different than Stockfish in order to exploit some AVX benefits for floats. You would then need to produce training code as well, as I have not released my training code written in C, nor do I plan to at any point. Although some other chess users do indeed have access to the training code. Halogen primarily, since Halogen was the guinea pig for my NN learning efforts.
User avatar
AlexChess
Posts: 1562
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by AlexChess »

Thank you!
I hope that other skilled programers will make their own NNUEs for it. I like to compare different versions :D

Regards, AlexChess
Chess engines and dedicated chess computers fan since 1981 :D macOS Sequoia 16GB-512GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by kranium »

mehmet123 wrote: Tue Jun 15, 2021 11:26 pm
AndrewGrant wrote: Tue Jun 15, 2021 11:04 pm
"Ethereal 13 (NNUE) includes two NNUE Networks for evaluation. These Networks are the second of their kind, boasting themselves as the only other high level NNUEs not derived from, trained on, nor duplicated from the works of the Stockfish team."
I'll stick to that. I'm the last person doing it on my own.
And food for thought: Stockfish folks training on Leela data is far less concerning to me than other engines reusing the entire SF pipeline.
We respect your decision. Is there any chance of us seeing an unofficial version with the feature to use large networks?
"We" ?
Mehmet, I don't believe you speak for everyone...certainly not for me.

Andrew, your posts are simply repugnant.
You and Ethereal owe a huge debt to Stockfish and all that came before., yet you act like you've invented all this technology by copying SF and rewriting a few python modules.

I I strongly suggest you step down from the fake ivory pedestal you've installed yourself on...
take a deep breath and inhale in large dose of much needed humility.
booot
Posts: 86
Joined: Sun Jul 03, 2016 10:29 pm

Re: Commercial Release of Ethereal 13.00 (NNUE) for AVX2 Systems

Post by booot »

AndrewGrant wrote: Wed Jun 16, 2021 8:07 am No no, not at all. Its all of the above, not just the data. So the only to NOT be trained on other data while also NOT using the Stockfish pipeline while also NOT using the Stockfish implementation while also BEING high level.
I am trying to implement it in Booot just now. With Delphi+Python+Keras+Tensorflow. Not using any Stockfish pipeline. I am still not sure i can pass this way by my own, but today i am much closer to finish then i was 1 month ago before i started :-).