I have the code to run NNUEs in Ethereal. I'll probably clean it up and merge it if I had a network I could call "mine". Ethereal with an NNUE will very easily smash all engines in TCEC aside from Stockfish, and _maybe_ Leela. I'm willing to add whoever makes an original Net, one without running Stockfish evals or qsearches, to the authors output. I don't even care if its trained on Ethereal data or games -- just enough to pass TCEC's pathetic criteria.
I can provide something like 5 million Ethereal self-play games to help. But no one has been opposed to using Stockfish games (for some reason?) so there are ~50 million of those freely available, and they are quite easy to extract and strip to a small size.
If no one is immediately interested, I'd be willing to talk about $. I can run the training session on a 32-core CPU if desired. I'll be buying RTX3080s whenever they are again available.
Request for someone to train an NNUE for Ethereal
Moderators: hgm, Rebel, chrisw
-
- Posts: 1777
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Request for someone to train an NNUE for Ethereal
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 512
- Joined: Tue Sep 29, 2020 4:29 pm
- Location: Dublin, Ireland
- Full name: Madeleine Birchfield
Re: Request for someone to train an NNUE for Ethereal
Why is TCEC and beating other engines so important to you that you feel the need to abandon your principles of not using NNUE in Ethereal?
-
- Posts: 11618
- Joined: Thu Mar 09, 2006 12:57 am
- Location: Birmingham UK
Re: Request for someone to train an NNUE for Ethereal
Madeleine Birchfield wrote: ↑Fri Oct 09, 2020 11:20 pm Why is TCEC and beating other engines so important to you that you feel the need to abandon your principles of not using NNUE in Ethereal?
It's difficult enough to understand small neural networks: the human brain has around 10^11 neurons, with each neuron connecting to about 10,000 others, making a total of 10^15 synapses. It's wrong to assume that anyone is able to understand their own behaviour or motivations: they don't.
Having said that, whether I'm right or wrong, I now feel I have a satisfying explanation for Andrew's retirement messages: he wants to place high in TCEC, and felt that without having the latest weapon, he wouldn't be able to. He has now decided to acquire the new weapon, so retirement is postponed - at least temporarily...
Writing is the antidote to confusion.
It's not "how smart you are", it's "how are you smart".
Your brain doesn't work the way you want, so train it!
It's not "how smart you are", it's "how are you smart".
Your brain doesn't work the way you want, so train it!
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: Request for someone to train an NNUE for Ethereal
I think my data generation should be just about complete.
When I create a net with it, it will be a flip net though.
Look at Noob's changes what to change to make it work: (not a lot btw)
https://github.com/noobpwnftw/Stockfish/tree/flip
Unlikely it will pass Fishtest so you can use it.
I'll try a few settings and see if it can be more different from SF eval than Ls15 is from T60.
When I create a net with it, it will be a flip net though.
Look at Noob's changes what to change to make it work: (not a lot btw)
https://github.com/noobpwnftw/Stockfish/tree/flip
Unlikely it will pass Fishtest so you can use it.
I'll try a few settings and see if it can be more different from SF eval than Ls15 is from T60.
-
- Posts: 1777
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Request for someone to train an NNUE for Ethereal
Is this a network that meets TCEC's criteria -- not trained on SF evals and searches? If so, do you want to talk more?Raphexon wrote: ↑Fri Oct 09, 2020 11:51 pm I think my data generation should be just about complete.
When I create a net with it, it will be a flip net though.
Look at Noob's changes what to change to make it work: (not a lot btw)
https://github.com/noobpwnftw/Stockfish/tree/flip
Unlikely it will pass Fishtest so you can use it.
I'll try a few settings and see if it can be more different from SF eval than Ls15 is from T60.
We can talk here, through pms, Discord (Andrews#9072), or Email (andrew@grantnet.us)
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: Request for someone to train an NNUE for Ethereal
Seems like the TCEC requirements (for NNUE) have become more strict, I won't be able to abide to that.AndrewGrant wrote: ↑Fri Oct 09, 2020 11:53 pmIs this a network that meets TCEC's criteria -- not trained on SF evals and searches? If so, do you want to talk more?Raphexon wrote: ↑Fri Oct 09, 2020 11:51 pm I think my data generation should be just about complete.
When I create a net with it, it will be a flip net though.
Look at Noob's changes what to change to make it work: (not a lot btw)
https://github.com/noobpwnftw/Stockfish/tree/flip
Unlikely it will pass Fishtest so you can use it.
I'll try a few settings and see if it can be more different from SF eval than Ls15 is from T60.
We can talk here, through pms, Discord (Andrews#9072), or Email (andrew@grantnet.us)
Feels a little arbitrary though. If you train purely on results you're not using SF eval as target, and since the Stockfish team can't claim ownership of individual games played it shouldn't be a problem. But I guess it is.
-
- Posts: 1777
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Request for someone to train an NNUE for Ethereal
Yup! Mission Accomplished. This thread can be ignored now safely.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 5569
- Joined: Tue Feb 28, 2012 11:56 pm
Re: Request for someone to train an NNUE for Ethereal
Are those TCEC rules written up somewhere?
-
- Posts: 1777
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Request for someone to train an NNUE for Ethereal
TCEC refuses to take a stance on anything, not even Houdini.
They have "Guidelines", found here : https://wiki.chessdom.org/TCEC_Cup_7_rules#Guidelines
Note that they change every 24 hours. People not as jaded as me, will complain just as much.
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 5569
- Joined: Tue Feb 28, 2012 11:56 pm
Re: Request for someone to train an NNUE for Ethereal
Thanks.AndrewGrant wrote: ↑Sat Oct 10, 2020 1:51 pmTCEC refuses to take a stance on anything, not even Houdini.
They have "Guidelines", found here : https://wiki.chessdom.org/TCEC_Cup_7_rules#Guidelines
Note that they change every 24 hours. People not as jaded as me, will complain just as much.
Why not!?Do the NNUE guidelines apply outside NNUE technology?
No, of course not.
Why would you be allowed to tune your non-NNUE eval by playing games against Stockfish if you're not allowed to tune your NNUE eval with games played by (or rather: positions generated by) Stockfish.
So only self-play games are allowed (when tuning NNUE weights but not when tuning other weights)?3. All NNUE training data should be generated by the unique engine's own search and/or eval code.