I had a fair amount of 800 node test games from bad gyal 7 though 8h sitting around, so I trained up Night Nurse (bonus for anyone who gets the Jamaican connection) from that data. Now anyone who is curious what a nnue net would play like if it were trained by a leela type net, there you go.
Now Bad Gyal isn’t even the strongest 128x10 net (probably -130 elo to t70), but Night Nurse already plays much more dynamically than the sf trained nets. I’m really curious what a nnue trained by a big net with 1600 nodes per move would look like.
The best nnue nets may end up being trained by Leela.
Night Nurse is Bad Gyal in disguise
Moderators: hgm, Rebel, chrisw
-
- Posts: 1632
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Night Nurse is Bad Gyal in disguise
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 6345
- Joined: Mon Mar 13, 2006 2:34 pm
- Location: Acworth, GA
Re: Night Nurse is Bad Gyal in disguise
Will there be a Pi version?
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
__________________________________________________________________
Ted Summers
-
- Posts: 1632
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Night Nurse is Bad Gyal in disguise
If sf-nnue runs on pi, then yes.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 6345
- Joined: Mon Mar 13, 2006 2:34 pm
- Location: Acworth, GA
Re: Night Nurse is Bad Gyal in disguise
I hope so, I have not heard any news about NNUE and Pi yet, but I will keep my eyes open for it.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
__________________________________________________________________
Ted Summers
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: Night Nurse is Bad Gyal in disguise
Just want to commend the people that are still coming up with nice names for things such as "Bad Gyal" or "Night Nurse" which really give character to what they make. Unlike others that continue using boring names like N.N.U.E., StockfiNN, NBSC, or name their nets with hard cold numbers.
The latest technologies have been full of creativity under the rugs, original names are a great way to show imagination on the other side.
The latest technologies have been full of creativity under the rugs, original names are a great way to show imagination on the other side.
-
- Posts: 3187
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Night Nurse is Bad Gyal in disguise
You mean trained by games Leela played against SF NNUE or against SF or against different Leel- nets?
That would be trained by SF and by Leela yet still mainly and depend much on Hardware- TC, as for the quality of the games, wouldn't it?
Or games Leela played on her own?
That would still depend mainly on the books used.
By games Leela playes on her own without book would be somewhat narrow- minded as for openings, wouldn't it?
Not so easy to get the right material for training.
I'd still take big opening books with much diversity and many sharp lines, into big depthes combined with corr. databases.
How about that?
Peter.
-
- Posts: 1632
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Night Nurse is Bad Gyal in disguise
You’re training an evaluation function based on the evaluation of an engine at some depth. Stockfish is easy, as the generation of training data from sf’s eval is built in. But you can generate training data from any uci engine (as I have done with toga, bad gyal and Komodo). At 800 nodes per move, lc0 even with a relatively weak 128x10 net generates very good evals.peter wrote: ↑Fri Jul 31, 2020 9:27 amYou mean trained by games Leela played against SF NNUE or against SF or against different Leel- nets?
That would be trained by SF and by Leela yet still mainly and depend much on Hardware- TC, as for the quality of the games, wouldn't it?
Or games Leela played on her own?
That would still depend mainly on the books used.
By games Leela playes on her own without book would be somewhat narrow- minded as for openings, wouldn't it?
Not so easy to get the right material for training.
I'd still take big opening books with much diversity and many sharp lines, into big depthes combined with corr. databases.
How about that?
The engine plays games against itself to generate positions with evals. The training data games start essentially from some position arrived at by a random walk and with random moves, especially king moves, thrown in from time to time afterwards, otherwise you won’t cover a big enough variety of positions. It doesn’t really resemble ‘good chess.’
If you want to train against the result in some way, you have to reduce the randomness.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 3187
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Night Nurse is Bad Gyal in disguise
But you can train with .pgn- data too, can't you?dkappe wrote: ↑Fri Jul 31, 2020 10:10 am The engine plays games against itself to generate positions with evals. The training data games start essentially from some position arrived at by a random walk and with random moves, especially king moves, thrown in from time to time afterwards, otherwise you won’t cover a big enough variety of positions. It doesn’t really resemble ‘good chess.’
If you want to train against the result in some way, you have to reduce the randomness.
My idea was, to take into .pgn- transcribed book- moves, played out or adjudicated as wdl, together with corr.- games in .pgn and maybe 7some- tbs- positions with their lines to wdl.
Wouldn't that resemble "good chess"?
Peter.
-
- Posts: 1632
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: Night Nurse is Bad Gyal in disguise
In theory it’s possible, but I’m not sure how many games you would need.peter wrote: ↑Fri Jul 31, 2020 10:28 amBut you can train with .pgn- data too, can't you?dkappe wrote: ↑Fri Jul 31, 2020 10:10 am The engine plays games against itself to generate positions with evals. The training data games start essentially from some position arrived at by a random walk and with random moves, especially king moves, thrown in from time to time afterwards, otherwise you won’t cover a big enough variety of positions. It doesn’t really resemble ‘good chess.’
If you want to train against the result in some way, you have to reduce the randomness.
My idea was, to take into .pgn- transcribed book- moves, played out or adjudicated as wdl, together with corr.- games in .pgn and maybe 7some- tbs- positions with their lines to wdl.
Wouldn't that resemble "good chess"?
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 3187
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Night Nurse is Bad Gyal in disguise
Well, neither do I of course.
But Herbert Bellmann's corr. DVD only is already about 1.5 Million games, a book like Cerebellum with wdl- adjudicated lines probably already more then this, 7men Lomonosovs probably some more then both others together, yet maybe on average only as long as the opening- lines.
I'd guess at least 10 millions of games, how many positions? Let's say 0.5 billions?
Peter.