It's NNUE era (sharing my thoughts)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: It's NNUE era (sharing my thoughts)

Post by Dann Corbit »

1 ShashChess 15.0 64-bit 4CPU 3534 +27 −26 76.5% −175.1 46.9% 490
198‑199 OliThink 5.6.9 64-bit 2528 +27 −27 43.6% +46.2 30.3% 489
3534-2528=1006 Elo.

The eval of Olithink is mobility and a few simple tables.
Running on one thread, it is within one thousand Elo of the strongest program on the list:
https://ccrl.chessdom.com/ccrl/4040/
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: It's NNUE era (sharing my thoughts)

Post by Dann Corbit »

One should not imagine that I am an opponent or I dislike someone or their work because I do not agree with them.
I may very well admire both them and their work.

"The way I see it, an intelligent person who disagrees with me is
probably the most important person I'll interact with on any given
day."
--Billy Chambless
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
tomitank
Posts: 276
Joined: Sat Mar 04, 2017 12:24 pm
Location: Hungary

Re: It's NNUE era (sharing my thoughts)

Post by tomitank »

AndrewGrant wrote: Mon Jan 18, 2021 3:07 pm
You have to labour for the NNUE eval too. Unless you are a coward and reuse the code and weights that Stockfish already gave you. NNUE is not a magic bullet -- Stockfish NNUEs are a magic bullet. Everyone who has tried to replicate NNUE on their own will know this.
@Dann Corbit:
This is the most important part of what we have to say.
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: It's NNUE era (sharing my thoughts)

Post by Dann Corbit »

tomitank wrote: Mon Jan 18, 2021 6:35 pm
AndrewGrant wrote: Mon Jan 18, 2021 3:07 pm
You have to labour for the NNUE eval too. Unless you are a coward and reuse the code and weights that Stockfish already gave you. NNUE is not a magic bullet -- Stockfish NNUEs are a magic bullet. Everyone who has tried to replicate NNUE on their own will know this.
@Dann Corbit:
This is the most important part of what we have to say.
Are you afraid to use the other data that SF produces? If it writes an EPD string will you use it?
Now, according to my understanding, the original SF NNUE creation code did not use its own eval at all. So it is the search of Stockfish producing the great nodes. Later, they used the SF eval because of the partially relying on SF eval for lopsided positions and it broke something. I do not know if they got that sorted out or not.

At any rate, I do not see data written by a chess program as sacred either. If you do, then I suggest you do not use it.

Of course if you use the data (and maybe if you do not) you will be banned from tournaments. This is ignorance on the part of the tournament organizers but so be it.

So if it is important for you to be allowed to play in tournaments then I suggest you use your own engine to create the data nodes. When your search is as good as Stockfish's search, then your nodes will be as good also.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
tomitank
Posts: 276
Joined: Sat Mar 04, 2017 12:24 pm
Location: Hungary

Re: It's NNUE era (sharing my thoughts)

Post by tomitank »

Dann Corbit wrote: Mon Jan 18, 2021 7:31 pm
tomitank wrote: Mon Jan 18, 2021 6:35 pm
AndrewGrant wrote: Mon Jan 18, 2021 3:07 pm
You have to labour for the NNUE eval too. Unless you are a coward and reuse the code and weights that Stockfish already gave you. NNUE is not a magic bullet -- Stockfish NNUEs are a magic bullet. Everyone who has tried to replicate NNUE on their own will know this.
@Dann Corbit:
This is the most important part of what we have to say.
Are you afraid to use the other data that SF produces? If it writes an EPD string will you use it?
Now, according to my understanding, the original SF NNUE creation code did not use its own eval at all. So it is the search of Stockfish producing the great nodes. Later, they used the SF eval because of the partially relying on SF eval for lopsided positions and it broke something. I do not know if they got that sorted out or not.

At any rate, I do not see data written by a chess program as sacred either. If you do, then I suggest you do not use it.

Of course if you use the data (and maybe if you do not) you will be banned from tournaments. This is ignorance on the part of the tournament organizers but so be it.

So if it is important for you to be allowed to play in tournaments then I suggest you use your own engine to create the data nodes. When your search is as good as Stockfish's search, then your nodes will be as good also.
Here is my solution:
http://talkchess.com/forum3/viewtopic.php?f=2&t=76359

I am as far from the SF solution as possible. Obviously, now all NN networks are suspicious after SF NNUE.
User avatar
maksimKorzh
Posts: 771
Joined: Sat Sep 08, 2018 5:37 pm
Location: Ukraine
Full name: Maksim Korzh

Re: It's NNUE era (sharing my thoughts)

Post by maksimKorzh »

AndrewGrant wrote: Mon Jan 18, 2021 3:00 pm
Dann Corbit wrote: Mon Jan 18, 2021 2:57 pm
AndrewGrant wrote: Mon Jan 18, 2021 2:53 pm
Dann Corbit wrote: Mon Jan 18, 2021 2:48 pm
tomitank wrote: Mon Jan 18, 2021 2:25 pm I agree with Andrew. Evaluation is the soul of the engine. LMR, Null move, etc is nothing without eval.
The real power of the modern chess engine is the branching factor, not the eval.
If that is the case, why are people taking SF's NNUE? The power is not in the eval you say, yet people gain hundreds to a thousand elo by copying it. Why don't we all just copy the Stockfish search tables? I'm so sick of "engine enthusiasts" that know nothing of what they speak.

I debate with myself what I should have done with Ethereal. Whether I should have sold copies. Or whether I should sell nets in the future. And my reoccurring thought is that Ethereal is at the top end, but it will never break the Leela / SF market hold. The only people using Ethereal are people that are quite invested in computer chess, and thus the only buyers would be the kinds of people on talkchess. And those people are the people who contribute ideas and insights that make things like Ethereal possible. But that is not true anymore.

But then I think of the sheer stupidity, ignorance, and otherwise degenerate views that so many on these forums hold. I don't think I view anyone on this forum as my friend anymore. I don't contribute my ideas to the programming section anymore. I've found the dozen or so people worth something on this forum, and collected them into a nice little discord. Maybe its time the Shut It Down movement goes all the way and burns this cesspool to the ground like it deserves.
NNUE added 100 Elo, not thousands.
The eval of Olithink would fit on a single page of paper.
Yet with a single thread it is within a thousand Elo of Stockfish
Wrong! Facts! Simple!

+180 to Ethereal and Komodo
+250 to Igel and Ruby
+300 to Andscas
+1000 to BBC
Only around 600 to BBC
And it's time to forget that experiment.
I'm no longer maintaining that.
That was just an experiment.
I'm now learning all from scratch.
Now playing around with Texel's tuning.
It would be much better to provide beginner's materials helping us noobs to learn.
No one would copypaste sf nnue if knows how to make your own.
Well at least it's true for me.
JohnWoe
Posts: 491
Joined: Sat Mar 02, 2013 11:31 pm

Re: It's NNUE era (sharing my thoughts)

Post by JohnWoe »

Double standards.
You shall earn every +Elo with blood, sweat and tears! :lol:

Somehow it's ok to copy-paste syzygy egtb / probing code in folder.
But not NNUE.

Wait you still need to fish out the syzygy probing code from Stockfish. Also download 17TiB of 7 men somehow.

The problem is:
Except syzygy gives you +5 Elo.
NNUE gives +900 Elo.

The real improvement came from Shogi guys. Without them we would be squeezing +0.2 Elo out from razoring.

I use LMR, Null move, Magic bitboards, UCI, Qsearch, IID...
I have invented absolutely nothing new.
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: It's NNUE era (sharing my thoughts)

Post by dkappe »

JohnWoe wrote: Tue Jan 19, 2021 12:22 am Double standards.
You shall earn every +Elo with blood, sweat and tears! :lol:
It’s changed the engine improvement workflow and skill sets. To develop a 3000+ engine, you had to implement a good search and a good eval, then tune them so they worked well together.

With NNUE, you just can focus on search and learn a few tricks to train up a decent net. Gone is the HCE glory.

Now 3300 is the new 3000. In a few months, everyone will be looking for ways to goose the nets — through size, architecture, etc. Those that use existing tools like tensorflow and pytorch instead of developing them from scratch will win the race(s).
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
jdart
Posts: 4367
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: It's NNUE era (sharing my thoughts)

Post by jdart »

It is pretty well established I think that both search and eval are important. Stockfish is strong because it is especially strong in both areas. But a good eval is very important.
Angle
Posts: 319
Joined: Sat Oct 31, 2020 1:04 am
Full name: Aleksey Glebov

Re: It's NNUE era (sharing my thoughts)

Post by Angle »

I only want to say that "NNUE Era" and "Copy-Paste SF NNUE Era" are two basicaly different rhings. The first is beautiful while the second is unworthy. In many discussions here, these two concepts are not separated, which is a great mistake.
Incredibly fast systems miscount incredibly fast.