SF-NNUE going forward...

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
perejaslav
Posts: 230
Joined: Sat Mar 18, 2006 3:01 am
Location: Cold

Re: SF-NNUE going forward...

Post by perejaslav » Tue Jul 28, 2020 8:58 am

Ovyron wrote:
Mon Jul 27, 2020 8:44 pm
but people are just stopping using Leela because Leela is worse than NNUE at beating Stockfish.
people are just stopping using Leela because Leela cannot be tested in very fast time control using multithreaded mode.

marsell
Posts: 62
Joined: Tue Feb 07, 2012 10:14 am

Re: SF-NNUE going forward...

Post by marsell » Tue Jul 28, 2020 9:01 am

People need several expensive and power-hungry GPUs to beat Stockfish

perejaslav
Posts: 230
Joined: Sat Mar 18, 2006 3:01 am
Location: Cold

Re: SF-NNUE going forward...

Post by perejaslav » Tue Jul 28, 2020 9:24 am

That's true, too. I would really like to test Leela against Stockfish, but under current conditions it will take a lot of time. Besides, I don't understand how to choose the right time control so that the programs are in equal conditions.

User avatar
Ovyron
Posts: 4405
Joined: Tue Jul 03, 2007 2:30 am

Re: SF-NNUE going forward...

Post by Ovyron » Tue Jul 28, 2020 8:22 pm

marsell wrote:
Tue Jul 28, 2020 9:01 am
People need several expensive and power-hungry GPUs to beat Stockfish
What is interesting is that those people got the GPUs for Leela. They still have the GPUs. The GPUs didn't just disappear.

And yet they're choosing to use their CPUs and NNUE nets because that gives them better performance (less loses, more wins). I rub shoulders with those people, and they kept complaining that Leela wasn't winning them games, and that no matter what they tried, they were still drawing their games. With NNUE they get wins and don't complain anymore...

I was really close to getting one of those GPUs, I'm just glad I never did if now I'd be dropping Leela in favor of NNUE! :mrgreen:

Raphexon
Posts: 341
Joined: Sun Mar 17, 2019 11:00 am
Full name: Henk Drost

Re: SF-NNUE going forward...

Post by Raphexon » Tue Jul 28, 2020 9:03 pm

Ovyron wrote:
Tue Jul 28, 2020 8:22 pm
marsell wrote:
Tue Jul 28, 2020 9:01 am
People need several expensive and power-hungry GPUs to beat Stockfish
What is interesting is that those people got the GPUs for Leela. They still have the GPUs. The GPUs didn't just disappear.

And yet they're choosing to use their CPUs and NNUE nets because that gives them better performance (less loses, more wins). I rub shoulders with those people, and they kept complaining that Leela wasn't winning them games, and that no matter what they tried, they were still drawing their games. With NNUE they get wins and don't complain anymore...

I was really close to getting one of those GPUs, I'm just glad I never did if now I'd be dropping Leela in favor of NNUE! :mrgreen:
Has NNUE refuted a few lines yet?

User avatar
Ovyron
Posts: 4405
Joined: Tue Jul 03, 2007 2:30 am

Re: SF-NNUE going forward...

Post by Ovyron » Tue Jul 28, 2020 10:32 pm

Raphexon wrote:
Tue Jul 28, 2020 9:03 pm
Has NNUE refuted a few lines yet?
Yes, there's a little opening revolution as we speak, people that haven't updated their lines have lost +70 elo points. I'm currently outperforming people in much faster hardware than mine and I'm not even using NNUE, just holding up with drawish openings that don't lose while others go down in flames.

This is very recent, since Eman Enigma 1.00 was released an started winning tourneys and people started jumping towards it, refuting opening theory still used by Stockfish dev users (mainly, out of book positions where, say, Stockfish dev depth 38 still claims 0.00, while NNUE at just depth 20 already shows 1.00 white advantage, then the white side goes on to win positions that the book claimed were fine for black, but weren't.)

NNUE is not outsearching Stockfish dev, but out-evaluating it, I used to play those 0.00 lines and get draws, now the NNUEs are killing me, I think anybody picking a great book from last week will be destroyed today when they play black (some white lines have fallen, but white still holds so NNUE isn't strong enough to break white Stockfish dev.)

Someone went and played with NNUE without book and got better performance than Stockfish dev with book, just because of those poor book likes that are being uncovered. I can't really imagine how out of opening eval will look like in 2021, but it's possible 0.00 positions of today will be 2.00 by then :shock:

Zenmastur
Posts: 915
Joined: Sat May 31, 2014 6:28 am

Re: SF-NNUE going forward...

Post by Zenmastur » Wed Jul 29, 2020 12:32 am

Ovyron wrote:
Tue Jul 28, 2020 10:32 pm
Raphexon wrote:
Tue Jul 28, 2020 9:03 pm
Has NNUE refuted a few lines yet?
Yes, there's a little opening revolution as we speak, people that haven't updated their lines have lost +70 elo points. I'm currently outperforming people in much faster hardware than mine and I'm not even using NNUE, just holding up with drawish openings that don't lose while others go down in flames.

This is very recent, since Eman Enigma 1.00 was released an started winning tourneys and people started jumping towards it, refuting opening theory still used by Stockfish dev users (mainly, out of book positions where, say, Stockfish dev depth 38 still claims 0.00, while NNUE at just depth 20 already shows 1.00 white advantage, then the white side goes on to win positions that the book claimed were fine for black, but weren't.)

NNUE is not outsearching Stockfish dev, but out-evaluating it, I used to play those 0.00 lines and get draws, now the NNUEs are killing me, I think anybody picking a great book from last week will be destroyed today when they play black (some white lines have fallen, but white still holds so NNUE isn't strong enough to break white Stockfish dev.)

Someone went and played with NNUE without book and got better performance than Stockfish dev with book, just because of those poor book likes that are being uncovered. I can't really imagine how out of opening eval will look like in 2021, but it's possible 0.00 positions of today will be 2.00 by then :shock:
I'm going through several opening books I have for computer play. Many of the lines give advantage to one side or another in order to get a non-book position. It seems that a lot of the lines given may be busted by SF-NNUE. I'm having to delete about 5% of the lines because they are either close to lost or ARE completely lost. Rather surprising the number of lines I'm being forced to remove loosing.

I was expecting to lose some lines, mostly the longer ones. I wasn't expecting to lose so many 4-move lines. I can do the short ones manually, but there are way too many long ones to do this way.
Only 2 defining forces have ever offered to die for you.....Jesus Christ and the American Soldier. One died for your soul, the other for your freedom.

User avatar
Ovyron
Posts: 4405
Joined: Tue Jul 03, 2007 2:30 am

Re: SF-NNUE going forward...

Post by Ovyron » Wed Jul 29, 2020 2:43 am

I think this game showcases the shift. White is regular Stockfish in much bigger hardware than mine. Black is NNUE with the slow machine with a bad out-of-book opening position:



Stockfish is reaching much higher depths with outstanding eval and can't win. I think I'd have lost this game if I had hardware as fast as my opponent's but Stockfish dev. Using NNUE is like playing with software from the future.

Dann Corbit
Posts: 11705
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: SF-NNUE going forward...

Post by Dann Corbit » Wed Jul 29, 2020 5:54 am

Ovyron wrote:
Tue Jul 28, 2020 8:22 pm
marsell wrote:
Tue Jul 28, 2020 9:01 am
People need several expensive and power-hungry GPUs to beat Stockfish
What is interesting is that those people got the GPUs for Leela. They still have the GPUs. The GPUs didn't just disappear.
GPUs are marvelous, incredible things. I bought GPUs long before I found out they can be useful for chess. I have GPUs in all of my machines and boxes of GPUs besides.

You can test Mersenne Prime candidates.
You can fold proteins and cure diseases.
You can look for gravitational waves
It's not a case of what can you do with a GPU, it's what can't you do. I guess you can even stop a herd of stampeding Yak with GPUs.

The uses are endless. I think GPUs are the most fabulous thing (hardware-wise) on the surface of the earth. I can't wait to buy some more and some really smoking hot ones are just around the corner
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
Ovyron
Posts: 4405
Joined: Tue Jul 03, 2007 2:30 am

Re: SF-NNUE going forward...

Post by Ovyron » Wed Jul 29, 2020 6:10 am

Dann Corbit wrote:
Wed Jul 29, 2020 5:54 am
It's not a case of what can you do with a GPU, it's what can't you do.
Well, I can't run Leela on my GPU. It's NVIDIA, but from before they implemented CUDA. And I'm on Windows 8.1 so their DirectX 12 solution doesn't work, and the CPU Leela I can run is laughably bad.

So on all accounts NNUE is a winner for me.

Post Reply