How does perform SF-NNUE vs Lc0 ?

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Dann Corbit, Harvey Williamson

Vinvin
Posts: 5223
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: How does perform SF-NNUE vs Lc0 ?

Post by Vinvin »

mwyoung wrote: Thu Aug 13, 2020 10:42 pm
Vinvin wrote: Wed Aug 12, 2020 12:09 am I saw very few matches between this 2 engines.

Conditions like :
3min+2sec
200 games
book : short lines (where Lc0 was the best over A/B engines)

RTX 2080 Ti for Lc0
16 cores for SF-NNUE (latest exe + latest NN file)

Could someone run a match like this ?

Thanks,
Vincent
I can run this test. I have the exact hardware. This will be my next test. So do you want it to play the offical Stockfish NNUE with NNUE enabled? If no answer this is what will be played.
Sure ! The latest executable with the latest NN file.
The opening book could be : NoomenShortLinesTestsuite.pgn (100 positions)
or the openings use for the Match AlphaZero vs SF8 (100 positions) : https://www.chess.com/computer-chess-ch ... tion-match
Thanks !
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by mwyoung »

Vinvin wrote: Fri Aug 14, 2020 12:41 am
mwyoung wrote: Thu Aug 13, 2020 10:42 pm
Vinvin wrote: Wed Aug 12, 2020 12:09 am I saw very few matches between this 2 engines.

Conditions like :
3min+2sec
200 games
book : short lines (where Lc0 was the best over A/B engines)

RTX 2080 Ti for Lc0
16 cores for SF-NNUE (latest exe + latest NN file)

Could someone run a match like this ?

Thanks,
Vincent
I can run this test. I have the exact hardware. This will be my next test. So do you want it to play the offical Stockfish NNUE with NNUE enabled? If no answer this is what will be played.
Sure ! The latest executable with the latest NN file.
Thanks !
That is what is running now! Enjoy!

Live Stream: https://www.youtube.com/watch?v=ISrbnpZ1wBo
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
Vinvin
Posts: 5223
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: How does perform SF-NNUE vs Lc0 ?

Post by Vinvin »

After 94 games, SF-NNUE is clearly leading.
Score in 4 different formats :
53-41
+15;=78;-1
57.4%
+52 Elo

SF-NNUE, the new God of chess.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: How does perform SF-NNUE vs Lc0 ?

Post by zullil »

Vinvin wrote: Fri Aug 14, 2020 5:26 pm After 94 games, SF-NNUE is clearly leading.
Score in 4 different formats :
53-41
+15;=78;-1
57.4%
+52 Elo

SF-NNUE, the new God of chess.
What exactly is Stockfish+NNUE 130820? It's hard to know what binaries folks are actually running at this point. From where was this binary (or its source) actually downloaded?
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: How does perform SF-NNUE vs Lc0 ?

Post by Laskos »

zullil wrote: Fri Aug 14, 2020 6:18 pm
Vinvin wrote: Fri Aug 14, 2020 5:26 pm After 94 games, SF-NNUE is clearly leading.
Score in 4 different formats :
53-41
+15;=78;-1
57.4%
+52 Elo

SF-NNUE, the new God of chess.
What exactly is Stockfish+NNUE 130820? It's hard to know what binaries folks are actually running at this point. From where was this binary (or its source) actually downloaded?
It's stockfish_20081307 binary from yesterday.
Leo
Posts: 1076
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: How does perform SF-NNUE vs Lc0 ?

Post by Leo »

mwyoung wrote: Thu Aug 13, 2020 10:31 pm
Modern Times wrote: Thu Aug 13, 2020 9:33 pm
Jouni wrote: Wed Aug 12, 2020 9:37 pm Everybody has sold their useless GPUs to gamers now.
I was never tempted to spend hundreds of pound on a high-end GPU and new power supply to run it. Not to mention the electricity bills.
What kind of electric bill do you think you will have? My power is cheap, if I run at full power 24/7 it will cost me less then 30 bucks a month. With a 2950x and a 2080 ti. It cost me more to run my pool pump. That explains CCRL testing.
My natural gas bill is always a lot more then electricity.
Advanced Micro Devices fan.
Modern Times
Posts: 3517
Joined: Thu Jun 07, 2012 11:02 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by Modern Times »

Leo wrote: Fri Aug 14, 2020 7:31 pm
My natural gas bill is always a lot more then electricity.
Depends on the time of year. In winter yes but in summer when all the gas has to do is provide hot water, electricity bill far exceeds it, i.e. 3 times as much. In Europe electricity is very expensive, whereas in the USA it is much cheaper I hear.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by mwyoung »

Laskos wrote: Fri Aug 14, 2020 6:43 pm
zullil wrote: Fri Aug 14, 2020 6:18 pm
Vinvin wrote: Fri Aug 14, 2020 5:26 pm After 94 games, SF-NNUE is clearly leading.
Score in 4 different formats :
53-41
+15;=78;-1
57.4%
+52 Elo

SF-NNUE, the new God of chess.
What exactly is Stockfish+NNUE 130820? It's hard to know what binaries folks are actually running at this point. From where was this binary (or its source) actually downloaded?
It's stockfish_20081307 binary from yesterday.
-mwyoung- is known to not change his mind at any cost even in the front of overwhelming evidence that he might do much better. Leave him alone, I never follow his tests, he used to use some 36 threads on 16 core machine, I don't know what other silly things he is doing.

Thanks for contributing to the testing Lasko.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by mwyoung »

Leo wrote: Fri Aug 14, 2020 7:31 pm
mwyoung wrote: Thu Aug 13, 2020 10:31 pm
Modern Times wrote: Thu Aug 13, 2020 9:33 pm
Jouni wrote: Wed Aug 12, 2020 9:37 pm Everybody has sold their useless GPUs to gamers now.
I was never tempted to spend hundreds of pound on a high-end GPU and new power supply to run it. Not to mention the electricity bills.
What kind of electric bill do you think you will have? My power is cheap, if I run at full power 24/7 it will cost me less then 30 bucks a month. With a 2950x and a 2080 ti. It cost me more to run my pool pump. That explains CCRL testing.
My natural gas bill is always a lot more then electricity.
That is because you now get your natural gas from Russia. My gas bill is 15 bucks a month.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
MMarco
Posts: 195
Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante

Re: How does perform SF-NNUE vs Lc0 ?

Post by MMarco »

Vinvin wrote: Fri Aug 14, 2020 5:26 pm After 94 games, SF-NNUE is clearly leading.
Score in 4 different formats :
53-41
+15;=78;-1
57.4%
+52 Elo

SF-NNUE, the new God of chess.
Yes maybe SF-NNUE is the new god, although Lc0 might have done better with LS 15.0 at this time control (instead of SV-4585).