How does perform SF-NNUE vs Lc0 ?

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

How does perform SF-NNUE vs Lc0 ?

Post by Vinvin »

I saw very few matches between this 2 engines.

Conditions like :
3min+2sec
200 games
book : short lines (where Lc0 was the best over A/B engines)

RTX 2080 Ti for Lc0
16 cores for SF-NNUE (latest exe + latest NN file)

Could someone run a match like this ?

Thanks,
Vincent
Jouni
Posts: 3293
Joined: Wed Mar 08, 2006 8:15 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by Jouni »

Everybody has sold their useless GPUs to gamers now.
Jouni
Masta
Posts: 28
Joined: Fri Jul 26, 2013 6:24 am

Re: How does perform SF-NNUE vs Lc0 ?

Post by Masta »

SF NNUE is just obliterating Lc0. Think with me. If SF was already beating Lc0 as demonstrated at TCEC...imagine now that it was improved in about one weak +110 ELO!!!
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: How does perform SF-NNUE vs Lc0 ?

Post by Vinvin »

Jouni wrote: Wed Aug 12, 2020 9:37 pm Everybody has sold their useless GPUs to gamers now.
:lol: :lol: :lol: :lol: :lol: :lol: :lol:
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: How does perform SF-NNUE vs Lc0 ?

Post by Vinvin »

Masta wrote: Wed Aug 12, 2020 10:29 pm If SF was already beating Lc0 as demonstrated at TCEC
For the last match, a book with long lines was used. This reduces the Lc0 power.
Masta wrote: Wed Aug 12, 2020 10:29 pm ...
imagine now that it was improved in about one weak +110 ELO!!!
I prefer to see results than use my imagination :-)
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by ernest »

Vinvin wrote: Thu Aug 13, 2020 12:15 am
I prefer to see results than use my imagination :-)
Well, maybe TCEC 19, which just started, will tell us more...
(but I couldn't find anything about which Lc0 and SF will participate)
User avatar
pohl4711
Posts: 2444
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: How does perform SF-NNUE vs Lc0 ?

Post by pohl4711 »

Vinvin wrote: Wed Aug 12, 2020 12:09 am I saw very few matches between this 2 engines.

Conditions like :
3min+2sec
200 games
book : short lines (where Lc0 was the best over A/B engines)

RTX 2080 Ti for Lc0
16 cores for SF-NNUE (latest exe + latest NN file)

Could someone run a match like this ?

Thanks,
Vincent
I am running a 300 games match between Lc0 0.26.1 Leelenstein 15 vs. SF 200807 9931db908a9b with Noomen lowdraw-openings (selected by J.Noomen out of his TCEC-openings (you can not play a match like this with short opening-lines, that would lead to draw-rates around 90%)) with long time: 5min+3sec for Lc0 (and +50% more time for SF nnue, to get a Leela-ratio of 1.0 (measured with SF 8 and Lc0 with old 11260 net, like Leela-ratio should be calculated), because my CPU is not so fast, compared to my RTX 2060).
Result in 3-4 days.
At the moment, it looks like a clear win for SF nnue.
Modern Times
Posts: 3553
Joined: Thu Jun 07, 2012 11:02 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by Modern Times »

Jouni wrote: Wed Aug 12, 2020 9:37 pm Everybody has sold their useless GPUs to gamers now.
I was never tempted to spend hundreds of pound on a high-end GPU and new power supply to run it. Not to mention the electricity bills.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by mwyoung »

Modern Times wrote: Thu Aug 13, 2020 9:33 pm
Jouni wrote: Wed Aug 12, 2020 9:37 pm Everybody has sold their useless GPUs to gamers now.
I was never tempted to spend hundreds of pound on a high-end GPU and new power supply to run it. Not to mention the electricity bills.
What kind of electric bill do you think you will have? My power is cheap, if I run at full power 24/7 it will cost me less then 30 bucks a month. With a 2950x and a 2080 ti. It cost me more to run my pool pump. That explains CCRL testing.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: How does perform SF-NNUE vs Lc0 ?

Post by mwyoung »

Vinvin wrote: Wed Aug 12, 2020 12:09 am I saw very few matches between this 2 engines.

Conditions like :
3min+2sec
200 games
book : short lines (where Lc0 was the best over A/B engines)

RTX 2080 Ti for Lc0
16 cores for SF-NNUE (latest exe + latest NN file)

Could someone run a match like this ?

Thanks,
Vincent
I can run this test. I have the exact hardware. This will be my next test. So do you want it to play the offical Stockfish NNUE with NNUE enabled? If no answer this is what will be played.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.