this will be the merge of a lifetime : SF 80 Elo+

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB »

Image
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by zullil »

MikeB wrote: Tue Aug 04, 2020 5:28 pm https://tests.stockfishchess.org/tests/ ... 64f05e4c58

I think this qualifies for SF 12!!
That's relative to Stockfish-dev. About +120 Elo above Stockfish 11, I think.

So much for human programming of evaluation functions. :wink:
User avatar
Leto
Posts: 2071
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leto »

Is that at LTC?
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by lkaufman »

Leto wrote: Tue Aug 04, 2020 6:17 pmIs that at LTC?
I'm getting a result that sfnnue (yesterday's 2108 net) on one thread is beating Stockfish 11 on four threads, at 2' + 1" by 9 elo after 200 games. This nnue is the real deal.
Komodo rules!
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by zullil »

Leto wrote: Tue Aug 04, 2020 6:17 pmIs that at LTC?
tc (20+0.2 )s
Raphexon
Posts: 476
Joined: Sun Mar 17, 2019 12:00 pm
Full name: Henk Drost

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Raphexon »

zullil wrote: Tue Aug 04, 2020 6:45 pm
Leto wrote: Tue Aug 04, 2020 6:17 pmIs that at LTC?
tc (20+0.2 )s
20+0.2 at 8 threads.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB »

Leto wrote: Tue Aug 04, 2020 6:17 pmIs that at LTC?
It scales very well.
Image
Gian-Carlo Pascutto
Posts: 1243
Joined: Sat Dec 13, 2008 7:00 pm

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Gian-Carlo Pascutto »

There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Ovyron »

This is the breakthrough I've been predicting for years! It finally happened, and I'm just glad chess looks very healthy after it (draw rates have gone down! Some lines are proving to be playable again!)
Gian-Carlo Pascutto wrote: Tue Aug 04, 2020 8:01 pm There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
I agree, a Stockfish 12 release could be premature. These are new unexplored terrains, the code is nowhere near being optimized, the nets are nowhere near properly tested, imagine if SF 12 is released and one month later there's another 50 elo jump, we want a SF 12 that lasts for long!

This makes Alpha Zero look like peanuts! Bring back Deep Mind!
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB »

Ovyron wrote: Wed Aug 05, 2020 12:41 pm This is the breakthrough I've been predicting for years! It finally happened, and I'm just glad chess looks very healthy after it (draw rates have gone down! Some lines are proving to be playable again!)
Gian-Carlo Pascutto wrote: Tue Aug 04, 2020 8:01 pm There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
I agree, a Stockfish 12 release could be premature. These are new unexplored terrains, the code is nowhere near being optimized, the nets are nowhere near properly tested, imagine if SF 12 is released and one month later there's another 50 elo jump, we want a SF 12 that lasts for long!

This makes Alpha Zero look like peanuts! Bring back Deep Mind!
To both - that is exactly why it should be #12 - set a marker in time from this point forward to measure progress. They always test regression against a prior release - what better time to set new marker once you merged a PR that is a 'significant" change - you will always want to measure progress from this point forward against the initial release.
Image