this will be the merge of a lifetime : SF 80 Elo+

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, bob, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
User avatar
MikeB
Posts: 4415
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB » Tue Aug 04, 2020 3:28 pm

Image

zullil
Posts: 6442
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by zullil » Tue Aug 04, 2020 4:11 pm

MikeB wrote:
Tue Aug 04, 2020 3:28 pm
https://tests.stockfishchess.org/tests/ ... 64f05e4c58

I think this qualifies for SF 12!!
That's relative to Stockfish-dev. About +120 Elo above Stockfish 11, I think.

So much for human programming of evaluation functions. :wink:

User avatar
Leto
Posts: 2052
Joined: Thu May 04, 2006 1:40 am
Location: Dune

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leto » Tue Aug 04, 2020 4:17 pm

Is that at LTC?

lkaufman
Posts: 4340
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by lkaufman » Tue Aug 04, 2020 4:27 pm

Leto wrote:
Tue Aug 04, 2020 4:17 pm
Is that at LTC?
I'm getting a result that sfnnue (yesterday's 2108 net) on one thread is beating Stockfish 11 on four threads, at 2' + 1" by 9 elo after 200 games. This nnue is the real deal.
Komodo rules!

zullil
Posts: 6442
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by zullil » Tue Aug 04, 2020 4:45 pm

Leto wrote:
Tue Aug 04, 2020 4:17 pm
Is that at LTC?
tc (20+0.2 )s

Raphexon
Posts: 327
Joined: Sun Mar 17, 2019 11:00 am
Full name: Henk Drost

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Raphexon » Tue Aug 04, 2020 4:56 pm

zullil wrote:
Tue Aug 04, 2020 4:45 pm
Leto wrote:
Tue Aug 04, 2020 4:17 pm
Is that at LTC?
tc (20+0.2 )s
20+0.2 at 8 threads.

User avatar
MikeB
Posts: 4415
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB » Tue Aug 04, 2020 5:58 pm

Leto wrote:
Tue Aug 04, 2020 4:17 pm
Is that at LTC?
It scales very well.
Image

Gian-Carlo Pascutto
Posts: 1204
Joined: Sat Dec 13, 2008 6:00 pm
Contact:

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Gian-Carlo Pascutto » Tue Aug 04, 2020 6:01 pm

There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.

User avatar
Ovyron
Posts: 4402
Joined: Tue Jul 03, 2007 2:30 am

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Ovyron » Wed Aug 05, 2020 10:41 am

This is the breakthrough I've been predicting for years! It finally happened, and I'm just glad chess looks very healthy after it (draw rates have gone down! Some lines are proving to be playable again!)
Gian-Carlo Pascutto wrote:
Tue Aug 04, 2020 6:01 pm
There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
I agree, a Stockfish 12 release could be premature. These are new unexplored terrains, the code is nowhere near being optimized, the nets are nowhere near properly tested, imagine if SF 12 is released and one month later there's another 50 elo jump, we want a SF 12 that lasts for long!

This makes Alpha Zero look like peanuts! Bring back Deep Mind!

User avatar
MikeB
Posts: 4415
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by MikeB » Wed Aug 05, 2020 12:28 pm

Ovyron wrote:
Wed Aug 05, 2020 10:41 am
This is the breakthrough I've been predicting for years! It finally happened, and I'm just glad chess looks very healthy after it (draw rates have gone down! Some lines are proving to be playable again!)
Gian-Carlo Pascutto wrote:
Tue Aug 04, 2020 6:01 pm
There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
I agree, a Stockfish 12 release could be premature. These are new unexplored terrains, the code is nowhere near being optimized, the nets are nowhere near properly tested, imagine if SF 12 is released and one month later there's another 50 elo jump, we want a SF 12 that lasts for long!

This makes Alpha Zero look like peanuts! Bring back Deep Mind!
To both - that is exactly why it should be #12 - set a marker in time from this point forward to measure progress. They always test regression against a prior release - what better time to set new marker once you merged a PR that is a 'significant" change - you will always want to measure progress from this point forward against the initial release.
Image

Post Reply