Stockfish 14 has been released

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Stockfish 14 has been released

Post by Madeleine Birchfield »

Making another thread as the other thread has devolved into a debate over neural network training data.

Stockfish 14 binaries could be found at https://abrok.eu/stockfish/.

Edit: Blog post now out: https://stockfishchess.org/blog/2021/stockfish-14/
Today, we have the pleasure to announce Stockfish 14.

As usual, downloads will be freely available at stockfishchess.org/download.

The engine is now significantly stronger than just a few months ago, and wins four times more game pairs than it loses against the previous release version. Stockfish 14 is now at least 400 Elo ahead of Stockfish 7, a top engine in 2016. During the last five years, Stockfish has thus gained about 80 Elo per year.

Stockfish 14 evaluates positions more accurately than Stockfish 13 as a result of two major steps forward in defining and training the efficiently updatable neural network (NNUE) that provides the evaluation for positions.

First, the collaboration with the Leela Chess Zero team - announced previously - has come to fruition. The LCZero team has provided a collection of billions of positions evaluated by Leela that we have combined with billions of positions evaluated by Stockfish to train the NNUE net that powers Stockfish 14. The fact that we could use and combine these datasets freely was essential for the progress made and demonstrates the power of open source and open data.

Second, the architecture of the NNUE network was significantly updated: the new network is not only larger, but more importantly, it deals better with large material imbalances and can specialize for multiple phases of the game. A new project, kick-started by Gary Linscott and Tomasz Sobczyk, led to a GPU accelerated net trainer written in pytorch. This tool allows for training high-quality nets in a couple of hours.

Finally, this release features some search refinements, minor bug fixes and additional improvements. For example, Stockfish is now about 90 Elo stronger for chess960 (Fischer random chess) at short time control.

The Stockfish project builds on a thriving community of enthusiasts (thanks everybody!) that contribute their expertise, time, and resources to build a free and open-source chess engine that is robust, widely available, and very strong. We invite our chess fans to join the fishtest testing framework and programmers to contribute to the project on github.

Stay safe and enjoy chess!

The Stockfish team
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish 14 has been released

Post by Rebel »

Gauntlet started, 1800 games.

http://rebel13.nl/a/grl.htm

Page refreshes each 30 seconds.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Stockfish 14 has been released

Post by CMCanavessi »

Hmmmm so far no good... by a mile

Stockfish 13 : 3677.0
Stockfish_14 : 3628.3
Difference : -48.7
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: Stockfish 14 has been released

Post by Madeleine Birchfield »

CMCanavessi wrote: Fri Jul 02, 2021 11:21 pm Hmmmm so far no good... by a mile

Stockfish 13 : 3677.0
Stockfish_14 : 3628.3
Difference : -48.7
Sample size?
User avatar
towforce
Posts: 11571
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK

Re: Stockfish 14 has been released

Post by towforce »

Madeleine Birchfield wrote: Fri Jul 02, 2021 11:36 pm
CMCanavessi wrote: Fri Jul 02, 2021 11:21 pm Hmmmm so far no good... by a mile

Stockfish 13 : 3677.0
Stockfish_14 : 3628.3
Difference : -48.7
Sample size?

144 (16 games against 9 other engines). The clue is in the "games" column in the table in the linked page. :wink:
Writing is the antidote to confusion.
It's not "how smart you are", it's "how are you smart".
Your brain doesn't work the way you want, so train it!
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Stockfish 14 has been released

Post by CMCanavessi »

Madeleine Birchfield wrote: Fri Jul 02, 2021 11:36 pm
CMCanavessi wrote: Fri Jul 02, 2021 11:21 pm Hmmmm so far no good... by a mile

Stockfish 13 : 3677.0
Stockfish_14 : 3628.3
Difference : -48.7
Sample size?
Well, it's still early, but -48.7 is HUGE already... something's "fishy"
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Stockfish 14 has been released

Post by CMCanavessi »

Well... going in the opposite direction lol

Stockfish 13 : 3677.0
Stockfish_14 : 3611.5
Difference : -65.5
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish 14 has been released

Post by Rebel »

Did SF-team made any elo gain predictions?
90% of coding is debugging, the other 10% is writing bugs.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Stockfish 14 has been released

Post by CMCanavessi »

Apparently it was tested vs. SF13 in 60.000 games and turned out as +30 elo.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
daniel71
Posts: 146
Joined: Wed Aug 27, 2008 3:48 am

Re: Stockfish 14 has been released

Post by daniel71 »

Regression test gone wrong?! Not expecting negative results for this version 14😕