Stockfish 14 has been released

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Cornfed
Posts: 511
Joined: Sun Apr 26, 2020 11:40 pm
Full name: Brian D. Smith

Re: Stockfish 14 has been released

Post by Cornfed »

Rebel wrote: Mon Jul 05, 2021 3:58 pm

Code: Select all

Running      : Match SF14 vs SF13 - using Noomen openings
Time Control : 40/120
Games        : 3498

Results from file match-sf14.pgn:

No. Name          Win Draw Loss Unf.  Score Games       %
---------------------------------------------------------
  1 Stockfish 14 +414 =2914 -170   *0 1871.0  3498   53.5%
  2 Stockfish 13 +170 =2914 -414   *0 1627.0  3498   46.5%
Match finished.

+25

Games : http://rebel13.nl/b/grl.pgn
Thanks...and thanks for the (easy) button! When I get back in today I would hope to look at the 170 lost by SF 14 and see what percentage of those were also lost by SF 13 and what may have been related to the opening itself vs SF 13 outplaying SF 14. Overall #'s are great to go by... specific subsets can be just as telling.
If there is a relatively easy way to do so.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish 14 has been released

Post by Rebel »

There is more to tell, I am currently playing SF14 in order that it faces the same opponents and openings as SF13, see: http://rebel13.nl/a/grl.htm and notice how high rated engines like SF10 and SF11 are demolished, this gives much elo.

To download those use : http://rebel13.nl/a/grl.pgn
90% of coding is debugging, the other 10% is writing bugs.
Cornfed
Posts: 511
Joined: Sun Apr 26, 2020 11:40 pm
Full name: Brian D. Smith

Re: Stockfish 14 has been released

Post by Cornfed »

Hmmm...only one game played with C05, that may make any real straight up comparison problematic.
Perhaps the book lines are just too short at time and non-guided play resulted in a transposition (?). Either way, doesn't look like this will be as easy as I had hoped....

I'll bet 'short lines' favor CF 14...just a hunch.
JohnW
Posts: 381
Joined: Thu Nov 22, 2012 12:20 am
Location: New Hampshire

Re: Stockfish 14 has been released

Post by JohnW »

mclane wrote: Sun Jul 04, 2021 9:11 pm
Werewolf wrote: Sun Jul 04, 2021 8:54 pm
mclane wrote: Sun Jul 04, 2021 8:50 pm To be honest. If there is a new Stockfish or in china a bag of rice falls down. What is the difference?!

Nobody is interested in stockfish.
This engine is as dead as fritz was under chessbase.
? It's the world leader and the best players are always downloading the latest version of it.
The world leader ?!?
It plays like an amateur against LC0.
Really, based on what? Stockfish 13 seems to be playing quite well against Lc0 on my PC.
JohnW
Posts: 381
Joined: Thu Nov 22, 2012 12:20 am
Location: New Hampshire

Re: Stockfish 14 has been released

Post by JohnW »

So where am I supposed to get the eval file that is referenced when I register the engine?

nn-3475407dc199.nnue

It's not included in the zip file..
User avatar
mclane
Posts: 18748
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: Stockfish 14 has been released

Post by mclane »

JohnW wrote: Mon Jul 05, 2021 7:12 pm
mclane wrote: Sun Jul 04, 2021 9:11 pm
Werewolf wrote: Sun Jul 04, 2021 8:54 pm
mclane wrote: Sun Jul 04, 2021 8:50 pm To be honest. If there is a new Stockfish or in china a bag of rice falls down. What is the difference?!

Nobody is interested in stockfish.
This engine is as dead as fritz was under chessbase.
? It's the world leader and the best players are always downloading the latest version of it.
The world leader ?!?
It plays like an amateur against LC0.
Really, based on what? Stockfish 13 seems to be playing quite well against Lc0 on my PC.
Its weaker then lc0.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....
User avatar
AdminX
Posts: 6339
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: Stockfish 14 has been released

Post by AdminX »

JohnW wrote: Mon Jul 05, 2021 10:21 pm So where am I supposed to get the eval file that is referenced when I register the engine?

nn-3475407dc199.nnue

It's not included in the zip file..
Built in
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
smatovic
Posts: 2644
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: Stockfish 14 has been released

Post by smatovic »

JohnW wrote: Mon Jul 05, 2021 10:21 pm So where am I supposed to get the eval file that is referenced when I register the engine?

nn-3475407dc199.nnue

It's not included in the zip file..
Nets are directly downloadable via:

https://tests.stockfishchess.org/api/nn/ + .nnue

https://tests.stockfishchess.org/api/nn ... dc199.nnue

--
Srdja
daniel71
Posts: 146
Joined: Wed Aug 27, 2008 3:48 am

Re: Stockfish 14 has been released

Post by daniel71 »

What is the verdict for SF14? Better or worse than SF 13 or was the lower rating because it doesn't handle gambits as well as SF13.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish 14 has been released

Post by Rebel »

daniel71 wrote: Tue Jul 06, 2021 4:47 am What is the verdict for SF14? Better or worse than SF 13 or was the lower rating because it doesn't handle gambits as well as SF13.
It plays a minor role IMO. I played 1100 new games in order that SF13 and SF14 more or less now played the same opponents, which gave SF14 an 8 elo increase.

Code: Select all

   # PLAYER                :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)     W     D     L  D(%)  OppAvg
   1 Stockfish 14          :  3683.5   17.1  2469.0    3100    80     100  1908  1122    70    36  3419.5
   2 Stockfish 13          :  3669.2   18.4  2660.0    3500    76      94  1915  1490    95    43  3442.2
   3 Stockfish 21-05-18    :  3651.3   24.6   841.0    1100    76     100   617   448    35    41  3415.2
   4 Stockfish 12          :  3616.2   13.5  1512.0    2200    69     100   979  1066   155    48  3457.1
   5 Komodo-Dragon         :  3583.0   16.4  1998.5    3000    67      57  1317  1363   320    45  3445.1
   6 Komodo-Dragon 2       :  3582.1   17.2  2572.0    3500    73     100  1856  1432   212    41  3387.4
   7 Lc0-v27               :  3530.7   15.9   501.0     800    63      95   307   388   105    49  3435.6
   8 Stockfish 11          :  3502.4   34.4   674.0    1100    61      88   439   470   191    43  3415.2
   9 Stockfish 10          :  3480.0   24.1   853.5    1400    61     100   563   581   256    42  3398.2
  10 Komodo 14             :  3428.7   27.3   457.0    1000    46      65   237   440   323    44  3467.0
  11 SlowChess 2.6         :  3423.7   14.0  1134.0    2400    47      99   589  1090   721    45  3450.0
There is definitely a gambit effect if you compare the elo gaps of CCRL and GRL.

Code: Select all

                              CCRL           GRL
Stockfish 13 64-bit           3506          3669
Dragon by Komodo 64-bit       3469  -37     3583  -86
SlowChess Blitz 2.6 64-bit    3379  -127    3423  -246
90% of coding is debugging, the other 10% is writing bugs.