Why not yet a Stockfish 12 release?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Steppenwolf
Posts: 67
Joined: Thu Jan 31, 2019 3:54 pm
Full name: Sven Steppenwolf

Why not yet a Stockfish 12 release?

Post by Steppenwolf » Sat Aug 29, 2020 2:48 pm

Actually the development of SF with NNUE is coming to a preliminary end.
In the SPCC List there is no real progress at the moment.
Why to making a new official release with SF12?

User avatar
Deberger
Posts: 71
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: Why not yet a Stockfish 12 release?

Post by Deberger » Sat Aug 29, 2020 4:55 pm

There are some issues.

1) "sudo make install" needs to perform a complete install, including the NNUE file.

https://github.com/official-stockfish/S ... ssues/3030

2) The most recent changes show a slight decrease in strength

https://github.com/glinscott/fishtest/w ... sion-Tests

Jouni
Posts: 2432
Joined: Wed Mar 08, 2006 7:15 pm

Re: Why not yet a Stockfish 12 release?

Post by Jouni » Mon Aug 31, 2020 6:26 am

Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Jouni

Modern Times
Posts: 2777
Joined: Thu Jun 07, 2012 9:02 pm

Re: Why not yet a Stockfish 12 release?

Post by Modern Times » Mon Aug 31, 2020 6:56 am

Jouni wrote:
Mon Aug 31, 2020 6:26 am
Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Agreed !
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

Vinvin
Posts: 4949
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Why not yet a Stockfish 12 release?

Post by Vinvin » Mon Aug 31, 2020 9:53 am

Modern Times wrote:
Mon Aug 31, 2020 6:56 am
Jouni wrote:
Mon Aug 31, 2020 6:26 am
Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Agreed !
+1

Dann Corbit
Posts: 12169
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Why not yet a Stockfish 12 release?

Post by Dann Corbit » Mon Aug 31, 2020 4:31 pm

Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

jhellis3
Posts: 488
Joined: Fri Aug 16, 2013 10:36 pm

Re: Why not yet a Stockfish 12 release?

Post by jhellis3 » Mon Aug 31, 2020 4:40 pm

Lol. :lol:

User avatar
Guenther
Posts: 3946
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: Why not yet a Stockfish 12 release?

Post by Guenther » Mon Aug 31, 2020 5:25 pm

Dann Corbit wrote:
Mon Aug 31, 2020 4:31 pm
Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
You missread the list by quite a lot. You should compare with the 1 cpu entry.

I copied it for you until the right one ;-)

CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5%
4       Stockfish 11.0 x64 8CPU         3513    19      19      900     64.2%   3409    65.4%
5       Stockfish 11.0 x64 4CPU         3507    14      14      1600    62.8%   3410    63.0%
6       StockfiNN 0.5 x64 1CPU          3503    23      23      600     68.4%   3340    50.5%
7       Stockfish 10.0 x64 8CPU         3500    20      20      761     64.1%   3395    63.6%
8       SFNNUE 200719 (SV0722-2141)     3495    16      16      1163    68.4%   3354    59.0%
9       LCZero 0.24.1 Cuda (LS14)       3490    18      18      1036    60.5%   3411    61.1%
10      Stockfish 11.0 x64 2CPU         3489    19      19      980     61.8%   3398    63.5%
11      LCZero 0.24.1 Cuda (t40-1541)   3487    16      16      1236    58.7%   3422    65.9%
12      Stockfish 9.0 x64 8CPU          3480    25      25      541     67.9%   3345    59.3%
13      StockfiNN 0.2 x64 1CPU          3478    18      18      1008    66.5%   3351    58.8%
14      Stockfish 10.0 x64 4CPU         3473    13      13      2061    64.8%   3357    61.1%
15      LCZero 0.23.2 Cuda (t40-1541)   3464    17      17      1110    56.6%   3416    67.0%
16      LCZero 0.23.1 Cuda (LS13.0)     3460    12      12      1842    62.3%   3364    57.8%
17      Stockfish 9.0 x64 4CPU          3450    12      12      2682    65.4%   3326    57.8%
18      Fat Fritz 1.1 (in lc0) Cuda     3448    14      14      1697    53.4%   3422    67.7%
19      Stockfish 11.0 x64 1CPU         3448    12      12      2730    61.2%   3360    58.7%
https://rwbc-chess.de
'chessqueen' 2018-present, aka: 'George' 2013-2016, 'pichy' 2006-2013, 'Jorge Pichard' 2000-2006 (old forum)
Troll barometer:
https://docs.google.com/spreadsheets/d/ ... KSptBx9AUs

User avatar
Deberger
Posts: 71
Joined: Sat Nov 02, 2019 5:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: Why not yet a Stockfish 12 release?

Post by Deberger » Mon Aug 31, 2020 5:48 pm

Guenther wrote:
Mon Aug 31, 2020 5:25 pm
Dann Corbit wrote:
Mon Aug 31, 2020 4:31 pm
Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5
Maybe he meant a 50 Elo increase over LCZero. :-)

User avatar
Guenther
Posts: 3946
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: Why not yet a Stockfish 12 release?

Post by Guenther » Mon Aug 31, 2020 7:29 pm

Deberger wrote:
Mon Aug 31, 2020 5:48 pm
Guenther wrote:
Mon Aug 31, 2020 5:25 pm
Dann Corbit wrote:
Mon Aug 31, 2020 4:31 pm
Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5
Maybe he meant a 50 Elo increase over LCZero. :-)
Maybe haha. The threads in talkchess make strange meanderings in the last weeks.
Whatever, the posters before compared to SF 11...
https://rwbc-chess.de
'chessqueen' 2018-present, aka: 'George' 2013-2016, 'pichy' 2006-2013, 'Jorge Pichard' 2000-2006 (old forum)
Troll barometer:
https://docs.google.com/spreadsheets/d/ ... KSptBx9AUs

Post Reply