Why not yet a Stockfish 12 release?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Steppenwolf
Posts: 75
Joined: Thu Jan 31, 2019 4:54 pm
Full name: Sven Steppenwolf

Why not yet a Stockfish 12 release?

Post by Steppenwolf »

Actually the development of SF with NNUE is coming to a preliminary end.
In the SPCC List there is no real progress at the moment.
Why to making a new official release with SF12?
User avatar
Deberger
Posts: 91
Joined: Sat Nov 02, 2019 6:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: Why not yet a Stockfish 12 release?

Post by Deberger »

There are some issues.

1) "sudo make install" needs to perform a complete install, including the NNUE file.

https://github.com/official-stockfish/S ... ssues/3030

2) The most recent changes show a slight decrease in strength

https://github.com/glinscott/fishtest/w ... sion-Tests
Jouni
Posts: 3283
Joined: Wed Mar 08, 2006 8:15 pm

Re: Why not yet a Stockfish 12 release?

Post by Jouni »

Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Jouni
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Why not yet a Stockfish 12 release?

Post by Modern Times »

Jouni wrote: Mon Aug 31, 2020 8:26 am Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Agreed !
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Why not yet a Stockfish 12 release?

Post by Vinvin »

Modern Times wrote: Mon Aug 31, 2020 8:56 am
Jouni wrote: Mon Aug 31, 2020 8:26 am Current regression test vs SF11:

ELO: 130.37 +-1.9 (95%) LOS: 100.0%
Total: 49862 W: 20008 L: 2129 D: 27725
Ptnml(0-2): 34, 958, 8619, 11735, 3585

I think this and embedded exe is file enough for release :) !
Agreed !
+1
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Why not yet a Stockfish 12 release?

Post by Dann Corbit »

Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: Why not yet a Stockfish 12 release?

Post by jhellis3 »

Lol. :lol:
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Why not yet a Stockfish 12 release?

Post by Guenther »

Dann Corbit wrote: Mon Aug 31, 2020 6:31 pm Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
You missread the list by quite a lot. You should compare with the 1 cpu entry.

I copied it for you until the right one ;-)

CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5%
4       Stockfish 11.0 x64 8CPU         3513    19      19      900     64.2%   3409    65.4%
5       Stockfish 11.0 x64 4CPU         3507    14      14      1600    62.8%   3410    63.0%
6       StockfiNN 0.5 x64 1CPU          3503    23      23      600     68.4%   3340    50.5%
7       Stockfish 10.0 x64 8CPU         3500    20      20      761     64.1%   3395    63.6%
8       SFNNUE 200719 (SV0722-2141)     3495    16      16      1163    68.4%   3354    59.0%
9       LCZero 0.24.1 Cuda (LS14)       3490    18      18      1036    60.5%   3411    61.1%
10      Stockfish 11.0 x64 2CPU         3489    19      19      980     61.8%   3398    63.5%
11      LCZero 0.24.1 Cuda (t40-1541)   3487    16      16      1236    58.7%   3422    65.9%
12      Stockfish 9.0 x64 8CPU          3480    25      25      541     67.9%   3345    59.3%
13      StockfiNN 0.2 x64 1CPU          3478    18      18      1008    66.5%   3351    58.8%
14      Stockfish 10.0 x64 4CPU         3473    13      13      2061    64.8%   3357    61.1%
15      LCZero 0.23.2 Cuda (t40-1541)   3464    17      17      1110    56.6%   3416    67.0%
16      LCZero 0.23.1 Cuda (LS13.0)     3460    12      12      1842    62.3%   3364    57.8%
17      Stockfish 9.0 x64 4CPU          3450    12      12      2682    65.4%   3326    57.8%
18      Fat Fritz 1.1 (in lc0) Cuda     3448    14      14      1697    53.4%   3422    67.7%
19      Stockfish 11.0 x64 1CPU         3448    12      12      2730    61.2%   3360    58.7%
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
User avatar
Deberger
Posts: 91
Joined: Sat Nov 02, 2019 6:42 pm
Full name: ɹǝƃɹǝqǝᗡ ǝɔnɹꓭ

Re: Why not yet a Stockfish 12 release?

Post by Deberger »

Guenther wrote: Mon Aug 31, 2020 7:25 pm
Dann Corbit wrote: Mon Aug 31, 2020 6:31 pm Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5
Maybe he meant a 50 Elo increase over LCZero. :-)
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Why not yet a Stockfish 12 release?

Post by Guenther »

Deberger wrote: Mon Aug 31, 2020 7:48 pm
Guenther wrote: Mon Aug 31, 2020 7:25 pm
Dann Corbit wrote: Mon Aug 31, 2020 6:31 pm Maybe they are waiting for 50 Elo increase in the actual rating lists, which is still a ways off.
http://www.cegt.net/40_40%20Rating%20Li ... liste.html
They are about +20 Elo right now.
CEGT 40/20 Ratinglist

Code: Select all

no      Program                         Elo     +       -       Games   Score   Av.Op.  Draws
1       SFNNUE 200719 (SV0806-1802)     3534    19      19      1011    67.1%   3403    59.6%
2       SFNNUE 200719 (SV0731-0252)     3528    19      19      1000    66.3%   3401    54.0%
3       LCZero 0.25.1 Cuda (LS15.0)     3514    15      15      1284    61.4%   3427    66.5
Maybe he meant a 50 Elo increase over LCZero. :-)
Maybe haha. The threads in talkchess make strange meanderings in the last weeks.
Whatever, the posters before compared to SF 11...
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy