Stockfish 12 has arrived!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: Harvey Williamson, bob, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
daniel71
Posts: 91
Joined: Wed Aug 27, 2008 1:48 am

Stockfish 12 has arrived!

Post by daniel71 » Wed Sep 02, 2020 8:54 pm

Let the testing begin!
https://abrok.eu/stockfish/

lkaufman
Posts: 4340
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Stockfish 12 has arrived!

Post by lkaufman » Wed Sep 02, 2020 9:17 pm

daniel71 wrote:
Wed Sep 02, 2020 8:54 pm
Let the testing begin!
https://abrok.eu/stockfish/
I'm getting a 2 to 1 score ratio so far (246 to 123), which is +120 elo, for SF 12 vs SF 11 under CCRL blitz conditions (2' + 1" adapted to hardware), Hert lowdraws book, one thread. Of course direct match might give a somewhat different result than playing against unrelated engines.
Komodo rules!

lkaufman
Posts: 4340
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Stockfish 12 has arrived!

Post by lkaufman » Wed Sep 02, 2020 11:15 pm

My final result (SF 12 vs 11, 1 thread, 2' + 1" adapted by CCRL rules for hardware) was 180 wins, 19 losses, 301 draws, which is +116 elo. Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
Komodo rules!

Vinvin
Posts: 4766
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Stockfish 12 has arrived!

Post by Vinvin » Wed Sep 02, 2020 11:31 pm

lkaufman wrote:
Wed Sep 02, 2020 11:15 pm
Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
I already saw this for a couple of weeks.
Probably because the moves at low depth are better with NNUE, so the tree is narrower and taller.

User avatar
Rebel
Posts: 5694
Joined: Thu Aug 18, 2011 10:04 am

Re: Stockfish 12 has arrived!

Post by Rebel » Thu Sep 03, 2020 7:34 am

Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
90% of coding is debugging, the other 10% is writing bugs.

User avatar
Laskos
Posts: 10832
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: Stockfish 12 has arrived!

Post by Laskos » Thu Sep 03, 2020 7:53 am

Rebel wrote:
Thu Sep 03, 2020 7:34 am
Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.

Raphexon
Posts: 327
Joined: Sun Mar 17, 2019 11:00 am
Full name: Henk Drost

Re: Stockfish 12 has arrived!

Post by Raphexon » Thu Sep 03, 2020 8:01 am

Vinvin wrote:
Wed Sep 02, 2020 11:31 pm
lkaufman wrote:
Wed Sep 02, 2020 11:15 pm
Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
I already saw this for a couple of weeks.
Probably because the moves at low depth are better with NNUE, so the tree is narrower and taller.
There have been a lot of pruning patches since NNUE too.
Because the NNUE eval is more reliable at low depth they can afford to cut away more of the tree.

User avatar
Rebel
Posts: 5694
Joined: Thu Aug 18, 2011 10:04 am

Re: Stockfish 12 has arrived!

Post by Rebel » Thu Sep 03, 2020 8:19 am

Laskos wrote:
Thu Sep 03, 2020 7:53 am
Rebel wrote:
Thu Sep 03, 2020 7:34 am
Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.
It's basically a programmer tool, but you can also create a reasonable reliable rating list with it.

http://rebel13.nl/misc/nice.html
90% of coding is debugging, the other 10% is writing bugs.

User avatar
Laskos
Posts: 10832
Joined: Wed Jul 26, 2006 8:21 pm
Full name: Kai Laskos

Re: Stockfish 12 has arrived!

Post by Laskos » Thu Sep 03, 2020 10:36 am

Rebel wrote:
Thu Sep 03, 2020 8:19 am
Laskos wrote:
Thu Sep 03, 2020 7:53 am
Rebel wrote:
Thu Sep 03, 2020 7:34 am
Did a quick SRL test.

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms
                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 12     341638  11:34:09.7  25383  40000  3416  400000  85.41%   1000   128    1     0
 2  Stockfish-NNUE   337741  11:34:00.9  24957  40000  3377  400000  84.44%   1000   128    1     0
 3  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 4  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 5  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 6  SlowChess 2.2    313139  10:30:56.4  21860  40000  3131  400000  78.28%   1000   128    1     0
 7  Ethereal 12.25   312493  11:30:24.1  21959  40000  3124  400000  78.12%   1000   128    1     0
 8  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 9  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
10  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
11  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
12  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
13  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
14  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0
15  Booot 6.4        305082  12:56:19.6  21267  40000  3050  400000  76.27%   1000   128    1   124
16  Defenchess 2.2   303754  10:12:00.7  21208  40000  3037  400000  75.94%   1000   128    1    41
17  Andscacs 0.95    301560  12:10:30.8  20745  40000  3015  400000  75.39%   1005   128    1    41
18  Shredder 13      300619  11:28:47.0  20946  40000  3006  400000  75.15%   1000   128    1     0
19  Wasp 4.00        299925  11:45:50.1  20727  40000  2999  400000  74.98%   1000   128    1     0
20  Senpai 2         299279  11:36:50.5  20615  40000  2992  400000  74.82%   1000   128    1    42
21  Arasan 22        298663  11:27:32.7  20460  40000  2986  400000  74.67%   1000   128    1     0
22  ice 4.0          297995  11:49:51.1  20767  40000  2980  400000  74.50%   1000   128    1     0
23  Critter 1.6      297939  11:38:55.1  20654  40000  2979  400000  74.48%   1000   128    1    22
24  Fire 7.1         296996  11:26:35.7  20356  40000  2970  400000  74.25%   1000   128    1     0
25  Vajolet 2.8      296269  11:25:51.6  20327  40000  2962  400000  74.07%   1000   128    1     0
26  Demolito 200514  295686  10:53:58.5  20429  40000  2956  400000  73.92%   1000   128    1     0
27  igel 2.50        294457  11:29:26.8  20369  40000  2944  400000  73.61%   1000   128    1     0
28  Wasp 3.75        293908  11:44:35.3  20203  40000  2939  400000  73.48%   1000   128    1     0
29  Gogobello 2.2    293824  11:44:24.1  20296  40000  2938  400000  73.46%   1000   128    1    41
30  igel 2.40        293056  11:28:38.5  20261  40000  2930  400000  73.26%   1000   128    1    41
31  Nemorino 5.00    291649  10:05:27.4  19882  40000  2916  400000  72.91%   1000   128    1    41
32  Rodent 4         291647  11:45:03.3  19774  40000  2916  400000  72.91%   1000   128    1     0
33  Winter 0.8       291596  10:02:03.0  20057  40000  2916  400000  72.90%   1000   128    1    41
34  Hannibal 1.7     291446  11:39:04.6  19985  40000  2914  400000  72.86%   1000   128    1     0
35  Combusken 1.2    291389  12:25:31.9  19902  40000  2914  400000  72.85%   1000   128    1    41
36  Texel 1.7        291164  11:27:40.3  20064  40000  2911  400000  72.79%   1000   128    1     0
37  Monolith 2       290807  11:31:27.5  19972  40000  2908  400000  72.70%   1000   128    1     0
38  Topple 0.7.5     290649  12:13:57.0  19696  40000  2906  400000  72.66%   1000   128    1     0
39  Deuterium 2019   290578  11:31:42.7  19819  40000  2905  400000  72.64%   1000   128    1     0
40  Chiron 4         290250  11:46:17.8  19978  40000  2902  400000  72.56%   1000   128    1     0
41  Godel 7.0        290222  12:52:57.9  19758  40000  2902  400000  72.56%   1000   128    1    42
42  Amoeba 3.1       289712  09:40:26.2  19682  40000  2897  400000  72.43%   1000   128    1     0
43  Minic 2.32       289394  11:01:03.5  19880  40000  2894  400000  72.35%   1000   128    1     0
44  FabChess 1.15    289296  11:50:40.2  19849  40000  2892  400000  72.32%   1000   128    1    41
45  sting-sf-21      288904  11:31:56.3  19905  40000  2889  400000  72.23%   1000   128    1     0
46  Marvin 3.60      288732  10:48:52.8  19848  40000  2887  400000  72.18%   1000   128    1    41
47  Minic 2.25       287730  10:54:48.6  19780  40000  2877  400000  71.93%   1000   128    1     0
48  Bobcat 8         287527  10:54:11.9  19486  40000  2875  400000  71.88%   1000   128    1     0
49  Invictus r305    285355  10:16:08.6  19227  40000  2853  400000  71.34%   1000   128    1     0
50  Counter 3.5      285137  11:25:20.1  19329  40000  2851  400000  71.28%   1000   128    1     0
51  Weiss 1.0        284693  11:23:14.3  19241  40000  2846  400000  71.17%   1000   128    1     0
52  Asymptote 0.8    284305  12:19:43.9  19245  40000  2843  400000  71.08%   1000   128    1    41
53  Weiss 0.10       281037  11:06:09.2  18927  40000  2810  400000  70.26%   1000   128    1     0
54  Tucano 8.0       280426  04:46:55.0  18777  40000  2804  400000  70.11%   1000   128    1     0
55  RuyDos 1.1.11    278666  10:25:44.5  18567  40000  2786  400000  69.67%   1000   128    1     0
56  Cheese 2.1       277252  11:28:33.3  18763  40000  2772  400000  69.31%   1000   128    1     0
57  GreKo 2020.03    276482  11:29:35.7  18694  40000  2764  400000  69.12%   1000   128    1     0
58  Fruit 2.3        275618  11:30:55.1  18270  40000  2756  400000  68.90%   1000   128    1     0
59  ProDeo 2.2       273793  11:29:46.3  18263  40000  2738  400000  68.45%   1000   128    1     0
60  Benjamin         271801  11:29:55.8  17985  40000  2718  400000  67.95%   1000   128    1     0
61  Fridolin 3.10    271357  11:40:42.9  18030  40000  2713  400000  67.84%   1000   128    1     0
62  Fruit 2.1        270830  11:29:45.7  17982  40000  2708  400000  67.71%   1000   128    1     0
63  Devel 3.0.0b     269433  12:22:53.0  17986  40000  2694  400000  67.36%   1000   128    1    65
64  Orion 0.6        268120  11:31:45.3  17895  40000  2681  400000  67.03%   1000   128    1    41
65  Ruffian 2        265592  11:13:01.7  17740  40000  2656  400000  66.40%   1000   128    1     0
66  Stash 18.0       253693  11:10:20.4  16848  40000  2536  400000  63.42%   1000   128    1     0
67  CT800 1.40       253449  10:45:20.4  16533  40000  2534  400000  63.36%   1000   128    1     0
68  Stash 17.0       250114  11:11:49.7  16549  40000  2501  400000  62.53%   1000   128    1     0
69  Stash 16.0       249149  11:10:56.4  16461  40000  2491  400000  62.29%   1000   128    1     0
70  Ares 005-2       243380  04:42:01.1  15937  40000  2433  400000  60.84%   1000   128    1     0
71  FoxSee 3.3.3     240244  11:08:18.3  15505  40000  2402  400000  60.06%   1000   128    1     0
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.
It's basically a programmer tool, but you can also create a reasonable reliable rating list with it.

http://rebel13.nl/misc/nice.html
Thanks, will look carefully.

Jhoravi
Posts: 274
Joined: Wed May 08, 2013 4:49 am

Re: Stockfish 12 has arrived!

Post by Jhoravi » Thu Sep 03, 2020 1:24 pm

Is Hyperthreading preferable in NNUE?

Post Reply