Let the testing begin!
https://abrok.eu/stockfish/
Stockfish 12 has arrived!
Moderators: hgm, Rebel, chrisw
-
lkaufman
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Stockfish 12 has arrived!
I'm getting a 2 to 1 score ratio so far (246 to 123), which is +120 elo, for SF 12 vs SF 11 under CCRL blitz conditions (2' + 1" adapted to hardware), Hert lowdraws book, one thread. Of course direct match might give a somewhat different result than playing against unrelated engines.
Komodo rules!
-
lkaufman
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Stockfish 12 has arrived!
My final result (SF 12 vs 11, 1 thread, 2' + 1" adapted by CCRL rules for hardware) was 180 wins, 19 losses, 301 draws, which is +116 elo. Curiously SF 12 actually got a slightly higher average depth (.23 ply) despite only about 76% NPS.
Komodo rules!
-
Vinvin
- Posts: 5228
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune
-
Rebel
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: Stockfish 12 has arrived!
Did a quick SRL test.
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.
Code: Select all
EPD : epd\lc1.epd
Time : 1000ms
Max Time Hash
Engine Points Used Time Found Pos Elo Score Score ms Mb Cpu Errors
1 Stockfish 12 341638 11:34:09.7 25383 40000 3416 400000 85.41% 1000 128 1 0
2 Stockfish-NNUE 337741 11:34:00.9 24957 40000 3377 400000 84.44% 1000 128 1 0
3 Stockfish 11 324287 11:30:00.8 23191 40000 3242 400000 81.07% 1000 128 1 0
4 Komodo 14 317110 11:09:21.4 22398 40000 3171 400000 79.28% 1000 128 1 0
5 Houdini 6.03 314596 11:27:54.8 22218 40000 3146 400000 78.65% 1000 128 1 0
6 SlowChess 2.2 313139 10:30:56.4 21860 40000 3131 400000 78.28% 1000 128 1 0
7 Ethereal 12.25 312493 11:30:24.1 21959 40000 3124 400000 78.12% 1000 128 1 0
8 rofChade 2.3 309642 11:24:20.2 21587 40000 3096 400000 77.41% 1000 128 1 41
9 SlowChess 2.1 309590 10:31:56.2 21595 40000 3096 400000 77.40% 1000 128 1 0
10 Ethereal 12 309088 11:30:20.9 21840 40000 3090 400000 77.27% 1000 128 1 0
11 Laser 1.7 308178 11:29:30.5 21320 40000 3081 400000 77.04% 1000 128 1 0
12 Schooner 2.2 306808 10:22:01.9 21335 40000 3068 400000 76.70% 1000 128 1 0
13 Xiphos 0.6 306796 10:03:55.9 21333 40000 3068 400000 76.70% 1000 128 1 0
14 RubiChess 1.7.2 305900 11:26:03.9 21215 40000 3059 400000 76.48% 1000 128 1 0
15 Booot 6.4 305082 12:56:19.6 21267 40000 3050 400000 76.27% 1000 128 1 124
16 Defenchess 2.2 303754 10:12:00.7 21208 40000 3037 400000 75.94% 1000 128 1 41
17 Andscacs 0.95 301560 12:10:30.8 20745 40000 3015 400000 75.39% 1005 128 1 41
18 Shredder 13 300619 11:28:47.0 20946 40000 3006 400000 75.15% 1000 128 1 0
19 Wasp 4.00 299925 11:45:50.1 20727 40000 2999 400000 74.98% 1000 128 1 0
20 Senpai 2 299279 11:36:50.5 20615 40000 2992 400000 74.82% 1000 128 1 42
21 Arasan 22 298663 11:27:32.7 20460 40000 2986 400000 74.67% 1000 128 1 0
22 ice 4.0 297995 11:49:51.1 20767 40000 2980 400000 74.50% 1000 128 1 0
23 Critter 1.6 297939 11:38:55.1 20654 40000 2979 400000 74.48% 1000 128 1 22
24 Fire 7.1 296996 11:26:35.7 20356 40000 2970 400000 74.25% 1000 128 1 0
25 Vajolet 2.8 296269 11:25:51.6 20327 40000 2962 400000 74.07% 1000 128 1 0
26 Demolito 200514 295686 10:53:58.5 20429 40000 2956 400000 73.92% 1000 128 1 0
27 igel 2.50 294457 11:29:26.8 20369 40000 2944 400000 73.61% 1000 128 1 0
28 Wasp 3.75 293908 11:44:35.3 20203 40000 2939 400000 73.48% 1000 128 1 0
29 Gogobello 2.2 293824 11:44:24.1 20296 40000 2938 400000 73.46% 1000 128 1 41
30 igel 2.40 293056 11:28:38.5 20261 40000 2930 400000 73.26% 1000 128 1 41
31 Nemorino 5.00 291649 10:05:27.4 19882 40000 2916 400000 72.91% 1000 128 1 41
32 Rodent 4 291647 11:45:03.3 19774 40000 2916 400000 72.91% 1000 128 1 0
33 Winter 0.8 291596 10:02:03.0 20057 40000 2916 400000 72.90% 1000 128 1 41
34 Hannibal 1.7 291446 11:39:04.6 19985 40000 2914 400000 72.86% 1000 128 1 0
35 Combusken 1.2 291389 12:25:31.9 19902 40000 2914 400000 72.85% 1000 128 1 41
36 Texel 1.7 291164 11:27:40.3 20064 40000 2911 400000 72.79% 1000 128 1 0
37 Monolith 2 290807 11:31:27.5 19972 40000 2908 400000 72.70% 1000 128 1 0
38 Topple 0.7.5 290649 12:13:57.0 19696 40000 2906 400000 72.66% 1000 128 1 0
39 Deuterium 2019 290578 11:31:42.7 19819 40000 2905 400000 72.64% 1000 128 1 0
40 Chiron 4 290250 11:46:17.8 19978 40000 2902 400000 72.56% 1000 128 1 0
41 Godel 7.0 290222 12:52:57.9 19758 40000 2902 400000 72.56% 1000 128 1 42
42 Amoeba 3.1 289712 09:40:26.2 19682 40000 2897 400000 72.43% 1000 128 1 0
43 Minic 2.32 289394 11:01:03.5 19880 40000 2894 400000 72.35% 1000 128 1 0
44 FabChess 1.15 289296 11:50:40.2 19849 40000 2892 400000 72.32% 1000 128 1 41
45 sting-sf-21 288904 11:31:56.3 19905 40000 2889 400000 72.23% 1000 128 1 0
46 Marvin 3.60 288732 10:48:52.8 19848 40000 2887 400000 72.18% 1000 128 1 41
47 Minic 2.25 287730 10:54:48.6 19780 40000 2877 400000 71.93% 1000 128 1 0
48 Bobcat 8 287527 10:54:11.9 19486 40000 2875 400000 71.88% 1000 128 1 0
49 Invictus r305 285355 10:16:08.6 19227 40000 2853 400000 71.34% 1000 128 1 0
50 Counter 3.5 285137 11:25:20.1 19329 40000 2851 400000 71.28% 1000 128 1 0
51 Weiss 1.0 284693 11:23:14.3 19241 40000 2846 400000 71.17% 1000 128 1 0
52 Asymptote 0.8 284305 12:19:43.9 19245 40000 2843 400000 71.08% 1000 128 1 41
53 Weiss 0.10 281037 11:06:09.2 18927 40000 2810 400000 70.26% 1000 128 1 0
54 Tucano 8.0 280426 04:46:55.0 18777 40000 2804 400000 70.11% 1000 128 1 0
55 RuyDos 1.1.11 278666 10:25:44.5 18567 40000 2786 400000 69.67% 1000 128 1 0
56 Cheese 2.1 277252 11:28:33.3 18763 40000 2772 400000 69.31% 1000 128 1 0
57 GreKo 2020.03 276482 11:29:35.7 18694 40000 2764 400000 69.12% 1000 128 1 0
58 Fruit 2.3 275618 11:30:55.1 18270 40000 2756 400000 68.90% 1000 128 1 0
59 ProDeo 2.2 273793 11:29:46.3 18263 40000 2738 400000 68.45% 1000 128 1 0
60 Benjamin 271801 11:29:55.8 17985 40000 2718 400000 67.95% 1000 128 1 0
61 Fridolin 3.10 271357 11:40:42.9 18030 40000 2713 400000 67.84% 1000 128 1 0
62 Fruit 2.1 270830 11:29:45.7 17982 40000 2708 400000 67.71% 1000 128 1 0
63 Devel 3.0.0b 269433 12:22:53.0 17986 40000 2694 400000 67.36% 1000 128 1 65
64 Orion 0.6 268120 11:31:45.3 17895 40000 2681 400000 67.03% 1000 128 1 41
65 Ruffian 2 265592 11:13:01.7 17740 40000 2656 400000 66.40% 1000 128 1 0
66 Stash 18.0 253693 11:10:20.4 16848 40000 2536 400000 63.42% 1000 128 1 0
67 CT800 1.40 253449 10:45:20.4 16533 40000 2534 400000 63.36% 1000 128 1 0
68 Stash 17.0 250114 11:11:49.7 16549 40000 2501 400000 62.53% 1000 128 1 0
69 Stash 16.0 249149 11:10:56.4 16461 40000 2491 400000 62.29% 1000 128 1 0
70 Ares 005-2 243380 04:42:01.1 15937 40000 2433 400000 60.84% 1000 128 1 0
71 FoxSee 3.3.3 240244 11:08:18.3 15505 40000 2402 400000 60.06% 1000 128 1 0
90% of coding is debugging, the other 10% is writing bugs.
-
Laskos
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Stockfish 12 has arrived!
Ed, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.Rebel wrote: ↑Thu Sep 03, 2020 9:34 am Did a quick SRL test.
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.Code: Select all
EPD : epd\lc1.epd Time : 1000ms Max Time Hash Engine Points Used Time Found Pos Elo Score Score ms Mb Cpu Errors 1 Stockfish 12 341638 11:34:09.7 25383 40000 3416 400000 85.41% 1000 128 1 0 2 Stockfish-NNUE 337741 11:34:00.9 24957 40000 3377 400000 84.44% 1000 128 1 0 3 Stockfish 11 324287 11:30:00.8 23191 40000 3242 400000 81.07% 1000 128 1 0 4 Komodo 14 317110 11:09:21.4 22398 40000 3171 400000 79.28% 1000 128 1 0 5 Houdini 6.03 314596 11:27:54.8 22218 40000 3146 400000 78.65% 1000 128 1 0 6 SlowChess 2.2 313139 10:30:56.4 21860 40000 3131 400000 78.28% 1000 128 1 0 7 Ethereal 12.25 312493 11:30:24.1 21959 40000 3124 400000 78.12% 1000 128 1 0 8 rofChade 2.3 309642 11:24:20.2 21587 40000 3096 400000 77.41% 1000 128 1 41 9 SlowChess 2.1 309590 10:31:56.2 21595 40000 3096 400000 77.40% 1000 128 1 0 10 Ethereal 12 309088 11:30:20.9 21840 40000 3090 400000 77.27% 1000 128 1 0 11 Laser 1.7 308178 11:29:30.5 21320 40000 3081 400000 77.04% 1000 128 1 0 12 Schooner 2.2 306808 10:22:01.9 21335 40000 3068 400000 76.70% 1000 128 1 0 13 Xiphos 0.6 306796 10:03:55.9 21333 40000 3068 400000 76.70% 1000 128 1 0 14 RubiChess 1.7.2 305900 11:26:03.9 21215 40000 3059 400000 76.48% 1000 128 1 0 15 Booot 6.4 305082 12:56:19.6 21267 40000 3050 400000 76.27% 1000 128 1 124 16 Defenchess 2.2 303754 10:12:00.7 21208 40000 3037 400000 75.94% 1000 128 1 41 17 Andscacs 0.95 301560 12:10:30.8 20745 40000 3015 400000 75.39% 1005 128 1 41 18 Shredder 13 300619 11:28:47.0 20946 40000 3006 400000 75.15% 1000 128 1 0 19 Wasp 4.00 299925 11:45:50.1 20727 40000 2999 400000 74.98% 1000 128 1 0 20 Senpai 2 299279 11:36:50.5 20615 40000 2992 400000 74.82% 1000 128 1 42 21 Arasan 22 298663 11:27:32.7 20460 40000 2986 400000 74.67% 1000 128 1 0 22 ice 4.0 297995 11:49:51.1 20767 40000 2980 400000 74.50% 1000 128 1 0 23 Critter 1.6 297939 11:38:55.1 20654 40000 2979 400000 74.48% 1000 128 1 22 24 Fire 7.1 296996 11:26:35.7 20356 40000 2970 400000 74.25% 1000 128 1 0 25 Vajolet 2.8 296269 11:25:51.6 20327 40000 2962 400000 74.07% 1000 128 1 0 26 Demolito 200514 295686 10:53:58.5 20429 40000 2956 400000 73.92% 1000 128 1 0 27 igel 2.50 294457 11:29:26.8 20369 40000 2944 400000 73.61% 1000 128 1 0 28 Wasp 3.75 293908 11:44:35.3 20203 40000 2939 400000 73.48% 1000 128 1 0 29 Gogobello 2.2 293824 11:44:24.1 20296 40000 2938 400000 73.46% 1000 128 1 41 30 igel 2.40 293056 11:28:38.5 20261 40000 2930 400000 73.26% 1000 128 1 41 31 Nemorino 5.00 291649 10:05:27.4 19882 40000 2916 400000 72.91% 1000 128 1 41 32 Rodent 4 291647 11:45:03.3 19774 40000 2916 400000 72.91% 1000 128 1 0 33 Winter 0.8 291596 10:02:03.0 20057 40000 2916 400000 72.90% 1000 128 1 41 34 Hannibal 1.7 291446 11:39:04.6 19985 40000 2914 400000 72.86% 1000 128 1 0 35 Combusken 1.2 291389 12:25:31.9 19902 40000 2914 400000 72.85% 1000 128 1 41 36 Texel 1.7 291164 11:27:40.3 20064 40000 2911 400000 72.79% 1000 128 1 0 37 Monolith 2 290807 11:31:27.5 19972 40000 2908 400000 72.70% 1000 128 1 0 38 Topple 0.7.5 290649 12:13:57.0 19696 40000 2906 400000 72.66% 1000 128 1 0 39 Deuterium 2019 290578 11:31:42.7 19819 40000 2905 400000 72.64% 1000 128 1 0 40 Chiron 4 290250 11:46:17.8 19978 40000 2902 400000 72.56% 1000 128 1 0 41 Godel 7.0 290222 12:52:57.9 19758 40000 2902 400000 72.56% 1000 128 1 42 42 Amoeba 3.1 289712 09:40:26.2 19682 40000 2897 400000 72.43% 1000 128 1 0 43 Minic 2.32 289394 11:01:03.5 19880 40000 2894 400000 72.35% 1000 128 1 0 44 FabChess 1.15 289296 11:50:40.2 19849 40000 2892 400000 72.32% 1000 128 1 41 45 sting-sf-21 288904 11:31:56.3 19905 40000 2889 400000 72.23% 1000 128 1 0 46 Marvin 3.60 288732 10:48:52.8 19848 40000 2887 400000 72.18% 1000 128 1 41 47 Minic 2.25 287730 10:54:48.6 19780 40000 2877 400000 71.93% 1000 128 1 0 48 Bobcat 8 287527 10:54:11.9 19486 40000 2875 400000 71.88% 1000 128 1 0 49 Invictus r305 285355 10:16:08.6 19227 40000 2853 400000 71.34% 1000 128 1 0 50 Counter 3.5 285137 11:25:20.1 19329 40000 2851 400000 71.28% 1000 128 1 0 51 Weiss 1.0 284693 11:23:14.3 19241 40000 2846 400000 71.17% 1000 128 1 0 52 Asymptote 0.8 284305 12:19:43.9 19245 40000 2843 400000 71.08% 1000 128 1 41 53 Weiss 0.10 281037 11:06:09.2 18927 40000 2810 400000 70.26% 1000 128 1 0 54 Tucano 8.0 280426 04:46:55.0 18777 40000 2804 400000 70.11% 1000 128 1 0 55 RuyDos 1.1.11 278666 10:25:44.5 18567 40000 2786 400000 69.67% 1000 128 1 0 56 Cheese 2.1 277252 11:28:33.3 18763 40000 2772 400000 69.31% 1000 128 1 0 57 GreKo 2020.03 276482 11:29:35.7 18694 40000 2764 400000 69.12% 1000 128 1 0 58 Fruit 2.3 275618 11:30:55.1 18270 40000 2756 400000 68.90% 1000 128 1 0 59 ProDeo 2.2 273793 11:29:46.3 18263 40000 2738 400000 68.45% 1000 128 1 0 60 Benjamin 271801 11:29:55.8 17985 40000 2718 400000 67.95% 1000 128 1 0 61 Fridolin 3.10 271357 11:40:42.9 18030 40000 2713 400000 67.84% 1000 128 1 0 62 Fruit 2.1 270830 11:29:45.7 17982 40000 2708 400000 67.71% 1000 128 1 0 63 Devel 3.0.0b 269433 12:22:53.0 17986 40000 2694 400000 67.36% 1000 128 1 65 64 Orion 0.6 268120 11:31:45.3 17895 40000 2681 400000 67.03% 1000 128 1 41 65 Ruffian 2 265592 11:13:01.7 17740 40000 2656 400000 66.40% 1000 128 1 0 66 Stash 18.0 253693 11:10:20.4 16848 40000 2536 400000 63.42% 1000 128 1 0 67 CT800 1.40 253449 10:45:20.4 16533 40000 2534 400000 63.36% 1000 128 1 0 68 Stash 17.0 250114 11:11:49.7 16549 40000 2501 400000 62.53% 1000 128 1 0 69 Stash 16.0 249149 11:10:56.4 16461 40000 2491 400000 62.29% 1000 128 1 0 70 Ares 005-2 243380 04:42:01.1 15937 40000 2433 400000 60.84% 1000 128 1 0 71 FoxSee 3.3.3 240244 11:08:18.3 15505 40000 2402 400000 60.06% 1000 128 1 0
-
Raphexon
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: Stockfish 12 has arrived!
There have been a lot of pruning patches since NNUE too.
Because the NNUE eval is more reliable at low depth they can afford to cut away more of the tree.
-
Rebel
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: Stockfish 12 has arrived!
It's basically a programmer tool, but you can also create a reasonable reliable rating list with it.Laskos wrote: ↑Thu Sep 03, 2020 9:53 amEd, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.Rebel wrote: ↑Thu Sep 03, 2020 9:34 am Did a quick SRL test.
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.Code: Select all
EPD : epd\lc1.epd Time : 1000ms Max Time Hash Engine Points Used Time Found Pos Elo Score Score ms Mb Cpu Errors 1 Stockfish 12 341638 11:34:09.7 25383 40000 3416 400000 85.41% 1000 128 1 0 2 Stockfish-NNUE 337741 11:34:00.9 24957 40000 3377 400000 84.44% 1000 128 1 0 3 Stockfish 11 324287 11:30:00.8 23191 40000 3242 400000 81.07% 1000 128 1 0 4 Komodo 14 317110 11:09:21.4 22398 40000 3171 400000 79.28% 1000 128 1 0 5 Houdini 6.03 314596 11:27:54.8 22218 40000 3146 400000 78.65% 1000 128 1 0 6 SlowChess 2.2 313139 10:30:56.4 21860 40000 3131 400000 78.28% 1000 128 1 0 7 Ethereal 12.25 312493 11:30:24.1 21959 40000 3124 400000 78.12% 1000 128 1 0 8 rofChade 2.3 309642 11:24:20.2 21587 40000 3096 400000 77.41% 1000 128 1 41 9 SlowChess 2.1 309590 10:31:56.2 21595 40000 3096 400000 77.40% 1000 128 1 0 10 Ethereal 12 309088 11:30:20.9 21840 40000 3090 400000 77.27% 1000 128 1 0 11 Laser 1.7 308178 11:29:30.5 21320 40000 3081 400000 77.04% 1000 128 1 0 12 Schooner 2.2 306808 10:22:01.9 21335 40000 3068 400000 76.70% 1000 128 1 0 13 Xiphos 0.6 306796 10:03:55.9 21333 40000 3068 400000 76.70% 1000 128 1 0 14 RubiChess 1.7.2 305900 11:26:03.9 21215 40000 3059 400000 76.48% 1000 128 1 0 15 Booot 6.4 305082 12:56:19.6 21267 40000 3050 400000 76.27% 1000 128 1 124 16 Defenchess 2.2 303754 10:12:00.7 21208 40000 3037 400000 75.94% 1000 128 1 41 17 Andscacs 0.95 301560 12:10:30.8 20745 40000 3015 400000 75.39% 1005 128 1 41 18 Shredder 13 300619 11:28:47.0 20946 40000 3006 400000 75.15% 1000 128 1 0 19 Wasp 4.00 299925 11:45:50.1 20727 40000 2999 400000 74.98% 1000 128 1 0 20 Senpai 2 299279 11:36:50.5 20615 40000 2992 400000 74.82% 1000 128 1 42 21 Arasan 22 298663 11:27:32.7 20460 40000 2986 400000 74.67% 1000 128 1 0 22 ice 4.0 297995 11:49:51.1 20767 40000 2980 400000 74.50% 1000 128 1 0 23 Critter 1.6 297939 11:38:55.1 20654 40000 2979 400000 74.48% 1000 128 1 22 24 Fire 7.1 296996 11:26:35.7 20356 40000 2970 400000 74.25% 1000 128 1 0 25 Vajolet 2.8 296269 11:25:51.6 20327 40000 2962 400000 74.07% 1000 128 1 0 26 Demolito 200514 295686 10:53:58.5 20429 40000 2956 400000 73.92% 1000 128 1 0 27 igel 2.50 294457 11:29:26.8 20369 40000 2944 400000 73.61% 1000 128 1 0 28 Wasp 3.75 293908 11:44:35.3 20203 40000 2939 400000 73.48% 1000 128 1 0 29 Gogobello 2.2 293824 11:44:24.1 20296 40000 2938 400000 73.46% 1000 128 1 41 30 igel 2.40 293056 11:28:38.5 20261 40000 2930 400000 73.26% 1000 128 1 41 31 Nemorino 5.00 291649 10:05:27.4 19882 40000 2916 400000 72.91% 1000 128 1 41 32 Rodent 4 291647 11:45:03.3 19774 40000 2916 400000 72.91% 1000 128 1 0 33 Winter 0.8 291596 10:02:03.0 20057 40000 2916 400000 72.90% 1000 128 1 41 34 Hannibal 1.7 291446 11:39:04.6 19985 40000 2914 400000 72.86% 1000 128 1 0 35 Combusken 1.2 291389 12:25:31.9 19902 40000 2914 400000 72.85% 1000 128 1 41 36 Texel 1.7 291164 11:27:40.3 20064 40000 2911 400000 72.79% 1000 128 1 0 37 Monolith 2 290807 11:31:27.5 19972 40000 2908 400000 72.70% 1000 128 1 0 38 Topple 0.7.5 290649 12:13:57.0 19696 40000 2906 400000 72.66% 1000 128 1 0 39 Deuterium 2019 290578 11:31:42.7 19819 40000 2905 400000 72.64% 1000 128 1 0 40 Chiron 4 290250 11:46:17.8 19978 40000 2902 400000 72.56% 1000 128 1 0 41 Godel 7.0 290222 12:52:57.9 19758 40000 2902 400000 72.56% 1000 128 1 42 42 Amoeba 3.1 289712 09:40:26.2 19682 40000 2897 400000 72.43% 1000 128 1 0 43 Minic 2.32 289394 11:01:03.5 19880 40000 2894 400000 72.35% 1000 128 1 0 44 FabChess 1.15 289296 11:50:40.2 19849 40000 2892 400000 72.32% 1000 128 1 41 45 sting-sf-21 288904 11:31:56.3 19905 40000 2889 400000 72.23% 1000 128 1 0 46 Marvin 3.60 288732 10:48:52.8 19848 40000 2887 400000 72.18% 1000 128 1 41 47 Minic 2.25 287730 10:54:48.6 19780 40000 2877 400000 71.93% 1000 128 1 0 48 Bobcat 8 287527 10:54:11.9 19486 40000 2875 400000 71.88% 1000 128 1 0 49 Invictus r305 285355 10:16:08.6 19227 40000 2853 400000 71.34% 1000 128 1 0 50 Counter 3.5 285137 11:25:20.1 19329 40000 2851 400000 71.28% 1000 128 1 0 51 Weiss 1.0 284693 11:23:14.3 19241 40000 2846 400000 71.17% 1000 128 1 0 52 Asymptote 0.8 284305 12:19:43.9 19245 40000 2843 400000 71.08% 1000 128 1 41 53 Weiss 0.10 281037 11:06:09.2 18927 40000 2810 400000 70.26% 1000 128 1 0 54 Tucano 8.0 280426 04:46:55.0 18777 40000 2804 400000 70.11% 1000 128 1 0 55 RuyDos 1.1.11 278666 10:25:44.5 18567 40000 2786 400000 69.67% 1000 128 1 0 56 Cheese 2.1 277252 11:28:33.3 18763 40000 2772 400000 69.31% 1000 128 1 0 57 GreKo 2020.03 276482 11:29:35.7 18694 40000 2764 400000 69.12% 1000 128 1 0 58 Fruit 2.3 275618 11:30:55.1 18270 40000 2756 400000 68.90% 1000 128 1 0 59 ProDeo 2.2 273793 11:29:46.3 18263 40000 2738 400000 68.45% 1000 128 1 0 60 Benjamin 271801 11:29:55.8 17985 40000 2718 400000 67.95% 1000 128 1 0 61 Fridolin 3.10 271357 11:40:42.9 18030 40000 2713 400000 67.84% 1000 128 1 0 62 Fruit 2.1 270830 11:29:45.7 17982 40000 2708 400000 67.71% 1000 128 1 0 63 Devel 3.0.0b 269433 12:22:53.0 17986 40000 2694 400000 67.36% 1000 128 1 65 64 Orion 0.6 268120 11:31:45.3 17895 40000 2681 400000 67.03% 1000 128 1 41 65 Ruffian 2 265592 11:13:01.7 17740 40000 2656 400000 66.40% 1000 128 1 0 66 Stash 18.0 253693 11:10:20.4 16848 40000 2536 400000 63.42% 1000 128 1 0 67 CT800 1.40 253449 10:45:20.4 16533 40000 2534 400000 63.36% 1000 128 1 0 68 Stash 17.0 250114 11:11:49.7 16549 40000 2501 400000 62.53% 1000 128 1 0 69 Stash 16.0 249149 11:10:56.4 16461 40000 2491 400000 62.29% 1000 128 1 0 70 Ares 005-2 243380 04:42:01.1 15937 40000 2433 400000 60.84% 1000 128 1 0 71 FoxSee 3.3.3 240244 11:08:18.3 15505 40000 2402 400000 60.06% 1000 128 1 0
http://rebel13.nl/misc/nice.html
90% of coding is debugging, the other 10% is writing bugs.
-
Laskos
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Stockfish 12 has arrived!
Thanks, will look carefully.Rebel wrote: ↑Thu Sep 03, 2020 10:19 amIt's basically a programmer tool, but you can also create a reasonable reliable rating list with it.Laskos wrote: ↑Thu Sep 03, 2020 9:53 amEd, great tool. Does this lc1.epd contain 40,000 test positions? Where I can find it? How the points are given? You have a testing tool to award points? I think I missed a thread where this was discussed, right? Thanks.Rebel wrote: ↑Thu Sep 03, 2020 9:34 am Did a quick SRL test.
The Stockfish-NNUE version is from my website with Sergio net, seems SF added a lot of elo in a very short time.Code: Select all
EPD : epd\lc1.epd Time : 1000ms Max Time Hash Engine Points Used Time Found Pos Elo Score Score ms Mb Cpu Errors 1 Stockfish 12 341638 11:34:09.7 25383 40000 3416 400000 85.41% 1000 128 1 0 2 Stockfish-NNUE 337741 11:34:00.9 24957 40000 3377 400000 84.44% 1000 128 1 0 3 Stockfish 11 324287 11:30:00.8 23191 40000 3242 400000 81.07% 1000 128 1 0 4 Komodo 14 317110 11:09:21.4 22398 40000 3171 400000 79.28% 1000 128 1 0 5 Houdini 6.03 314596 11:27:54.8 22218 40000 3146 400000 78.65% 1000 128 1 0 6 SlowChess 2.2 313139 10:30:56.4 21860 40000 3131 400000 78.28% 1000 128 1 0 7 Ethereal 12.25 312493 11:30:24.1 21959 40000 3124 400000 78.12% 1000 128 1 0 8 rofChade 2.3 309642 11:24:20.2 21587 40000 3096 400000 77.41% 1000 128 1 41 9 SlowChess 2.1 309590 10:31:56.2 21595 40000 3096 400000 77.40% 1000 128 1 0 10 Ethereal 12 309088 11:30:20.9 21840 40000 3090 400000 77.27% 1000 128 1 0 11 Laser 1.7 308178 11:29:30.5 21320 40000 3081 400000 77.04% 1000 128 1 0 12 Schooner 2.2 306808 10:22:01.9 21335 40000 3068 400000 76.70% 1000 128 1 0 13 Xiphos 0.6 306796 10:03:55.9 21333 40000 3068 400000 76.70% 1000 128 1 0 14 RubiChess 1.7.2 305900 11:26:03.9 21215 40000 3059 400000 76.48% 1000 128 1 0 15 Booot 6.4 305082 12:56:19.6 21267 40000 3050 400000 76.27% 1000 128 1 124 16 Defenchess 2.2 303754 10:12:00.7 21208 40000 3037 400000 75.94% 1000 128 1 41 17 Andscacs 0.95 301560 12:10:30.8 20745 40000 3015 400000 75.39% 1005 128 1 41 18 Shredder 13 300619 11:28:47.0 20946 40000 3006 400000 75.15% 1000 128 1 0 19 Wasp 4.00 299925 11:45:50.1 20727 40000 2999 400000 74.98% 1000 128 1 0 20 Senpai 2 299279 11:36:50.5 20615 40000 2992 400000 74.82% 1000 128 1 42 21 Arasan 22 298663 11:27:32.7 20460 40000 2986 400000 74.67% 1000 128 1 0 22 ice 4.0 297995 11:49:51.1 20767 40000 2980 400000 74.50% 1000 128 1 0 23 Critter 1.6 297939 11:38:55.1 20654 40000 2979 400000 74.48% 1000 128 1 22 24 Fire 7.1 296996 11:26:35.7 20356 40000 2970 400000 74.25% 1000 128 1 0 25 Vajolet 2.8 296269 11:25:51.6 20327 40000 2962 400000 74.07% 1000 128 1 0 26 Demolito 200514 295686 10:53:58.5 20429 40000 2956 400000 73.92% 1000 128 1 0 27 igel 2.50 294457 11:29:26.8 20369 40000 2944 400000 73.61% 1000 128 1 0 28 Wasp 3.75 293908 11:44:35.3 20203 40000 2939 400000 73.48% 1000 128 1 0 29 Gogobello 2.2 293824 11:44:24.1 20296 40000 2938 400000 73.46% 1000 128 1 41 30 igel 2.40 293056 11:28:38.5 20261 40000 2930 400000 73.26% 1000 128 1 41 31 Nemorino 5.00 291649 10:05:27.4 19882 40000 2916 400000 72.91% 1000 128 1 41 32 Rodent 4 291647 11:45:03.3 19774 40000 2916 400000 72.91% 1000 128 1 0 33 Winter 0.8 291596 10:02:03.0 20057 40000 2916 400000 72.90% 1000 128 1 41 34 Hannibal 1.7 291446 11:39:04.6 19985 40000 2914 400000 72.86% 1000 128 1 0 35 Combusken 1.2 291389 12:25:31.9 19902 40000 2914 400000 72.85% 1000 128 1 41 36 Texel 1.7 291164 11:27:40.3 20064 40000 2911 400000 72.79% 1000 128 1 0 37 Monolith 2 290807 11:31:27.5 19972 40000 2908 400000 72.70% 1000 128 1 0 38 Topple 0.7.5 290649 12:13:57.0 19696 40000 2906 400000 72.66% 1000 128 1 0 39 Deuterium 2019 290578 11:31:42.7 19819 40000 2905 400000 72.64% 1000 128 1 0 40 Chiron 4 290250 11:46:17.8 19978 40000 2902 400000 72.56% 1000 128 1 0 41 Godel 7.0 290222 12:52:57.9 19758 40000 2902 400000 72.56% 1000 128 1 42 42 Amoeba 3.1 289712 09:40:26.2 19682 40000 2897 400000 72.43% 1000 128 1 0 43 Minic 2.32 289394 11:01:03.5 19880 40000 2894 400000 72.35% 1000 128 1 0 44 FabChess 1.15 289296 11:50:40.2 19849 40000 2892 400000 72.32% 1000 128 1 41 45 sting-sf-21 288904 11:31:56.3 19905 40000 2889 400000 72.23% 1000 128 1 0 46 Marvin 3.60 288732 10:48:52.8 19848 40000 2887 400000 72.18% 1000 128 1 41 47 Minic 2.25 287730 10:54:48.6 19780 40000 2877 400000 71.93% 1000 128 1 0 48 Bobcat 8 287527 10:54:11.9 19486 40000 2875 400000 71.88% 1000 128 1 0 49 Invictus r305 285355 10:16:08.6 19227 40000 2853 400000 71.34% 1000 128 1 0 50 Counter 3.5 285137 11:25:20.1 19329 40000 2851 400000 71.28% 1000 128 1 0 51 Weiss 1.0 284693 11:23:14.3 19241 40000 2846 400000 71.17% 1000 128 1 0 52 Asymptote 0.8 284305 12:19:43.9 19245 40000 2843 400000 71.08% 1000 128 1 41 53 Weiss 0.10 281037 11:06:09.2 18927 40000 2810 400000 70.26% 1000 128 1 0 54 Tucano 8.0 280426 04:46:55.0 18777 40000 2804 400000 70.11% 1000 128 1 0 55 RuyDos 1.1.11 278666 10:25:44.5 18567 40000 2786 400000 69.67% 1000 128 1 0 56 Cheese 2.1 277252 11:28:33.3 18763 40000 2772 400000 69.31% 1000 128 1 0 57 GreKo 2020.03 276482 11:29:35.7 18694 40000 2764 400000 69.12% 1000 128 1 0 58 Fruit 2.3 275618 11:30:55.1 18270 40000 2756 400000 68.90% 1000 128 1 0 59 ProDeo 2.2 273793 11:29:46.3 18263 40000 2738 400000 68.45% 1000 128 1 0 60 Benjamin 271801 11:29:55.8 17985 40000 2718 400000 67.95% 1000 128 1 0 61 Fridolin 3.10 271357 11:40:42.9 18030 40000 2713 400000 67.84% 1000 128 1 0 62 Fruit 2.1 270830 11:29:45.7 17982 40000 2708 400000 67.71% 1000 128 1 0 63 Devel 3.0.0b 269433 12:22:53.0 17986 40000 2694 400000 67.36% 1000 128 1 65 64 Orion 0.6 268120 11:31:45.3 17895 40000 2681 400000 67.03% 1000 128 1 41 65 Ruffian 2 265592 11:13:01.7 17740 40000 2656 400000 66.40% 1000 128 1 0 66 Stash 18.0 253693 11:10:20.4 16848 40000 2536 400000 63.42% 1000 128 1 0 67 CT800 1.40 253449 10:45:20.4 16533 40000 2534 400000 63.36% 1000 128 1 0 68 Stash 17.0 250114 11:11:49.7 16549 40000 2501 400000 62.53% 1000 128 1 0 69 Stash 16.0 249149 11:10:56.4 16461 40000 2491 400000 62.29% 1000 128 1 0 70 Ares 005-2 243380 04:42:01.1 15937 40000 2433 400000 60.84% 1000 128 1 0 71 FoxSee 3.3.3 240244 11:08:18.3 15505 40000 2402 400000 60.06% 1000 128 1 0
http://rebel13.nl/misc/nice.html
-
Jhoravi
- Posts: 291
- Joined: Wed May 08, 2013 6:49 am
Re: Stockfish 12 has arrived!
Is Hyperthreading preferable in NNUE?