Dear Tom,
Firstly, once again, thank you.
Stockfish 221214 MZ is 3209 ELO and Stockfish 030115 IPMAN is 3311. Then it should be 102 (!!) ELO higher, am I right?
Best regards,
Koh, Kah Huat
Testing Stockfish 11-03-13. 480 Games.
Moderator: Ras
-
- Posts: 240
- Joined: Wed Sep 19, 2007 11:07 am
- Location: Singapore
-
- Posts: 5298
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune
Re: Testing Stockfish 11-03-13. 480 Games.
The reference rating changed by -100 points in the meantime.Kohflote wrote:Dear Tom,
Firstly, once again, thank you.
Stockfish 221214 MZ is 3209 ELO and Stockfish 030115 IPMAN is 3311. Then it should be 102 (!!) ELO higher, am I right?
Best regards,
Koh, Kah Huat
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
Hello, Koh, Kah Huat.Vinvin wrote:The reference rating changed by -100 points in the meantime.Kohflote wrote:Dear Tom,
Firstly, once again, thank you.
Stockfish 221214 MZ is 3209 ELO and Stockfish 030115 IPMAN is 3311. Then it should be 102 (!!) ELO higher, am I right?
Best regards,
Koh, Kah Huat
Thanks to you for following my tests. The reason is exactly what Vincent has commented in his previous post.
(Thanks, Vincent, for clarifying it!)

Regards,
Tom.
-
- Posts: 1537
- Joined: Sun Oct 25, 2009 2:30 am
Re: Testing Stockfish 11-03-13. 480 Games.
Guess that means Vincent follows your tests more closely.Tomcass wrote:Hello, Koh, Kah Huat.Vinvin wrote:The reference rating changed by -100 points in the meantime.Kohflote wrote:Dear Tom,
Firstly, once again, thank you.
Stockfish 221214 MZ is 3209 ELO and Stockfish 030115 IPMAN is 3311. Then it should be 102 (!!) ELO higher, am I right?
Best regards,
Koh, Kah Huat
Thanks to you for following my tests. The reason is exactly what Vincent has commented in his previous post.
(Thanks, Vincent, for clarifying it!)
Regards,
Tom.

-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH 010115MZ : 2nd and 3rd Tests Games 481 to 1440.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF010115MZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 42.0 - 38.0 +11/=62/-7 52.50%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 46.5 - 33.5 +20/=53/-7 58.13%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 52.5 - 27.5 +29/=47/-4 65.63%
Time Control= 2+2
SF010115MZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 46.5 - 33.5 +20/=53/-7 58.13%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 45.0 - 35.0 +21/=48/-11 56.25%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 56.5 - 23.5 +35/=43/-2 70.63%
Score using 6 cores: 289.0 – 191.0= 60.21%
480 Games =
http://www.mediafire.com/download/gc...d_3rd_Test.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF010115MZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 47.0 - 33.0 +23/=48/-9 58.75%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 52.0 - 28.0 +31/=42/-7 65.00%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 47.5 - 32.5 +27/=41/-12 59.38%
Time Control= 2+2
SF010115MZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 45.5 - 34.5 +22/=47/-11 56.88%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 45.5 - 34.5 +18/=55/-7 56.88%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 56.5 - 23.5 +35/=43/-2 70.63%
Score using 4 cores: 294.0 – 186.0= 91.0= 61.25%
480 Games:
http://www.mediafire.com/download/m2...d_3rd_test.pgn
Segmenting by Time Control:
Fixed TC = 287.5 – 192.5= 59.90%
Incremental TC = 295.5 – 184.5= 61.56%
GLOBAL SCORE: 583.0 – 377.5= 60.73%
Against : Houdini 4.0 St. Ct0 (3136) = 56.56% ; Komodo 8 (3153) = 59.06%, Gull 3 XP (3103) = 66.57%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
Error bars= +/- 23 EEP
………………………………………...............
SUMMARY OF TESTS 1, 2 AND 3 FOR STOCKFISH 010115MZ AFTER 1440 GAMES.
GLOBAL SCORE: 875.5 – 564.5= 60.80%
Against : Houdini 4.0 St. Ct0 (3136) =57.81% ; Komodo 8 (3153) = 58.44%, Gull 3 XP (3103) = 66.15%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3207
Error bars= +/- 13 EEP
This score is very similar to the best SFMZ compile so far: SF221214MZ, 3209.
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF010115MZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 42.0 - 38.0 +11/=62/-7 52.50%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 46.5 - 33.5 +20/=53/-7 58.13%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 52.5 - 27.5 +29/=47/-4 65.63%
Time Control= 2+2
SF010115MZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 46.5 - 33.5 +20/=53/-7 58.13%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 45.0 - 35.0 +21/=48/-11 56.25%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 56.5 - 23.5 +35/=43/-2 70.63%
Score using 6 cores: 289.0 – 191.0= 60.21%
480 Games =
http://www.mediafire.com/download/gc...d_3rd_Test.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF010115MZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 47.0 - 33.0 +23/=48/-9 58.75%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 52.0 - 28.0 +31/=42/-7 65.00%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 47.5 - 32.5 +27/=41/-12 59.38%
Time Control= 2+2
SF010115MZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 45.5 - 34.5 +22/=47/-11 56.88%
SF010115MZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 45.5 - 34.5 +18/=55/-7 56.88%
SF010115MZ x64 POPCNT_ - Gull 3 x64 XP 56.5 - 23.5 +35/=43/-2 70.63%
Score using 4 cores: 294.0 – 186.0= 91.0= 61.25%
480 Games:
http://www.mediafire.com/download/m2...d_3rd_test.pgn
Segmenting by Time Control:
Fixed TC = 287.5 – 192.5= 59.90%
Incremental TC = 295.5 – 184.5= 61.56%
GLOBAL SCORE: 583.0 – 377.5= 60.73%
Against : Houdini 4.0 St. Ct0 (3136) = 56.56% ; Komodo 8 (3153) = 59.06%, Gull 3 XP (3103) = 66.57%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
Error bars= +/- 23 EEP
………………………………………...............
SUMMARY OF TESTS 1, 2 AND 3 FOR STOCKFISH 010115MZ AFTER 1440 GAMES.
GLOBAL SCORE: 875.5 – 564.5= 60.80%
Against : Houdini 4.0 St. Ct0 (3136) =57.81% ; Komodo 8 (3153) = 58.44%, Gull 3 XP (3103) = 66.15%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3207
Error bars= +/- 13 EEP
This score is very similar to the best SFMZ compile so far: SF221214MZ, 3209.
Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH 090115 IPMAN: 1440 Games
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090115IPx 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +32/=77/-11 58.75%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_6_NOB 64.0 - 56.0 +25/=78/-17 53.33%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 77.0 - 43.0 +44/=66/-10 64.17%
Time Control= 2+2
SF 090115IPx 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +30/=81/-9 58.75%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_6_NOB 69.5 - 50.5 +26/=87/-7 57.92%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 76.0 - 44.0 +43/=66/-11 63.33%
Score using 6 cores: 427.5 – 292.5 = 59.37%
720 games=
http://www.mediafire.com/download/2m...ests_1_2_3.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090115IPx 64 POPCNT_ - Houdini 4 Pro x64-A_OK 81.0 - 39.0 +49/=64/-7 67.50%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_4_NOB 72.0 - 48.0 +34/=76/-10 60.00%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 84.0 - 36.0 +57/=54/-9 70.00%
Time Control= 2+2
SF 090115IPx 64 POPCNT_ - Houdini 4 Pro x64-A_OK 72.0 - 48.0 +36/=72/-12 60.00%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_4_NOB 69.5 - 50.5 +34/=71/-15 57.92%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 80.5 - 39.5 +52/=57/-11 67.08%
Score using 4 cores: 459.0 – 261.0 = 63.75%
720 games=
http://www.mediafire.com/download/4k...Test_1_2_3.pgn
Segmenting by Time Control:
Fixed TC = 448.5 – 271.5= 62.29%
Incremental TC = 438.0 – 282.0= 60.83%
Global Score: 886.5 – 553.5 = 61.56%
Against : Houdini 4.0 St. Ct0 (3136) = 61.25% ; Komodo 8 (3153) = 57.29%, Gull 3 XP (3103) = 66.14%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3212
Although only by ONE Elo point over the previous leader STOCKFISH 030115 IPMAN (3211), this is a new best score ever in my tests.
Error bars= +/- 13 EEP
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090115IPx 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +32/=77/-11 58.75%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_6_NOB 64.0 - 56.0 +25/=78/-17 53.33%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 77.0 - 43.0 +44/=66/-10 64.17%
Time Control= 2+2
SF 090115IPx 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +30/=81/-9 58.75%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_6_NOB 69.5 - 50.5 +26/=87/-7 57.92%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 76.0 - 44.0 +43/=66/-11 63.33%
Score using 6 cores: 427.5 – 292.5 = 59.37%
720 games=
http://www.mediafire.com/download/2m...ests_1_2_3.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090115IPx 64 POPCNT_ - Houdini 4 Pro x64-A_OK 81.0 - 39.0 +49/=64/-7 67.50%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_4_NOB 72.0 - 48.0 +34/=76/-10 60.00%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 84.0 - 36.0 +57/=54/-9 70.00%
Time Control= 2+2
SF 090115IPx 64 POPCNT_ - Houdini 4 Pro x64-A_OK 72.0 - 48.0 +36/=72/-12 60.00%
SF 090115IPx 64 POPCNT_ - Komodo 8 64-bit_4_NOB 69.5 - 50.5 +34/=71/-15 57.92%
SF 090115IPx 64 POPCNT_ - Gull 3 x64 XP 80.5 - 39.5 +52/=57/-11 67.08%
Score using 4 cores: 459.0 – 261.0 = 63.75%
720 games=
http://www.mediafire.com/download/4k...Test_1_2_3.pgn
Segmenting by Time Control:
Fixed TC = 448.5 – 271.5= 62.29%
Incremental TC = 438.0 – 282.0= 60.83%
Global Score: 886.5 – 553.5 = 61.56%
Against : Houdini 4.0 St. Ct0 (3136) = 61.25% ; Komodo 8 (3153) = 57.29%, Gull 3 XP (3103) = 66.14%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3212
Although only by ONE Elo point over the previous leader STOCKFISH 030115 IPMAN (3211), this is a new best score ever in my tests.
Error bars= +/- 13 EEP
Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING Stockfish 6 Release Candidate 1 : 1440 Games Part 1: Games 1 to 720.
Timestamp: 1421592791 Bench: 8080602
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +24/=86/-10 55.83%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 74.0 - 46.0 +38/=72/-10 61.67%
360 Games:
http://www.mediafire.com/download/l9...0Games_4_0.pgn
Score using 6 cores: 210.0 – 150.0= 58.33%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 75.5 - 44.5 +40/=71/-9 62.92%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 70.5 - 49.5 +33/=75/-12 58.75%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +47/=68/-5 67.50%
360 Games:
http://www.mediafire.com/download/bf...0games_4_0.pgn
Score using 4 cores: 227.0 – 133.0 = 63.06%
GLOBAL SCORE AFTER 720 GAMES: 437.0 – 283.0 = 60.69%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
Only as a reference, we can compare SF6 RC1 with Stockfish Development 170115. I tested this Development Version at 4+0 Time control but not at 2+2 Time Control, since I gave priority to Stockfish 6 Release Candidate 1 :
201501Stockfish_Dev170115_4+0_ 2015
Stockfish 170115 64 POPCNTx - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +32/=77/-11 58.75%
Stockfish 170115 64 POPCNTx - Komodo 8 64-bit_6_NOB 73.0 - 47.0 +37/=72/-11 60.83%
Stockfish 170115 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +46/=70/-4 67.50%
Score using 6 cores: 224.5 – 135.5= 62.36%
201501_SF_Dev_170115_4+0 2015
Stockfish 170115 64 POPCNTx - Houdini 4 Pro x64-A_OK 70.0 - 50.0 +36/=68/-16 58.33%
Stockfish 170115 64 POPCNTx - Komodo 8 64-bit_4_NOB 60.0 - 60.0 +24/=72/-24 50.00%
Stockfish 170115 64 POPCNTx - Gull 3 x64 XP 83.5 - 36.5 +53/=61/-6 69.58%
Score using 4 cores: 213,5 – 146.5
GLOBAL SCORE AFTER 720 GAMES: 438.0 – 282.0 = 60.83%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3207
Let’s wait for the second leg of my test, games 721 to 1440 at 2min + 2 sec. time control to compare this Candidate with the top scorers and with Stockfish 5.
Regards,
Tom.
Timestamp: 1421592791 Bench: 8080602
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +24/=86/-10 55.83%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 74.0 - 46.0 +38/=72/-10 61.67%
360 Games:
http://www.mediafire.com/download/l9...0Games_4_0.pgn
Score using 6 cores: 210.0 – 150.0= 58.33%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 75.5 - 44.5 +40/=71/-9 62.92%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 70.5 - 49.5 +33/=75/-12 58.75%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +47/=68/-5 67.50%
360 Games:
http://www.mediafire.com/download/bf...0games_4_0.pgn
Score using 4 cores: 227.0 – 133.0 = 63.06%
GLOBAL SCORE AFTER 720 GAMES: 437.0 – 283.0 = 60.69%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
Only as a reference, we can compare SF6 RC1 with Stockfish Development 170115. I tested this Development Version at 4+0 Time control but not at 2+2 Time Control, since I gave priority to Stockfish 6 Release Candidate 1 :
201501Stockfish_Dev170115_4+0_ 2015
Stockfish 170115 64 POPCNTx - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +32/=77/-11 58.75%
Stockfish 170115 64 POPCNTx - Komodo 8 64-bit_6_NOB 73.0 - 47.0 +37/=72/-11 60.83%
Stockfish 170115 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +46/=70/-4 67.50%
Score using 6 cores: 224.5 – 135.5= 62.36%
201501_SF_Dev_170115_4+0 2015
Stockfish 170115 64 POPCNTx - Houdini 4 Pro x64-A_OK 70.0 - 50.0 +36/=68/-16 58.33%
Stockfish 170115 64 POPCNTx - Komodo 8 64-bit_4_NOB 60.0 - 60.0 +24/=72/-24 50.00%
Stockfish 170115 64 POPCNTx - Gull 3 x64 XP 83.5 - 36.5 +53/=61/-6 69.58%
Score using 4 cores: 213,5 – 146.5
GLOBAL SCORE AFTER 720 GAMES: 438.0 – 282.0 = 60.83%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3207
Let’s wait for the second leg of my test, games 721 to 1440 at 2min + 2 sec. time control to compare this Candidate with the top scorers and with Stockfish 5.
Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING Stockfish 6 Release Candidate 1 : 1440 Games
Timestamp: 1421592791 Bench: 8080602
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +24/=86/-10 55.83%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 74.0 - 46.0 +38/=72/-10 61.67%
360 Games:
http://www.mediafire.com/download/l970c ... es_4_0.pgn
Time Control 2+2
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 71.0 - 49.0 +32/=78/-10 59.17%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 65.5 - 54.5 +26/=79/-15 54.58%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 78.0 - 42.0 +43/=70/-7 65.00%
360 games:
http://www.mediafire.com/download/up1fq ... es_2_2.pgn
Score using 6 cores: 424.5 – 295.5= 58.96%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 75.5 - 44.5 +40/=71/-9 62.92%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 70.5 - 49.5 +33/=75/-12 58.75%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +47/=68/-5 67.50%
360 Games:
http://www.mediafire.com/download/bf7s1 ... es_4_0.pgn
Time Control 2+2
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 71.5 - 48.5 +35/=73/-12 59.58%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 68.5 - 51.5 +36/=65/-19 57.08%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 79.5 - 40.5 +43/=73/-4 66.25%
360 Games:
http://www.mediafire.com/download/ocjf8 ... es_2_2.pgn
Score using 4 cores: 446.5 – 273.5= 62.01%
Segmenting by Time Control:
Fixed TC = 437.0 – 283.0 = 60.69%
Incremental TC = 434.0 – 286.0 = 60.28%
Global Score: 871.0 – 569.0 = 60.49%
Against : Houdini 4.0 St. Ct0 (3136) = 59.79% ; Komodo 8 (3153) = 56.56%, Gull 3 XP (3103) = 65.11%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3204
After 1440 games -IMHO- I think that this is a good but not an excellent candidate for SF 6. 8 Elo points below the top scorer in my tests STOCKFISH 090115 IPMAN (3212).
As a reference:
3 ELO below Stockfish_Dev 170115 (3207)
32 ELO above Stockfish 5 (3172)
51 ELO above Komodo 8 (3153)
68 ELO above Houdini 4 (3136)
If possible, let’s wait for other a bit stronger SF Release Candidates.
Regards,
Tom.
Timestamp: 1421592791 Bench: 8080602
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +24/=86/-10 55.83%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 74.0 - 46.0 +38/=72/-10 61.67%
360 Games:
http://www.mediafire.com/download/l970c ... es_4_0.pgn
Time Control 2+2
Stockfish 6 RC1 64 POPCNTx - Houdini 4 x64_st_X6_CT0 71.0 - 49.0 +32/=78/-10 59.17%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_6_NOB 65.5 - 54.5 +26/=79/-15 54.58%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 78.0 - 42.0 +43/=70/-7 65.00%
360 games:
http://www.mediafire.com/download/up1fq ... es_2_2.pgn
Score using 6 cores: 424.5 – 295.5= 58.96%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 75.5 - 44.5 +40/=71/-9 62.92%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 70.5 - 49.5 +33/=75/-12 58.75%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 81.0 - 39.0 +47/=68/-5 67.50%
360 Games:
http://www.mediafire.com/download/bf7s1 ... es_4_0.pgn
Time Control 2+2
Stockfish 6 RC1 64 POPCNTx - Houdini 4 Pro x64-A_OK 71.5 - 48.5 +35/=73/-12 59.58%
Stockfish 6 RC1 64 POPCNTx - Komodo 8 64-bit_4_NOB 68.5 - 51.5 +36/=65/-19 57.08%
Stockfish 6 RC1 64 POPCNTx - Gull 3 x64 XP 79.5 - 40.5 +43/=73/-4 66.25%
360 Games:
http://www.mediafire.com/download/ocjf8 ... es_2_2.pgn
Score using 4 cores: 446.5 – 273.5= 62.01%
Segmenting by Time Control:
Fixed TC = 437.0 – 283.0 = 60.69%
Incremental TC = 434.0 – 286.0 = 60.28%
Global Score: 871.0 – 569.0 = 60.49%
Against : Houdini 4.0 St. Ct0 (3136) = 59.79% ; Komodo 8 (3153) = 56.56%, Gull 3 XP (3103) = 65.11%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3204
After 1440 games -IMHO- I think that this is a good but not an excellent candidate for SF 6. 8 Elo points below the top scorer in my tests STOCKFISH 090115 IPMAN (3212).
As a reference:
3 ELO below Stockfish_Dev 170115 (3207)
32 ELO above Stockfish 5 (3172)
51 ELO above Komodo 8 (3153)
68 ELO above Houdini 4 (3136)
If possible, let’s wait for other a bit stronger SF Release Candidates.

Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING Stockfish 6 Release Candidate 2 : 1440 Games
Timestamp: 1422128569 Bench: 8080602
I know that it is too late for this test to be of any use, since Stockfish 6 has been already released. Anyway I have decided to post it. This SF RC2 is a true monster.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC2 64 POPCNTx - Houdini 4 x64_st_X6_CT0 75.0 - 45.0 +37/=76/-7 62.50%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_6_NOB 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 79.0 - 41.0 +42/=74/-4 65.83%
Time Control 2+2
Stockfish 6 RC2 64 POPCNTx - Houdini 4 x64_st_X6_CT0 78.5 - 41.5 +45/=67/-8 65.42%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +28/=78/-14 55.83%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 81.5 - 38.5 +50/=63/-7 67.92%
Score using 6 cores: 450.0 – 270.0= 62.50%
720 games:
http://www.mediafire.com/download/b96vc ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC2 64 POPCNTx - Houdini 4 Pro x64-A_OK 74.5 - 45.5 +41/=67/-12 62.08%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_4_NOB 66.0 - 54.0 +31/=70/-19 55.00%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 83.5 - 36.5 +54/=59/-7 69.58%
Time Control 2+2
Stockfish 6 RC2 64 POPCNTx - Houdini 4 Pro x64-A_OK 68.5 - 51.5 +32/=73/-15 57.08%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_4_NOB 72.0 - 48.0 +34/=76/-10 60.00%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 80.5 - 39.5 +46/=69/-5 67.08%
Score using 4 cores: 445.0 – 275.0= 61.81%
720 Games: http://www.mediafire.com/download/e16ye ... RC2_X4.pgn
Segmenting by Time Control:
Fixed TC = 447.0 – 273.0= 62.08%
Incremental TC = 448.0 – 272.0 = 62.22%
Global Score: 895.0 – 545.0 = 62.15%
Against : Houdini 4.0 St. Ct0 (3136) = 61.77% ; Komodo 8 (3153) = 57.08%, Gull 3 XP (3103) = 67.60%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3216
Error bars: +/- 13 Elo points
This is a new BEST SCORE EVER in my tests, 4 Elo points better than the previous leader STOCKFISH 090115 IPMAN (3212).
According to my tests, Stockfish 6 Release Candidate 2 is:
44 ELO stronger than Stockfish 5 (3172)
63 ELO above Komodo 8 (3153)
80 ELO above Houdini 4 (3136)
I have just started my 1440 games test of Stockfish 6. I expect to have it finished this Sunday morning.
Best regards from Barcelona.
Tom.
Timestamp: 1422128569 Bench: 8080602
I know that it is too late for this test to be of any use, since Stockfish 6 has been already released. Anyway I have decided to post it. This SF RC2 is a true monster.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 RC2 64 POPCNTx - Houdini 4 x64_st_X6_CT0 75.0 - 45.0 +37/=76/-7 62.50%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_6_NOB 69.0 - 51.0 +31/=76/-13 57.50%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 79.0 - 41.0 +42/=74/-4 65.83%
Time Control 2+2
Stockfish 6 RC2 64 POPCNTx - Houdini 4 x64_st_X6_CT0 78.5 - 41.5 +45/=67/-8 65.42%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_6_NOB 67.0 - 53.0 +28/=78/-14 55.83%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 81.5 - 38.5 +50/=63/-7 67.92%
Score using 6 cores: 450.0 – 270.0= 62.50%
720 games:
http://www.mediafire.com/download/b96vc ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 RC2 64 POPCNTx - Houdini 4 Pro x64-A_OK 74.5 - 45.5 +41/=67/-12 62.08%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_4_NOB 66.0 - 54.0 +31/=70/-19 55.00%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 83.5 - 36.5 +54/=59/-7 69.58%
Time Control 2+2
Stockfish 6 RC2 64 POPCNTx - Houdini 4 Pro x64-A_OK 68.5 - 51.5 +32/=73/-15 57.08%
Stockfish 6 RC2 64 POPCNTx - Komodo 8 64-bit_4_NOB 72.0 - 48.0 +34/=76/-10 60.00%
Stockfish 6 RC2 64 POPCNTx - Gull 3 x64 XP 80.5 - 39.5 +46/=69/-5 67.08%
Score using 4 cores: 445.0 – 275.0= 61.81%
720 Games: http://www.mediafire.com/download/e16ye ... RC2_X4.pgn
Segmenting by Time Control:
Fixed TC = 447.0 – 273.0= 62.08%
Incremental TC = 448.0 – 272.0 = 62.22%
Global Score: 895.0 – 545.0 = 62.15%
Against : Houdini 4.0 St. Ct0 (3136) = 61.77% ; Komodo 8 (3153) = 57.08%, Gull 3 XP (3103) = 67.60%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3216
Error bars: +/- 13 Elo points
This is a new BEST SCORE EVER in my tests, 4 Elo points better than the previous leader STOCKFISH 090115 IPMAN (3212).
According to my tests, Stockfish 6 Release Candidate 2 is:
44 ELO stronger than Stockfish 5 (3172)
63 ELO above Komodo 8 (3153)
80 ELO above Houdini 4 (3136)
I have just started my 1440 games test of Stockfish 6. I expect to have it finished this Sunday morning.
Best regards from Barcelona.
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING Stockfish 6: 1440 Games
Timestamp: 1422390458 Stockfish bench signature is: 8918745
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 64 POPCNT_6x - Houdini 4 x64_st_X6_CT0 75.0 - 45.0 +39/=72/-9 62.50%
Stockfish 6 64 POPCNT_6x - Komodo 8 64-bit_6_NOB 70.5 - 49.5 +32/=77/-11 58.75%
Stockfish 6 64 POPCNT_6x - Gull 3 x64 XP 84.5 - 35.5 +54/=61/-5 70.42%
Time Control 2+2
Stockfish 6 64 POPCNT_6x - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +36/=69/-15 58.75%
Stockfish 6 64 POPCNT_6x - Komodo 8 64-bit_6_NOB 70.5 - 49.5 +30/=81/-9 58.75%
Stockfish 6 64 POPCNT_6x - Gull 3 x64 XP 78.5 - 41.5 +44/=69/-7 65.42%
Score using 6 cores: 449.5 – 270.5= 62.43%
720 games:
http://www.mediafire.com/download/ukd8u ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 70.5 - 49.5 +31/=79/-10 58.75%
Stockfish 6 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 74.0 - 46.0 +40/=68/-12 61.67%
Stockfish 6 64 POPCNTx4 - Gull 3 x64 XP 82.0 - 38.0 +51/=62/-7 68.33%
Time Control 2+2
Stockfish 6 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 73.0 - 47.0 +36/=74/-10 60.83%
Stockfish 6 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 73.0 - 47.0 +38/=70/-12 60.83%
Stockfish 6 64 POPCNTx4 - Gull 3 x64 XP 78.0 - 42.0 +42/=72/-6 65.00%
Score using 4 cores: 450.5 – 260.5= 62.57%
720 Games:
http://www.mediafire.com/download/7a779 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 456.5 – 263.5= 63.40%
Incremental TC = 443.5 – 276.5 = 61.60%
Global Score: 900.0 – 540.0 = 62.50%
Against : Houdini 4.0 St. Ct0 (3136) = 60.21% ; Komodo 8 (3153) = 60.00%, Gull 3 XP (3103) = 67.29%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3218
Error bars: +/- 13 Elo points
This is a new BEST SCORE EVER in my tests, although only 2 Elo points better than the previous leader Stockfish 6 Release Candidate 2 (3216).
According to my tests, Stockfish 6 is:
46 ELO stronger than Stockfish 5 (3172)
65 ELO stronger than Komodo 8 (3153)
82 ELO stronger than Houdini 4 (3136)
115 ELO stronger than Gull3 XP (3103)
For me this Stockfish 6 is a great gift from the Stockfish Team. Thank you very much for your time, your effort, your organized work and your talent.
Smiling regards from Barcelona.
Tom.
Timestamp: 1422390458 Stockfish bench signature is: 8918745
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 6 64 POPCNT_6x - Houdini 4 x64_st_X6_CT0 75.0 - 45.0 +39/=72/-9 62.50%
Stockfish 6 64 POPCNT_6x - Komodo 8 64-bit_6_NOB 70.5 - 49.5 +32/=77/-11 58.75%
Stockfish 6 64 POPCNT_6x - Gull 3 x64 XP 84.5 - 35.5 +54/=61/-5 70.42%
Time Control 2+2
Stockfish 6 64 POPCNT_6x - Houdini 4 x64_st_X6_CT0 70.5 - 49.5 +36/=69/-15 58.75%
Stockfish 6 64 POPCNT_6x - Komodo 8 64-bit_6_NOB 70.5 - 49.5 +30/=81/-9 58.75%
Stockfish 6 64 POPCNT_6x - Gull 3 x64 XP 78.5 - 41.5 +44/=69/-7 65.42%
Score using 6 cores: 449.5 – 270.5= 62.43%
720 games:
http://www.mediafire.com/download/ukd8u ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 6 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 70.5 - 49.5 +31/=79/-10 58.75%
Stockfish 6 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 74.0 - 46.0 +40/=68/-12 61.67%
Stockfish 6 64 POPCNTx4 - Gull 3 x64 XP 82.0 - 38.0 +51/=62/-7 68.33%
Time Control 2+2
Stockfish 6 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 73.0 - 47.0 +36/=74/-10 60.83%
Stockfish 6 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 73.0 - 47.0 +38/=70/-12 60.83%
Stockfish 6 64 POPCNTx4 - Gull 3 x64 XP 78.0 - 42.0 +42/=72/-6 65.00%
Score using 4 cores: 450.5 – 260.5= 62.57%
720 Games:
http://www.mediafire.com/download/7a779 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 456.5 – 263.5= 63.40%
Incremental TC = 443.5 – 276.5 = 61.60%
Global Score: 900.0 – 540.0 = 62.50%
Against : Houdini 4.0 St. Ct0 (3136) = 60.21% ; Komodo 8 (3153) = 60.00%, Gull 3 XP (3103) = 67.29%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3218
Error bars: +/- 13 Elo points
This is a new BEST SCORE EVER in my tests, although only 2 Elo points better than the previous leader Stockfish 6 Release Candidate 2 (3216).
According to my tests, Stockfish 6 is:
46 ELO stronger than Stockfish 5 (3172)
65 ELO stronger than Komodo 8 (3153)
82 ELO stronger than Houdini 4 (3136)
115 ELO stronger than Gull3 XP (3103)
For me this Stockfish 6 is a great gift from the Stockfish Team. Thank you very much for your time, your effort, your organized work and your talent.
Smiling regards from Barcelona.
Tom.