STOCKFISH6 (Official page, binary code: https://stockfishchess.org/download/)
150 GAMES TEST AGAINST KOMODO 8 AT 30 MINUTES + 5 SECONDS TIME CONTROL
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control: 30 minutes + 5 seconds
(Average= 22 billion nodes per engine and game)
STOCKFISH 6 - KOMODO 8 = +40 / =97 / -13 88.5 – 61.5 = 59,00%
http://www.mediafire.com/download/gycqm ... 0Games.pgn
This has been a very unusual test fot me, because of this much longer Time Control. I have had no time to check if this Stockfish 6 is faster or not than the Abroak one. Anyway I had not expected such a clear win for Stockfish 6. My guess was 54%-46%. What an impressive win for Stockfish 6!.
Thanks, Jouni for your suggestion about this Stockfish 6.
Regards,
Tom.
Testing Stockfish 11-03-13. 480 Games.
Moderator: Ras
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING SUGAR V5.1 (By Marco Zerbinati) = 1440 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
SugaR v5.1 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 144.5 - 95.5 +70/=149/-21 60.21%
SugaR v5.1 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 144.0 - 96.0 +73/=142/-25 60.00%
SugaR v5.1 64 POPCNTx6 - Gull 3 x64 XP 158.5 - 81.5 +94/=129/-17 66.04%
720 Games=
http://www.mediafire.com/download/p63zh ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
SugaR v5.1 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 146.0 - 94.0 +74/=144/-22 60.83%
SugaR v5.1 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 141.5 - 98.5 +69/=145/-26 58.96%
SugaR v5.1 64 POPCNTx4 - Gull 3 x64 XP 161.5 - 78.5 +95/=133/-12 67.29%
720 Games=
http://www.mediafire.com/download/a96c1 ... 0games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 60.52% ; Komodo 8 (3153) = 59.50%, Gull 3 XP (3103) = 66.66%
GLOBAL SCORE: 896.0 – 544.0 = 62.22%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3217
Error bars: +/- 13
Only 1 Elo Point below the higest score in my tests so far. Stockfish 6 (3218). Well done, Marco Z.!
Regards,
Tom.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
SugaR v5.1 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 144.5 - 95.5 +70/=149/-21 60.21%
SugaR v5.1 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 144.0 - 96.0 +73/=142/-25 60.00%
SugaR v5.1 64 POPCNTx6 - Gull 3 x64 XP 158.5 - 81.5 +94/=129/-17 66.04%
720 Games=
http://www.mediafire.com/download/p63zh ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
SugaR v5.1 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 146.0 - 94.0 +74/=144/-22 60.83%
SugaR v5.1 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 141.5 - 98.5 +69/=145/-26 58.96%
SugaR v5.1 64 POPCNTx4 - Gull 3 x64 XP 161.5 - 78.5 +95/=133/-12 67.29%
720 Games=
http://www.mediafire.com/download/a96c1 ... 0games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 60.52% ; Komodo 8 (3153) = 59.50%, Gull 3 XP (3103) = 66.66%
GLOBAL SCORE: 896.0 – 544.0 = 62.22%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3217
Error bars: +/- 13
Only 1 Elo Point below the higest score in my tests so far. Stockfish 6 (3218). Well done, Marco Z.!
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 260215: 480 Games
Timestamp: 1424973143 Bench: 8069601
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 260215 64 POPCNTx - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +9/=29/-2 58.75%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 27.5 - 12.5 +15/=25/-0 68.75%
Time Control 2+2
Stockfish 260215 64 POPCNTx - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +9/=29/-2 58.75%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_6_NOB 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 29.5 - 10.5 +19/=21/-0 73.75%
Score using 6 cores: 148.5 – 91.5= 61.87%
240 Games:
http://www.mediafire.com/download/t6...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 260215 64 POPCNTx - Houdini 4 Pro x64-A_OK 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 28.0 - 12.0 +16/=24/-0 70.00%
Time Control 2+2
Stockfish 260215 64 POPCNTx - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +15/=17/-8 58.75%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 27.0 - 13.0 +16/=22/-2 67.50%
Score using 4 cores: 152.0 – 88.0= 63.33%
240 Games
http://www.mediafire.com/download/tx...4_240games.pgn
Segmenting by Time Control:
Fixed TC = 150.0 – 90.0 = 62.50%
Incremental TC = 150.5 – 89.5 = 62.71%
Against : Houdini 4.0 St. Ct0 (3136) = 60.31% ; Komodo 8 (3153) = 57.50%, Gull 3 XP (3103) = 70.00%
GLOBAL SCORE: 300.5 – 179.5 = 62.60%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3219
Error bars: +/- 23
This is a new best score ever in my tests .. . although only 1 Elo point better than my leader Stockfish 6. I have started a new 1440 games test with the latest SF Development version to minimize error bars.
Regards,
Tom.
Timestamp: 1424973143 Bench: 8069601
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 260215 64 POPCNTx - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +9/=29/-2 58.75%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 27.5 - 12.5 +15/=25/-0 68.75%
Time Control 2+2
Stockfish 260215 64 POPCNTx - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +9/=29/-2 58.75%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_6_NOB 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 29.5 - 10.5 +19/=21/-0 73.75%
Score using 6 cores: 148.5 – 91.5= 61.87%
240 Games:
http://www.mediafire.com/download/t6...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 260215 64 POPCNTx - Houdini 4 Pro x64-A_OK 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 28.0 - 12.0 +16/=24/-0 70.00%
Time Control 2+2
Stockfish 260215 64 POPCNTx - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 260215 64 POPCNTx - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +15/=17/-8 58.75%
Stockfish 260215 64 POPCNTx - Gull 3 x64 XP 27.0 - 13.0 +16/=22/-2 67.50%
Score using 4 cores: 152.0 – 88.0= 63.33%
240 Games
http://www.mediafire.com/download/tx...4_240games.pgn
Segmenting by Time Control:
Fixed TC = 150.0 – 90.0 = 62.50%
Incremental TC = 150.5 – 89.5 = 62.71%
Against : Houdini 4.0 St. Ct0 (3136) = 60.31% ; Komodo 8 (3153) = 57.50%, Gull 3 XP (3103) = 70.00%
GLOBAL SCORE: 300.5 – 179.5 = 62.60%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3219
Error bars: +/- 23
This is a new best score ever in my tests .. . although only 1 Elo point better than my leader Stockfish 6. I have started a new 1440 games test with the latest SF Development version to minimize error bars.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 020315: 1440 Games
Timestamp: 1425280299 Bench: 8285241
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control =2+2
Stockfish 020315 64 POPCNTx - Houdini 4 x64_st_X6_CT 139.5 - 100.5 +64/=151/-25 58.13%
Stockfish 020315 64 POPCNTx - Komodo 8 64-bit_6_NOB 133.5 - 106.5 +56/=155/-29 55.63%
Stockfish 020315 64 POPCNTx - Gull 3 x64 XP 159.0 - 81.0 +92/=134/-14 66.25%
Score using 6 cores: 432.0 – 288.0= 60.00%
720 Games:
http://www.mediafire.com/download/522o8 ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
201503_Stockfish6_Dev_020315_4+0 2015
Stockfish 020315 64 POPCNTx - Houdini 4 Pro x64-A 140.0 - 100.0 +71/=138/-31 58.33%
Stockfish 020315 64 POPCNTx - Komodo 8 64-bit_4 134.0 - 106.0 +62/=144/-34 55.83%
Stockfish 020315 64 POPCNTx - Gull 3 x64 XP 168.0 - 72.0 +108/=120/-12 70.00%
Score using 4 cores: 442.0 – 278.0 = 61.39%
720 Games:
http://www.mediafire.com/download/tu91b ... 0games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 58.23% ; Komodo 8 (3153) = 55.73%, Gull 3 XP (3103) = 68.13%
GLOBAL SCORE: 874.0 – 566.0 = 60.69%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
The good score of STOCKFISH DEVELOPMENT 260215 has not been confirmed by this longer test. This performance is 12 Elo points below the current leader under my testing conditions: STOCKFISH 6 (Official page, binary code: https://stockfishchess.org/download/) = 3218 ELO.
Regards,
Tom.
Timestamp: 1425280299 Bench: 8285241
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control =2+2
Stockfish 020315 64 POPCNTx - Houdini 4 x64_st_X6_CT 139.5 - 100.5 +64/=151/-25 58.13%
Stockfish 020315 64 POPCNTx - Komodo 8 64-bit_6_NOB 133.5 - 106.5 +56/=155/-29 55.63%
Stockfish 020315 64 POPCNTx - Gull 3 x64 XP 159.0 - 81.0 +92/=134/-14 66.25%
Score using 6 cores: 432.0 – 288.0= 60.00%
720 Games:
http://www.mediafire.com/download/522o8 ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
201503_Stockfish6_Dev_020315_4+0 2015
Stockfish 020315 64 POPCNTx - Houdini 4 Pro x64-A 140.0 - 100.0 +71/=138/-31 58.33%
Stockfish 020315 64 POPCNTx - Komodo 8 64-bit_4 134.0 - 106.0 +62/=144/-34 55.83%
Stockfish 020315 64 POPCNTx - Gull 3 x64 XP 168.0 - 72.0 +108/=120/-12 70.00%
Score using 4 cores: 442.0 – 278.0 = 61.39%
720 Games:
http://www.mediafire.com/download/tu91b ... 0games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 58.23% ; Komodo 8 (3153) = 55.73%, Gull 3 XP (3103) = 68.13%
GLOBAL SCORE: 874.0 – 566.0 = 60.69%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3206
The good score of STOCKFISH DEVELOPMENT 260215 has not been confirmed by this longer test. This performance is 12 Elo points below the current leader under my testing conditions: STOCKFISH 6 (Official page, binary code: https://stockfishchess.org/download/) = 3218 ELO.
Regards,
Tom.
-
Jouni
- Posts: 3669
- Joined: Wed Mar 08, 2006 8:15 pm
- Full name: Jouni Uski
Re: Testing Stockfish 11-03-13. 480 Games.
But You haven't posted results for SF 6 official compile yet - I am still waiting.
Jouni
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
Hi Jouni.Jouni wrote:But You haven't posted results for SF 6 official compile yet - I am still waiting.
These last weeks I have been in 'collapse mode' at professional level. For this reason I have not posted very frequently. I posted the SF official compile against Komodo 8 at a much longer time control. I will post also as soon as possible a 1440 games test of this SF 6 official ... keeping the automatic selection af number of threads. That is 6 + 6 HT and 4 + 4 HT. Surprisingly the number of cores that appeared in the Fritz GUI was not 12 and 8, but 6 and 4. I don't know the reason.
Usually I avoid HT tests because my computers tend to be over-heated. But this time I decided to take this risk.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH 6 OFFICIAL PAGE WITH HT ALLOWED: 1440 Games
6 real cores + 6 HT
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
201503SF6_Official_x12_4+0_120games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 25.5 - 14.5 +13/=25/-2 63.75%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 29.0 - 11.0 +20/=18/-2 72.50%
201503SF6_Official_x12_2+2_120games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 25.5 - 14.5 +12/=27/-1 63.75%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
201503SF6_Official_x12_4+0_240games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 50.5 - 29.5 +27/=47/-6 63.13%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 46.5 - 33.5 +24/=45/-11 58.13%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 52.0 - 28.0 +29/=46/-5 65.00%
201503SF6_Official_x12_2+2_240games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 52.0 - 28.0 +28/=48/-4 65.00%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 45.0 - 35.0 +18/=54/-8 56.25%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 48.0 - 32.0 +25/=46/-9 60.00%
SCORE USING 6 + 6 HT CORES: 448.5 – 271.5 = 62.29%
720 games: http://www.mediafire.com/download/lr44y ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores + 4 HT
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
201502_Stockfish6_OfficialPage_280115_x 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +10/=26/-4 57.50%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
201502_Stockfish6_OffPage_280115_x8_2+2 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 22.0 - 18.0 +9/=26/-5 55.00%
201502_Stockfish6_OffP_280115_x8_240g_4 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 51.0 - 29.0 +29/=44/-7 63.75%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 46.5 - 33.5 +24/=45/-11 58.13%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 52.5 - 27.5 +29/=47/-4 65.63%
201502_Stockfish6_OffP_280115_x8_240g_2 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 47.5 - 32.5 +21/=53/-6 59.38%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 46.0 - 34.0 +20/=52/-8 57.50%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 52.5 - 27.5 +27/=51/-2 65.63%
SCORE USING 4 + 4 HT CORES= 443.5 – 276.5 = 61.60%
720 GAMES =
http://www.mediafire.com/download/idwg2 ... 0games.pgn
GLOBAL SCORE: 892.0 – 548.0 = 61.94%
Against : Houdini 4.0 (3136) = 62.08% ; Komodo 8 (3153) = 59.58%, Gull 3 XP (3103) = 64.17%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3215
Error bars: +/- 13
Regards,
Tom.
6 real cores + 6 HT
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
201503SF6_Official_x12_4+0_120games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 25.5 - 14.5 +13/=25/-2 63.75%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 29.0 - 11.0 +20/=18/-2 72.50%
201503SF6_Official_x12_2+2_120games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 25.5 - 14.5 +12/=27/-1 63.75%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
201503SF6_Official_x12_4+0_240games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 50.5 - 29.5 +27/=47/-6 63.13%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 46.5 - 33.5 +24/=45/-11 58.13%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 52.0 - 28.0 +29/=46/-5 65.00%
201503SF6_Official_x12_2+2_240games 2015
Stockfish 6 64 POPCNT_12 - Houdini 4 x64_st_X6_CT0 52.0 - 28.0 +28/=48/-4 65.00%
Stockfish 6 64 POPCNT_12 - Komodo 8 64-bit_6_NOB 45.0 - 35.0 +18/=54/-8 56.25%
Stockfish 6 64 POPCNT_12 - Gull 3 x64 XP 48.0 - 32.0 +25/=46/-9 60.00%
SCORE USING 6 + 6 HT CORES: 448.5 – 271.5 = 62.29%
720 games: http://www.mediafire.com/download/lr44y ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores + 4 HT
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
201502_Stockfish6_OfficialPage_280115_x 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +10/=26/-4 57.50%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
201502_Stockfish6_OffPage_280115_x8_2+2 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 22.0 - 18.0 +9/=26/-5 55.00%
201502_Stockfish6_OffP_280115_x8_240g_4 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 51.0 - 29.0 +29/=44/-7 63.75%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 46.5 - 33.5 +24/=45/-11 58.13%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 52.5 - 27.5 +29/=47/-4 65.63%
201502_Stockfish6_OffP_280115_x8_240g_2 2015
Stockfish 6 64 POPCNTx8 - Houdini 4 Pro x64-A_OK 47.5 - 32.5 +21/=53/-6 59.38%
Stockfish 6 64 POPCNTx8 - Komodo 8 64-bit_4_NOB 46.0 - 34.0 +20/=52/-8 57.50%
Stockfish 6 64 POPCNTx8 - Gull 3 x64 XP 52.5 - 27.5 +27/=51/-2 65.63%
SCORE USING 4 + 4 HT CORES= 443.5 – 276.5 = 61.60%
720 GAMES =
http://www.mediafire.com/download/idwg2 ... 0games.pgn
GLOBAL SCORE: 892.0 – 548.0 = 61.94%
Against : Houdini 4.0 (3136) = 62.08% ; Komodo 8 (3153) = 59.58%, Gull 3 XP (3103) = 64.17%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3215
Error bars: +/- 13
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 130315: 1440 Games
Timestamp: 1426278568 Bench: 7725341
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 130315 64 POPCNTx6 - Houdini 4 x64_st_X6 71.0 - 49.0 +36/=70/-14 59.17%
Stockfish 130315 64 POPCNTx6 - Komodo 8 64-bit_6 69.0 - 51.0 +34/=70/-16 57.50%
Stockfish 130315 64 POPCNTx6 - Gull 3 x64 XP 80.0 - 40.0 +45/=70/-5 66.67%
Time Control = 2+2
Stockfish 130315 64 POPCNTx6 - Houdini 4 x64_st_X6 65.5 - 54.5 +27/=77/-16 54.58%
Stockfish 130315 64 POPCNTx6 - Komodo 8 64-bit_6 73.0 - 47.0 +35/=76/-9 60.83%
Stockfish 130315 64 POPCNTx6 - Gull 3 x64 XP 80.5 - 39.5 +45/=71/-4 67.08%
Score using 6 cores: 439.0 – 281.0= 60.97%
720 Games:
http://www.mediafire.com/download/5cenh ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 130315 64 POPCNTx4 - Houdini 4 Pro x64-A 76.5 - 43.5 +40/=73/-7 63.75%
Stockfish 130315 64 POPCNTx4 - Komodo 8 64-bit_4 76.0 - 44.0 +40/=72/-8 63.33%
Stockfish 130315 64 POPCNTx4 - Gull 3 x64 XP 85.5 - 34.5 +53/=65/-2 71.25%
Time Control 2+2
Stockfish 130315 64 POPCNTx4 - Houdini 4 Pro x64-A 68.5 - 51.5 +31/=75/-14 57.08%
Stockfish 130315 64 POPCNTx4 - Komodo 8 64-bit_4 73.5 - 46.5 +37/=73/-10 61.25%
Stockfish 130315 64 POPCNTx4 - Gull 3 x64 XP 81.0 - 39.0 +50/=62/-8 67.50%
Score using 4 cores: 461.0 – 259.0 = 64.03%
720 Games:
http://www.mediafire.com/download/3ahb3 ... 0games.pgn
Segmenting by time control:
Fixed TC = 458.0 – 262.0 = 63.61%
Incremental TC = 442.0 – 278.0 = 61.39%
Against : Houdini 4.0 St. Ct0 (3136) = 58.64% ; Komodo 8 (3153) = 60.73%, Gull 3 XP (3103) = 68.13%
GLOBAL SCORE: 900.0 – 540.0 = 62.50%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3219
New best score in my 1440 games tests. Congratulations to the Stockfish Team!.
Regards,
Tom.
Timestamp: 1426278568 Bench: 7725341
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 130315 64 POPCNTx6 - Houdini 4 x64_st_X6 71.0 - 49.0 +36/=70/-14 59.17%
Stockfish 130315 64 POPCNTx6 - Komodo 8 64-bit_6 69.0 - 51.0 +34/=70/-16 57.50%
Stockfish 130315 64 POPCNTx6 - Gull 3 x64 XP 80.0 - 40.0 +45/=70/-5 66.67%
Time Control = 2+2
Stockfish 130315 64 POPCNTx6 - Houdini 4 x64_st_X6 65.5 - 54.5 +27/=77/-16 54.58%
Stockfish 130315 64 POPCNTx6 - Komodo 8 64-bit_6 73.0 - 47.0 +35/=76/-9 60.83%
Stockfish 130315 64 POPCNTx6 - Gull 3 x64 XP 80.5 - 39.5 +45/=71/-4 67.08%
Score using 6 cores: 439.0 – 281.0= 60.97%
720 Games:
http://www.mediafire.com/download/5cenh ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 130315 64 POPCNTx4 - Houdini 4 Pro x64-A 76.5 - 43.5 +40/=73/-7 63.75%
Stockfish 130315 64 POPCNTx4 - Komodo 8 64-bit_4 76.0 - 44.0 +40/=72/-8 63.33%
Stockfish 130315 64 POPCNTx4 - Gull 3 x64 XP 85.5 - 34.5 +53/=65/-2 71.25%
Time Control 2+2
Stockfish 130315 64 POPCNTx4 - Houdini 4 Pro x64-A 68.5 - 51.5 +31/=75/-14 57.08%
Stockfish 130315 64 POPCNTx4 - Komodo 8 64-bit_4 73.5 - 46.5 +37/=73/-10 61.25%
Stockfish 130315 64 POPCNTx4 - Gull 3 x64 XP 81.0 - 39.0 +50/=62/-8 67.50%
Score using 4 cores: 461.0 – 259.0 = 64.03%
720 Games:
http://www.mediafire.com/download/3ahb3 ... 0games.pgn
Segmenting by time control:
Fixed TC = 458.0 – 262.0 = 63.61%
Incremental TC = 442.0 – 278.0 = 61.39%
Against : Houdini 4.0 St. Ct0 (3136) = 58.64% ; Komodo 8 (3153) = 60.73%, Gull 3 XP (3103) = 68.13%
GLOBAL SCORE: 900.0 – 540.0 = 62.50%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3219
New best score in my 1440 games tests. Congratulations to the Stockfish Team!.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH BULLET 290315= 1440 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control 4 + 0
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 51.5 - 28.5 +25/=53/-2 64.38%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 47.5 - 32.5 +25/=45/-10 59.38%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 50.5 - 29.5 +27/=47/-6 63.13%
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 98.0 - 62.0 +48/=100/-12 61.25%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 99.0 - 61.0 +55/=88/-17 61.88%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 111.0 - 49.0 +66/=90/-4 69.38%
Score at 4 minutes +0 seconds Time Control after 720 Games:
457.50 – 262.50 = 63.54%
Time Control 2 + 2
201504StockfishBullet290315_x6_2+2 2015
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 49.5 - 30.5 +21/=57/-2 61.88%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 49.0 - 31.0 +27/=44/-9 61.25%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 55.0 - 25.0 +32/=46/-2 68.75%
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 101.0 - 59.0 +48/=106/-6 63.13%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 100.0 - 60.0 +54/=92/-14 62.50%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 108.0 - 52.0 +65/=86/-9 67.50%
Score at 4 minutes +0 seconds Time Control after 720 Games:
462.50 – 257.50 = 64.24%
1440 Games=
http://www.mediafire.com/download/97..._1440Games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 62.50% ; Komodo 8 (3153) = 61.56%, Gull 3 XP (3103) = 67.60%
GLOBAL SCORE: 920.0 – 520.0= 63.89%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3228
This test is a major step ahead for Stockfish. This SF version build up by Bullet is substantially stronger than any other version I have tested so far. After such a long test, a 9 Elo points difference over the previous leading scorer Sugar V 5.2 seems to me to be very relevant. Great work, Bullet! Congratulations to you and to the Stockfish Team.
Regards,
Tom.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control 4 + 0
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 51.5 - 28.5 +25/=53/-2 64.38%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 47.5 - 32.5 +25/=45/-10 59.38%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 50.5 - 29.5 +27/=47/-6 63.13%
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 98.0 - 62.0 +48/=100/-12 61.25%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 99.0 - 61.0 +55/=88/-17 61.88%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 111.0 - 49.0 +66/=90/-4 69.38%
Score at 4 minutes +0 seconds Time Control after 720 Games:
457.50 – 262.50 = 63.54%
Time Control 2 + 2
201504StockfishBullet290315_x6_2+2 2015
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 49.5 - 30.5 +21/=57/-2 61.88%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 49.0 - 31.0 +27/=44/-9 61.25%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 55.0 - 25.0 +32/=46/-2 68.75%
Stockfish 290315b 64 SSE42_ - Houdini 4 x64_st_X6_CT0 101.0 - 59.0 +48/=106/-6 63.13%
Stockfish 290315b 64 SSE42_ - Komodo 8 64-bit_6_NOB 100.0 - 60.0 +54/=92/-14 62.50%
Stockfish 290315b 64 SSE42_ - Gull 3 x64 XP 108.0 - 52.0 +65/=86/-9 67.50%
Score at 4 minutes +0 seconds Time Control after 720 Games:
462.50 – 257.50 = 64.24%
1440 Games=
http://www.mediafire.com/download/97..._1440Games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 62.50% ; Komodo 8 (3153) = 61.56%, Gull 3 XP (3103) = 67.60%
GLOBAL SCORE: 920.0 – 520.0= 63.89%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3228
This test is a major step ahead for Stockfish. This SF version build up by Bullet is substantially stronger than any other version I have tested so far. After such a long test, a 9 Elo points difference over the previous leading scorer Sugar V 5.2 seems to me to be very relevant. Great work, Bullet! Congratulations to you and to the Stockfish Team.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
(Please note again that this 1440 games test has been performed with only one computer, working non stop for 7 days. My old 4 cores crashed after 9 years of service. I hope that my new 8 cores computer will be available soon…)
TESTING STOCKFISH 100415 BULLET = 1440 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control 4 + 0
Stockfish 100415b 64 SSE42x6 - Houdini 4 x64_st_X6_CT0 155.0 - 85.0 +84/=142/-14 64.58%
Stockfish 100415b 64 SSE42x6 - Komodo 8 64-bit_6_NOB 146.5 - 93.5 +81/=131/-28 61.04%
Stockfish 100415b 64 SSE42x6 - Gull 3 x64 XP 164.0 - 76.0 +100/=128/-12 68.33%
Score at 4 minutes +0 seconds Time Control after 720 Games:
465.5 – 254.5 = 64.65%
720 Games:
http://www.mediafire.com/download/ls...0_720Games.pgn
Time Control 2 + 2
Stockfish 100415b 64 SSE42x6 - Houdini 4 x64_st_X6_CT0 155.5 - 84.5 +83/=145/-12 64.79%
Stockfish 100415b 64 SSE42x6 - Komodo 8 64-bit_6_NOB 144.0 - 96.0 +76/=136/-28 60.00%
Stockfish 100415b 64 SSE42x6 - Gull 3 x64 XP 170.0 - 70.0 +110/=120/-10 70.83%
Score at 4 minutes +0 seconds Time Control after 720 Games:
469.5 – 250.5 = 65.21%
720 Games:
http://www.mediafire.com/download/5d...2_720Games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 64.68% ; Komodo 8 (3153) = 60.52%, Gull 3 XP (3103) = 69.58%
GLOBAL SCORE: 935.0 – 505.0= 64.94%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3236
This test is the confirmation that SF compiles by Bullet are extremely strong. This compile, the best I have ever tested, is 18 Elo Points stronger than S.F. 6 -not Abroak, but official page- (3218) and 17 Elo points stronger than the best performers in my tests so far: Sugar V 5.2 and SF Development 130315 (3219).
Regards from Barcelona.
Tom.
TESTING STOCKFISH 100415 BULLET = 1440 GAMES
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control 4 + 0
Stockfish 100415b 64 SSE42x6 - Houdini 4 x64_st_X6_CT0 155.0 - 85.0 +84/=142/-14 64.58%
Stockfish 100415b 64 SSE42x6 - Komodo 8 64-bit_6_NOB 146.5 - 93.5 +81/=131/-28 61.04%
Stockfish 100415b 64 SSE42x6 - Gull 3 x64 XP 164.0 - 76.0 +100/=128/-12 68.33%
Score at 4 minutes +0 seconds Time Control after 720 Games:
465.5 – 254.5 = 64.65%
720 Games:
http://www.mediafire.com/download/ls...0_720Games.pgn
Time Control 2 + 2
Stockfish 100415b 64 SSE42x6 - Houdini 4 x64_st_X6_CT0 155.5 - 84.5 +83/=145/-12 64.79%
Stockfish 100415b 64 SSE42x6 - Komodo 8 64-bit_6_NOB 144.0 - 96.0 +76/=136/-28 60.00%
Stockfish 100415b 64 SSE42x6 - Gull 3 x64 XP 170.0 - 70.0 +110/=120/-10 70.83%
Score at 4 minutes +0 seconds Time Control after 720 Games:
469.5 – 250.5 = 65.21%
720 Games:
http://www.mediafire.com/download/5d...2_720Games.pgn
Against : Houdini 4.0 St. Ct0 (3136) = 64.68% ; Komodo 8 (3153) = 60.52%, Gull 3 XP (3103) = 69.58%
GLOBAL SCORE: 935.0 – 505.0= 64.94%
Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3236
This test is the confirmation that SF compiles by Bullet are extremely strong. This compile, the best I have ever tested, is 18 Elo Points stronger than S.F. 6 -not Abroak, but official page- (3218) and 17 Elo points stronger than the best performers in my tests so far: Sugar V 5.2 and SF Development 130315 (3219).
Regards from Barcelona.
Tom.