Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Ozymandias wrote:Links are ok now, maybe I clicked somewhere else? :roll:
No problem, Juan.

Un abrazo!

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 191114MZ: 480 Games

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF191114xMZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +9/=28/-3 57.50%
SF191114xMZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 20.0 - 20.0 +8/=24/-8 50.00%
SF191114xMZ x64 POPCNT_ - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%

Time Control= 2+2
201411Stockfish_191114MZ_2+2_x6 2014

SF191114xMZ x64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
SF191114xMZ x64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.5 - 16.5 +10/=27/-3 58.75%
SF191114xMZ x64 POPCNT_ - Gull 3 x64 XP 25.5 - 14.5 +12/=27/-1 63.75%

Score using 6 cores: 141.5 – 99.5 = 58.96%

240 Games =
http://www.mediafire.com/download/0yi9x ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF191114xMZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 23.5 - 16.5 +12/=23/-5 58.75%
SF191114xMZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 20.5 - 19.5 +5/=31/-4 51.25%
SF191114xMZ x64 POPCNT_ - Gull 3 x64 XP 23.5 - 16.5 +11/=25/-4 58.75%

Time Control= 2+2

SF191114xMZ x64 POPCNT_ - Houdini 4 Pro x64-A_OK 21.5 - 18.5 +8/=27/-5 53.75%
SF191114xMZ x64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +8/=30/-2 57.50%

SF191114xMZ x64 POPCNT_ - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Score using 4 cores: 136.0 – 104.0 = 56.67%

240 Games:
http://www.mediafire.com/download/8xcob ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 136.5 – 103.5 = 56.88%
Incremental TC = 141.0 – 99.0 = 58.75%

GLOBAL SCORE: 277.5 – 202.5 = 57.81%

Against : Houdini 4.0 St. Ct0 (3227) = 57.19% ; Komodo 8 (3266) = 54.37%, Gull 3 XP (3199) = 61.87%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3286


Error bars= +/- 23 EEP

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 231114 : 480 Games.

Timestamp: 1416721360 Bench: 8255966 (Gary Linscott’s syzygy version)

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

Stockfish 231114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +8/=30/-2 57.50%
Stockfish 231114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 231114 64 POPCNT_ - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%

Time Control= 2+2

Stockfish 231114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 19.0 - 21.0 +7/=24/-9 47.50%
Stockfish 231114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 231114 64 POPCNT_ - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%

Score using 6 cores: 140.5 – 99.5 = 58.54%

240 Games =
http://www.mediafire.com/download/l4s00 ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 231114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 231114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 21.5 - 18.5 +12/=19/-9 53.75%
Stockfish 231114 64 POPCNT_ - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%

Time Control= 2+2

Stockfish 231114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 18.5 - 21.5 +5/=27/-8 46.25%
Stockfish 231114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 22.5 - 17.5 +11/=23/-6 56.25%
Stockfish 231114 64 POPCNT_ - Gull 3 x64 XP 28.0 - 12.0 +19/=18/-3 70.00%
Score using 4 cores: 140.0 – 100.0 = 58.33%

240 Games:
http://www.mediafire.com/download/g87mj ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 146.0 – 94.0 = 60.83%
Incremental TC = 134.5 – 105.5= 56.04%

GLOBAL SCORE: 280.5 – 199.5 = 58.44%

Against : Houdini 4.0 St. Ct0 (3227) = 51.87% ; Komodo 8 (3266) = 57.19%, Gull 3 XP (3199) = 66.25%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3290


Error bars= +/- 23 EEP

Regards,

Tom
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 241114 : 480 Games.

Bench: 8255966 Timestamp: 1416790236

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

Stockfish 241114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +12/=26/-2 62.50%
Stockfish 241114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +10/=26/-4 57.50%
Stockfish 241114 64 POPCNT_ - Gull 3 x64 XP 22.5 - 17.5 +11/=23/-6 56.25%

Time Control= 2+2

Stockfish 241114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 241114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 241114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +15/=20/-5 62.50%

Score using 6 cores: 144.5 – 95.5 = 60.21%

240 Games =
http://www.mediafire.com/download/ranr5 ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 241114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 241114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 241114 64 POPCNT_ - Gull 3 x64 XP 26.5 - 13.5 +15/=23/-2 66.25%

Time Control= 2+2

Stockfish 241114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 19.5 - 20.5 +6/=27/-7 48.75%
Stockfish 241114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 241114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +16/=18/-6 62.50%

Score using 4 cores: 135.0 – 105.0= 56.25%

240 Games:
http://www.mediafire.com/download/jqumg ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 138.5 – 101.5 = 57.71%
Incremental TC = 141.0 – 99.0= 58.75%

GLOBAL SCORE: 279.5 – 200.5 = 58.23%

Against : Houdini 4.0 St. Ct0 (3227) = 55.00% ; Komodo 8 (3266) = 57.81%, Gull 3 XP (3199) = 61.87%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3289

Error bars= +/- 23 EEP


Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 081214: 1440 GAMES. (THREE 480 GAMES TESTS IN ONE).

Bench: 9324905 Timestamp: 1417997906


i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

Stockfish 081214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 74.5 - 45.5 +41/=67/-12 62.08%
Stockfish 081214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 66.0 - 54.0 +25/=82/-13 55.00%
Stockfish 081214 64 POPCNT_ - Gull 3 x64 XP 72.5 - 47.5 +39/=67/-14 60.42%

Time Control= 2+2

Stockfish 081214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 66.0 - 54.0 +30/=72/-18 55.00%
Stockfish 081214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 65.0 - 55.0 +25/=80/-15 54.17%
Stockfish 081214 64 POPCNT_ - Gull 3 x64 XP 65.5 - 54.5 +29/=73/-18 54.58%

Score using 6 cores: 409.5 – 310.5= 56.87%

720 Games
http://www.mediafire.com/download/plosy ... 0Games.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 081214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 67.5 - 52.5 +29/=77/-14 56.25%
Stockfish 081214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 76.5 - 43.5 +42/=69/-9 63.75%
Stockfish 081214 64 POPCNT_ - Gull 3 x64 XP 74.5 - 45.5 +40/=69/-11 62.08%

Time Control= 2+2

Stockfish 081214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 72.5 - 47.5 +36/=73/-11 60.42%
Stockfish 081214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 70.5 - 49.5 +30/=81/-9 58.75%
Stockfish 081214 64 POPCNT_ - Gull 3 x64 XP 78.5 - 41.5 +42/=73/-5 65.42%

Score using 4 cores: 440.0 – 280.0 = 61.11%

720 Games=
http://www.mediafire.com/download/zd0s8 ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 431.5 – 288.5= 59.93%
Incremental TC = 418.0 – 302.0 = 58.06%

GLOBAL SCORE: 849.5 – 590.5 = 58.99%

Against : Houdini 4.0 St. Ct0 (3227) = 58.44% ; Komodo 8 (3266) = 57.92%, Gull 3 XP (3199) = 60.62%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3294


Error bars= +/- 13 EEP

This score is very similar to the one got by Stockfish Development 171114. Timestamp: 1416181833 Bench: 7694316. Also after 1440 GAMES. (THREE 480 GAMES TEST IN ONE) its score was:

Against : Houdini 4.0 St. Ct0 (3227) = 59.06% ; Komodo 8 (3266) = 56.77%, Gull 3 XP (3199) = 61.98%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3296

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 131214 : 480 Games.

Timestamp: 1418455357 Bench: 8116521

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

Stockfish 131214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 131214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 24.5 - 15.5 +15/=19/-6 61.25%
Stockfish 131214 64 POPCNT_ - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%

Time Control= 2+2

Stockfish 131214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 131214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 21.5 - 18.5 +8/=27/-5 53.75%
Stockfish 131214 64 POPCNT_ - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%

Score using 6 cores: 148.0 – 92.0= 61.67%

240 Games =
http://www.mediafire.com/download/i5egv ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 131214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 20.5 - 19.5 +5/=31/-4 51.25%
Stockfish 131214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 131214 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +11/=28/-1 62.50%

Time Control= 2+2

Stockfish 131214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 21.5 - 18.5 +11/=21/-8 53.75%
Stockfish 131214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 22.0 - 18.0 +8/=28/-4 55.00%
Stockfish 131214 64 POPCNT_ - Gull 3 x64 XP 27.5 - 12.5 +17/=21/-2 68.75%

Score using 4 cores: 138.5 – 101.5= 57.71%

240 Games:
http://www.mediafire.com/download/55v62 ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 143.0 – 97.0 = 59.58%
Incremental TC = 143.5 – 96.5 = 59.79%

GLOBAL SCORE: 286.5 – 103.5= 59.69%

Against : Houdini 4.0 St. Ct0 (3227) = 56.56% ; Komodo 8 (3266) = 56.25%, Gull 3 XP (3199) =
66.25%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3299


Error bars= +/- 23 EEP

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCK-FISH-6_6ST: 1440 GAMES. (THREE 480 GAMES TESTS IN ONE).

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

Stock-fish-6 6ST_IP - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +9/=26/-5 55.00%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +5/=32/-3 52.50%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 26.0 - 14.0 +12/=28/-0 65.00%

Stock-fish-6 6ST_IP - Houdini 4 x64_st_X6_CT0 44.5 - 35.5 +17/=55/-8 55.63%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_6_NOB 47.5 - 32.5 +25/=45/-10 59.38%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 57.5 - 22.5 +38/=39/-3 71.88%

Time Control= 2+2

Stock-fish-6 6ST_IP - Houdini 4 x64_st_X6_CT0 25.5 - 14.5 +15/=21/-4 63.75%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_6_NOB 18.5 - 21.5 +6/=25/-9 46.25%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 22.0 - 18.0 +8/=28/-4 55.00%

Stock-fish-6 6ST_IP - Houdini 4 x64_st_X6_CT0 43.5 - 36.5 +20/=47/-13 54.38%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_6_NOB 45.0 - 35.0 +19/=52/-9 56.25%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 50.0 - 30.0 +25/=50/-5 62.50%

Score using 6 cores: 428.5 – 291.5= 59.51%

720 Games:
http://www.mediafire.com/download/gb...6_720Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stock-fish-6 6ST_IP - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +12/=25/-3 61.25%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +9/=29/-2 58.75%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%

Stock-fish-6 6ST_IP - Houdini 4 Pro x64-A_OK 48.0 - 32.0 +23/=50/-7 60.00%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_4_NOB 40.0 - 40.0 +17/=46/-17 50.00%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 54.0 - 26.0 +34/=40/-6 67.50%

Time Control= 2+2

Stock-fish-6 6ST_IP - Houdini 4 Pro x64-A_OK 26.0 - 14.0 +16/=20/-4 65.00%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +12/=25/-3 61.25%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 27.5 - 12.5 +16/=23/-1 68.75%

Stock-fish-6 6ST_IP - Houdini 4 Pro x64-A_OK 52.5 - 27.5 +28/=49/-3 65.63%
Stock-fish-6 6ST_IP - Komodo 8 64-bit_4_NOB 41.0 - 39.0 +16/=50/-14 51.25%
Stock-fish-6 6ST_IP - Gull 3 x64 XP 51.5 - 28.5 +30/=43/-7 64.38%


Score using 4 cores: 433.5 – 286.5 = 60.21%

720 Games=
http://www.mediafire.com/download/8n...4_720games.pgn

Segmenting by Time Control:

Fixed TC = 434.0 - 286.0 = 60.28%
Incremental TC = 427.5 – 292.5 = 59.37%

GLOBAL SCORE: 861.5 – 578.5 = 59.82%

Against : Houdini 4.0 St. Ct0 (3227) = 60.08% ; Komodo 8 (3266) = 54.45%, Gull 3 XP (3199) = 64.84%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3300


Error bars= +/- 13 EEP

This is an extremely strong SF compile. Thanks Ipman!. :D

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 221214 : 480 Games.

Timestamp: 1419233587 Bench: 9498821

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0
Stockfish 221214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 221214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 20.0 - 20.0 +9/=22/-9 50.00%
Stockfish 221214 64 POPCNT_ - Gull 3 x64 XP 26.5 - 13.5 +15/=23/-2 66.25%

Time Control= 2+2

Stockfish 221214 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +12/=26/-2 62.50%
Stockfish 221214 64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 221214 64 POPCNT_ - Gull 3 x64 XP 20.5 - 19.5 +7/=27/-6 51.25%

Score using 6 cores: 139.0 – 101.0= 57.92%

240 Games =
http://www.mediafire.com/download/k3k9c ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 221214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 221214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 221214 64 POPCNT_ - Gull 3 x64 XP 22.5 - 17.5 +9/=27/-4 56.25%

Time Control= 2+2

Stockfish 221214 64 POPCNT_ - Houdini 4 Pro x64-A_OK 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 221214 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 221214 64 POPCNT_ - Gull 3 x64 XP 28.5 - 11.5 +18/=21/-1 71.25%
Score using 4 cores: 144.5 – 95.5= 60.21%

240 Games:
http://www.mediafire.com/download/1u076 ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 140.0 –100.0 = 58.33%
Incremental TC = 143.5 – 96.5 = 59.79%

GLOBAL SCORE: 283.5 – 106.5= 59.06%

Against : Houdini 4.0 St. Ct0 (3227) = 60.31% ; Komodo 8 (3266) = 55.62%, Gull 3 XP (3199) =
61.25%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3294


Error bars= +/- 23 EEP

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 221214MZ : 480 Games.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF221214MZ x64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +14/=24/-2 65.00%
SF221214MZ x64 POPCNTx6 - Komodo 8 64-bit_6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
SF221214MZ x64 POPCNTx6 - Gull 3 x64 XP 25.5 - 14.5 +14/=23/-3 63.75%

Time Control= 2+2

SF221214MZ x64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +13/=21/-6 58.75%
SF221214MZ x64 POPCNTx6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +10/=28/-2 60.00%
SF221214MZ x64 POPCNTx6 - Gull 3 x64 XP 29.0 – 11.0 +19/=20/-1 72.50%

Score using 6 cores: 151.5 – 81.5= 63.12%

240 Games =


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF221214MZ x64 POPCNTx4 - Houdini 4 Pro x64-A_OK 21.0 - 19.0 +5/=32/-3 52.50%
SF221214MZ x64 POPCNTx4 - Komodo 8 64-bit_4_NOB 22.0 - 18.0 +10/=24/-6 55.00%
SF221214MZ x64 POPCNTx4 - Gull 3 x64 XP 25.5 - 14.5 +16/=19/-5 63.75%

Time Control= 2+2

SF221214MZ x64 POPCNTx4 - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +15/=19/-6 61.25%
SF221214MZ x64 POPCNTx4 - Komodo 8 64-bit_4_NOB 22.5 - 17.5 +10/=25/-5 56.25%
SF221214MZ x64 POPCNTx4 - Gull 3 x64 XP 28.0 - 12.0 +16/=24/-0 70.00%

Score using 4 cores: 143.5 – 96.5= 59.79%
240 Games:
http://www.mediafire.com/download/9bcab ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 143.5 –94.5 = 59.79%
Incremental TC = 151.5 – 88.5 = 63.12%

GLOBAL SCORE: 295.0 – 185.0= 61.46%

Against : Houdini 4.0 St. Ct0 (3227) = 59.37% ; Komodo 8 (3266) = 57.50%, Gull 3 XP (3199) = 67.50%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3311


Error bars= +/- 23 EEP

This compile has clearly broken all the records in my tests. Well done, Marco Z! :D Before trumpeting that this is the new number one SF compile under my testing conditions, lets repeat this test until 1.400 games, where the score will be much more reliable, with error bars of only +/- 13.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 221214MZ : Test 2 and 3. Games 481 to 1440.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF221214MZ x64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 48.5 - 31.5 +25/=47/-8 60.63%
SF221214MZ x64 POPCNTx6 - Komodo 8 64-bit_6_NOB 46.5 - 33.5 +27/=39/-14 58.13%
SF221214MZ x64 POPCNTx6 - Gull 3 x64 XP 48.5 - 31.5 +26/=45/-9 60.63%

Time Control= 2+2

SF221214MZ x64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 48.5 - 31.5 +27/=43/-10 60.63%
SF221214MZ x64 POPCNTx6 - Komodo 8 64-bit_6_NOB 47.5 - 32.5 +24/=47/-9 59.38%
SF221214MZ x64 POPCNTx6 - Gull 3 x64 XP 50.0 - 30.0 +28/=44/-8 62.50%

Score using 6 cores: 289.5 – 190.5 = 60.31%

480 Games =
http://www.mediafire.com/download/y3xzj ... est2_3.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF221214MZ x64 POPCNTx4 - Houdini 4 Pro x64-A_OK 46.0 - 34.0 +20/=52/-8 57.50%
SF221214MZ x64 POPCNTx4 - Komodo 8 64-bit_4_NOB 50.5 - 29.5 +29/=43/-8 63.13%
SF221214MZ x64 POPCNTx4 - Gull 3 x64 XP 52.0 - 28.0 +31/=42/-7 65.00%

Time Control= 2+2

SF221214MZ x64 POPCNTx4 - Houdini 4 Pro x64-A_OK 49.5 - 30.5 +26/=47/-7 61.88%
SF221214MZ x64 POPCNTx4 - Komodo 8 64-bit_4_NOB 45.5 - 34.5 +18/=55/-7 56.88%
SF221214MZ x64 POPCNTx4 - Gull 3 x64 XP 51.5 - 28.5 +27/=49/-4 64.38%
Score using 4 cores: 295.0 – 185.0 = 61.46%

480 Games:
http://www.mediafire.com/download/9ppv4 ... est2_3.pgn

Segmenting by Time Control:

Fixed TC = 292.0 – 188.0 = 60.83%
Incremental TC = 292.5 – 187.5= 60.94%

GLOBAL SCORE: 584.5 – 375.5= 60.88%

Against : Houdini 4.0 St. Ct0 (3227) = 60.16% ; Komodo 8 (3266) = 59.38%, Gull 3 XP (3199) =
63.13%

Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3307


Tests 2 and 3, with 960 additional games, have confirmed the exceptional strength of this compile.


------------------

SUMMARY OF TESTS 1, 2 AND 3 FOR STOCKFISH 221214 MZ AFTER 1440 GAMES.

GLOBAL SCORE: 879.5 – 560.5 = 61.08%

Against : Houdini 4.0 St. Ct0 (3227) = 59.90% ; Komodo 8 (3266) = 58.75%, Gull 3 XP (3199) =
64.59%

Average Estimated Elo Opponents = 3231

Estimated Elo Performance= 3309


Error Bars +/- 13

After 1440 games –around 200 computer hours non stop work- the tests show that this compile is stronger than any other compile or engine, under my testing environment. Only as a reference:

- 9 ELO points stronger than Stock-Fish SF6, my second best.
- 15 ELO points stronger than SF 221214 Development
- 43 ELO points stronger than Komodo 8
- 82 ELO points stronger than Houdini 4 and
- 110 ELO points stronger than Gull 3 XP.

Congratulations to the Stockfish Team for their great work and to Marco Z. for this amazing compile.

Regards from Barcelona.

Tom.