Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH MZ130814a AVX = 480 GAMES

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SFMZ130814a x64 AVX SSE4.2_ - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +9/=26/-5 55.00%
SFMZ130814a x64 AVX SSE4.2_ - Komodo 7 64-bitx6_NOB 22.5 - 17.5 +10/=25/-5 56.25%
SFMZ130814a x64 AVX SSE4.2_ - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%

Time Control= 2+2

SFMZ130814a x64 AVX SSE4.2_ - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +7/=27/-6 51.25%
SFMZ130814a x64 AVX SSE4.2_ - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +11/=26/-3 60.00%
SFMZ130814a x64 AVX SSE4.2_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%

Score using 6 cores: 140.0 – 100.0= 58.33%
240 Games =
http://www.mediafire.com/view/kckr33omd ... 0Games.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SFMZ130814a x64 AVX SSE4.2_ - Houdini 4 Pro x64-A_OK 25.5 - 14.5 +12/=27/-1 63.75%
SFMZ130814a x64 AVX SSE4.2_ - Komodo 7 64-bitx4_NOB 24.0 - 16.0 +13/=22/-5 60.00%
SFMZ130814a x64 AVX SSE4.2_ - Gull 3 x64 XP 28.0 - 12.0 +17/=22/-1 70.00%

Time Control: 2+2
SFMZ130814a x64 AVX SSE4.2_ - Houdini 4 Pro x64-A_OK 17.5 - 22.5 +6/=23/-11 43.75%
SFMZ130814a x64 AVX SSE4.2_ - Komodo 7 64-bitx4_NOB 22.5 - 17.5 +9/=27/-4 56.25%
SFMZ130814a x64 AVX SSE4.2_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%

Score using 4 cores: 142.5 – 97.5= 59.37%
240 Games:
http://www.mediafire.com/view/7rprpwgvb ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 148.0 – 92.0= 61.67% (EEP = 3293)
Incremental TC = 134.5 – 105.5= 56.04% (EEP = 3253)

Global Score= 282.5 – 107.5 = 58.86%

Against : Houdini 4.0 St. Ct0 (3227) = 53.44%; Komodo 7 (3206) = 58.12%, Gull 3 XP (3199) = 65.00%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3273


Error bars= +/- 23 EEP

Please note the big difference in performance between Fixed and Incremental time controls.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH IPMAN 220814IPx = GAMES 1 to 480

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +15/=20/-5 62.50%
SF 220814IPx_6 - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +12/=24/-4 60.00%
SF 220814IPx_6 - Gull 3 x64 XP 25.0 - 15.0 +12/=26/-2 62.50%

Time Control= 2+2

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
SF 220814IPx_6 - Komodo 7 64-bitx6_NOB 26.5 - 13.5 +16/=21/-3 66.25%
SF 220814IPx_6 - Gull 3 x64 XP 27.5 - 12.5 +16/=23/-1 68.75%

Score using 6 cores: 153.0 – 87.0= 63.75%
240 Games =
http://www.mediafire.com/view/l0hyu1goi ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 23.5 - 16.5 +11/=25/-4 58.75%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 25.0 - 15.0 +16/=18/-6 62.50%
SF 220814IPx_4 - Gull 3 x64 XP 21.5 - 18.5 +10/=23/-7 53.75%

Time Control: 2+2

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 21.5 - 18.5 +8/=27/-5 53.75%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 24.5 - 15.5 +13/=23/-4 61.25%
SF 220814IPx_4 - Gull 3 x64 XP 23.0 - 17.0 +11/=24/-5 57.50%

Score using 4 Cores= 139.0 – 101.0 = 57.92%
240 Games:
http://www.mediafire.com/view/wilt67aci ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 144.0 – 96.0 = 60.00%
Incremental TC = 148.0 – 92.00 = 61.67%

Global Score= 292.0 – 188.0 = 60.83%

Against : Houdini 4.0 St. Ct0 (3227) = 59.37%; Komodo 7 (3206) = 62.50%, Gull 3 XP (3199) = 60.62%

Average Estimated Elo Opponents= 3211
Estimated Elo Performance= 3287


Error bars= +/- 23 EEP

This is an extremely strong compile. I will repeat the test to reduce the statistical error bars. Well done, Ipman!.

Regards from Barcelona.

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH IPMAN 220814IPx = GAMES 481 to 960

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +10/=23/-7 53.75%
SF 220814IPx_6 - Komodo 7 64-bitx6 26.0 - 14.0 +14/=24/-2 65.00%
SF 220814IPx_6 - Gull 3 x64 XP 28.0 - 12.0 +21/=14/-5 70.00%

Time Control= 2+2

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +11/=24/-5 57.50%
SF 220814IPx_6 - Komodo 7 64-bitx6 21.5 - 18.5 +7/=29/-4 53.75%
SF 220814IPx_6 - Gull 3 x64 XP 22.5 - 17.5 +9/=27/-4 56.25%

Score using 6 cores: 142.5 – 97.5= 59.37%

240 Games =
http://www.mediafire.com/view/jczb1a...0Games_bis.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +11/=22/-7 55.00%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 25.0 - 15.0 +15/=20/-5 62.50%
SF 220814IPx_4 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%

Time Control: 2+2

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +8/=30/-2 57.50%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 25.5 - 14.5 +15/=21/-4 63.75%
SF 220814IPx_4 - Gull 3 x64 XP 25.5 - 14.5 +14/=23/-3 63.75%

Score using 4 Cores= 146.5 – 93.5 = 61.04%

240 Games:
http://www.mediafire.com/view/l08oxt...0games_BIS.pgn

Segmenting by Time Control:

Fixed TC = 148.0 – 92.0 = 61.67%
Incremental TC = 141.0 – 99.00 = 58.75%

Global Score= 289.0 – 191.0 = 60.21%

Against : Houdini 4.0 St. Ct0 (3227) = 55.94%; Komodo 7 (3206) = 61.25%, Gull 3 XP (3199) = 63.44%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3282


Error bars= +/- 23 EEP

Again a good score for this compile.


TOTAL SCORE FOR STOCKFISH IPMAN 220814IPx AFTER 960 GAMES:

Global Score= 581.0 – 379.0 = 60.52%

Against : Houdini 4.0 St. Ct0 (3227) = 57.66%; Komodo 7 (3206) =61.87% Gull 3 XP (3199) = 62.03%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3285


Error bars= +/- 16 EEP

This is the strongest Stockfish Compile I have tested so far. :D

Regards,

Tom.
carldaman
Posts: 2287
Joined: Sat Jun 02, 2012 2:13 am

Re: Testing Stockfish 11-03-13. 480 Games.

Post by carldaman »

Tomcass wrote:TESTING STOCKFISH IPMAN 220814IPx = GAMES 481 to 960

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +10/=23/-7 53.75%
SF 220814IPx_6 - Komodo 7 64-bitx6 26.0 - 14.0 +14/=24/-2 65.00%
SF 220814IPx_6 - Gull 3 x64 XP 28.0 - 12.0 +21/=14/-5 70.00%

Time Control= 2+2

SF 220814IPx_6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +11/=24/-5 57.50%
SF 220814IPx_6 - Komodo 7 64-bitx6 21.5 - 18.5 +7/=29/-4 53.75%
SF 220814IPx_6 - Gull 3 x64 XP 22.5 - 17.5 +9/=27/-4 56.25%

Score using 6 cores: 142.5 – 97.5= 59.37%

240 Games =
http://www.mediafire.com/view/jczb1a...0Games_bis.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +11/=22/-7 55.00%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 25.0 - 15.0 +15/=20/-5 62.50%
SF 220814IPx_4 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%

Time Control: 2+2

SF 220814IPx_4 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +8/=30/-2 57.50%
SF 220814IPx_4 - Komodo 7 64-bitx4_NOB_OK 25.5 - 14.5 +15/=21/-4 63.75%
SF 220814IPx_4 - Gull 3 x64 XP 25.5 - 14.5 +14/=23/-3 63.75%

Score using 4 Cores= 146.5 – 93.5 = 61.04%

240 Games:
http://www.mediafire.com/view/l08oxt...0games_BIS.pgn

Segmenting by Time Control:

Fixed TC = 148.0 – 92.0 = 61.67%
Incremental TC = 141.0 – 99.00 = 58.75%

Global Score= 289.0 – 191.0 = 60.21%

Against : Houdini 4.0 St. Ct0 (3227) = 55.94%; Komodo 7 (3206) = 61.25%, Gull 3 XP (3199) = 63.44%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3282


Error bars= +/- 23 EEP

Again a good score for this compile.


TOTAL SCORE FOR STOCKFISH IPMAN 220814IPx AFTER 960 GAMES:

Global Score= 581.0 – 379.0 = 60.52%

Against : Houdini 4.0 St. Ct0 (3227) = 57.66%; Komodo 7 (3206) =61.87% Gull 3 XP (3199) = 62.03%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3285


Error bars= +/- 16 EEP

This is the strongest Stockfish Compile I have tested so far. :D

Regards,

Tom.
Hi Tom,
Interesting results - thanks for your tests! :)
Hopefully IPman will release this compile. :wink:

Regards,
CL
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH MZ250814 = 480 GAMES

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF250814MZ x64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
SF250814MZ x64 SSE4.2_6 - Komodo 7 64-bitx6 27.5 - 12.5 +17/=21/-2 68.75%
SF250814MZ x64 SSE4.2_6 - Gull 3 x64 XP 23.5 - 16.5 +10/=27/-3 58.75%

Time Control= 2+2

SF250814MZ x64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +15/=17/-8 58.75%
SF250814MZ x64 SSE4.2_6 - Komodo 7 64-bitx6 25.5 - 14.5 +15/=21/-4 63.75%
SF250814MZ x64 SSE4.2_6 - Gull 3 x64 XP 24.5 - 15.5 +16/=17/-7 61.25%

Score using 6 cores: 149.0 – 91.0= 62.08%
240 Games =
http://www.mediafire.com/view/gnazg9...6_240Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages allowed.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF250814MZ x64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 21.5 - 18.5 +10/=23/-7 53.75%
SF250814MZ x64 SSE4.2_4 - Komodo 7 64-bitx4 27.0 - 13.0 +18/=18/-4 67.50%
SF250814MZ x64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +16/=20/-4 65.00%

Time Control: 2+2

SF250814MZ x64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +11/=22/-7 55.00%
SF250814MZ x64 SSE4.2_4 - Komodo 7 64-bitx4 25.5 - 14.5 +15/=21/-4 63.75%
SF250814MZ x64 SSE4.2_4 - Gull 3 x64 XP 24.5 - 15.5 +15/=19/-6 61.25%

Score using 4 cores: 146.5 – 93.5= 61.04%
240 Games:
http://www.mediafire.com/view/z5bmh2...Z_240games.pgn

Segmenting by Time Control:

Fixed TC = 150.0 – 90.0= 62.50
Incremental TC = 145.5 – 94.5 = 60.62%

Global Score= 295.5 -184.5= 61.56%

Against : Houdini 4.0 St. Ct0 (3227) = 57.19%; Komodo 7 (3206) = 65.94%, Gull 3 XP (3199) = 61.56%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3292


Error bars= +/- 23 EEP

This is the highest score ever of an engine in my tests. I will repeate it to reduce the error bars from 23 to 16. Congratulations, Am0s!.

SF250814MZ x64 SSE4.2= 3292
Stockfish 280614 Development = 3287
Stockfish 270714 IPMAN = 3284
Stockfish RockWood 190514 = 3283
Stockfish 100814 64 SSE4.2 Development = 3277
Stockfish 5 64 SSE4.2 = 3272
Houdini 4.0 = 3227
Komodo 7 = 3206
Gull 3 XP = 3199
Critter 1.6a = 3104
Deep Rybka 4.1 = 3015

Regards,

Tom.
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by JJJ »

Hello. Where can we Download this version ?
User avatar
Ajedrecista
Posts: 2141
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Ajedrecista »

Hello Jean:
JJJ wrote:Hello. Where can we Download this version ?
Please take a look here:

http://immortalchess.net/forum/showpost.php?p=529003

It is the post #416 of this thread.
AmOs 4EvEr wrote:SF250814MZ-SF250814aMZ.
SF250814MZ x64 AVX SSE4.2
SF250814MZ x64 SSE4.2
SF250814MZ x64
SF250814MZ 32 sse
SF250814MZ 32 old
SF250814MZ 32
___________________________
SF250814aMZ x64 AVX SSE4.2
SF250814aMZ x64 SSE4.2
SF250814aMZ x64
SF250814aMZ 32 sse
SF250814aMZ 32 old
SF250814aMZ 32
____________________
Thanks to my friends Tomcass & Slankamen and paulied for testing!

https://www.dropbox.com/s/zuf241zyf7...14aMZ.rar?dl=0
https://www.sendspace.com/file/gfgh66
http://www.mediafire.com/download/ni...F250814aMZ.rar

Enjoy your testing ;)

Regards

M.Z
Regards from Spain.

Ajedrecista.
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by JJJ »

Hello, and Thanks you very much Ajedrecista !
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH MZ250814 = GAMES 481 to 960

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF250814MZ x64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +14/=24/-2 65.00%
SF250814MZ x64 SSE4.2_6 - Komodo 7 64-bitx6 23.5 - 16.5 +12/=23/-5 58.75%
SF250814MZ x64 SSE4.2_6 - Gull 3 x64 XP 23.5 - 16.5 +13/=21/-6 58.75%

Time Control= 2+2

SF250814MZ x64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 24.0 - 16.0 +13/=22/-5 60.00%
SF250814MZ x64 SSE4.2_6 - Komodo 7 64-bitx6 25.0 - 15.0 +14/=22/-4 62.50%
SF250814MZ x64 SSE4.2_6 - Gull 3 x64 XP 23.0 - 17.0 +9/=28/-3 57.50%

Score using 6 cores: 145.0 – 95.0= 60.42%
240 Games =
http://www.mediafire.com/view/j1mb5b...0Games_BIS.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages= Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0
SF250814MZ x64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 27.5 - 12.5 +16/=23/-1 68.75%
SF250814MZ x64 SSE4.2_4 - Komodo 7 64-bitx4 25.5 - 14.5 +16/=19/-5 63.75%
SF250814MZ x64 SSE4.2_4 - Gull 3 x64 XP 24.5 - 15.5 +13/=23/-4 61.25%

Time Control: 2+2

SF250814MZ x64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +11/=27/-2 61.25%
SF250814MZ x64 SSE4.2_4 - Komodo 7 64-bitx4 26.5 - 13.5 +14/=25/-1 66.25%
SF250814MZ x64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%

Score using 4 cores: 154.5 – 85.5= 64.37%
240 Games:
http://www.mediafire.com/view/pw8zsx...0games_BIS.pgn

Segmenting by Time Control:

Fixed TC = 150.5 – 89.5= 62.71%
Incremental TC = 149.0 – 91.0 = 62.08%

Global Score= 299.5 -180.5= 62.40%

Against : Houdini 4.0 St. Ct0 (3227) = 63.75%; Komodo 7 (3206) = 62.81%, Gull 3 XP (3199) = 60.62%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3298


Error bars= +/- 23 EEP

-------------------------------------------------------------

OVERALL SCORE FOR STOCKFISH MZ250814 AFTER 960 GAMES

Global Score= 595.0 – 365.0 = 61.98%

Against : Houdini 4.0 St. Ct0 (3227) = 60.47%; Komodo 7 (3206) = 64.37%, Gull 3 XP (3199) = 61.09%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3295

Error bars= +/- 16 EEP


CONFIRMED! In the second leg of my test –games 481 to 960- SF250814MZ x64 SSE4.2 has even improved its amazing score of the first leg.

This is is the highest score ever of an engine in my tests.

SF250814MZ x64 SSE4.2= 3295 (960 games)
Stockfish 280614 Development = 3287 (960 games)
Stockfish 270714 IPMAN = 3284 (960 games)
Stockfish RockWood 190514 = 3283 (480 games)
Stockfish 100814 64 SSE4.2 Development = 3277 (480 games)
Stockfish 5 64 SSE4.2 = 3272 (960 games)
Houdini 4.0 = 3227
Komodo 7 = 3206
Gull 3 XP = 3199
Critter 1.6a = 3104
Deep Rybka 4.1 = 3015

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 250814a MZ = 480 GAMES

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF250814aMZ x64 SSE4.2_BO - Houdini 4 x64_st_X6_CT0 26.5 - 13.5 +15/=23/-2 66.25%
SF250814aMZ x64 SSE4.2_BO - Komodo 7 64-bitx6 22.5 - 17.5 +8/=29/-3 56.25%
SF250814aMZ x64 SSE4.2_BO - Gull 3 x64 XP 24.5 - 15.5 +12/=25/-3 61.25%

Time Control= 2+2

201408Stockfish_250814aMZ_2+2_ 2014

SF250814aMZ x64 SSE4.2_BO - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +14/=21/-5 61.25%
SF250814aMZ x64 SSE4.2_BO - Komodo 7 64-bitx6 22.5 - 17.5 +10/=25/-5 56.25%
SF250814aMZ x64 SSE4.2_BO - Gull 3 x64 XP 27.5 - 12.5 +17/=21/-2 68.75%

Score using 6 cores: 148.0 – 92.0= 61.67%
240 Games =
http://www.mediafire.com/view/2jpp81...6_240Games.pgn



i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages= Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

SF250814aMZ x64 SSE4.2_BO - Houdini 4 Pro x64-A_OK 25.0 - 15.0 +15/=20/-5 62.50%
SF250814aMZ x64 SSE4.2_BO - Komodo 7 64-bitx4_ 26.5 - 13.5 +15/=23/-2 66.25%
SF250814aMZ x64 SSE4.2_BO - Gull 3 x64 XP 23.5 - 16.5 +11/=25/-4 58.75%

Time Control: 2+2

SF250814aMZ x64 SSE4.2_BO - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +13/=22/-5 60.00%
SF250814aMZ x64 SSE4.2_BO - Komodo 7 64-bitx4 26.0 - 14.0 +15/=22/-3 65.00%
SF250814aMZ x64 SSE4.2_BO - Gull 3 x64 XP 27.5 - 12.5 +17/=21/-2 68.75%

Score using 4 cores: 152.5 – 87.5= 63.54
240 Games:
http://www.mediafire.com/view/qx1r7l...Z_240games.pgn

Segmenting by Time Control:

Fixed TC = 148.5 – 91.5= 61.87%
Incremental TC = 152.0 – 88.0 = 60.62%

Global Score= 300.5 – 179.5= 62.60%

Against : Houdini 4.0 St. Ct0 (3227) = 62.50%; Komodo 7 (3206) = 60.94%, Gull 3 XP (3199) = 64.37%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3299


Error bars= +/- 23 EEP

Again a new highest score ever of an engine in my tests. 250814aMZ is a bit more tactical whereas 250814MZ is more positional. Simply AMAZING score and games!.


SF250814aMZ x64 SSE4.2= 3299 (480 games)
SF250814MZ x64 SSE4.2= 3295 (960 games)
Stockfish 280614 Development = 3287 (960 games)
Stockfish 270714 IPMAN = 3284 (960 games)
Stockfish RockWood 190514 = 3283 (480 games)
Stockfish 100814 64 SSE4.2 Development = 3277 (480 games)
Stockfish 5 64 SSE4.2 = 3272 (960 games)
Houdini 4.0 = 3227
Komodo 7 = 3206
Gull 3 XP = 3199
Critter 1.6a = 3104
Deep Rybka 4.1 = 3015

Great work, Am0s! :D :D :D

Regards,

Tom.