Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Jouni
Posts: 3677
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Jouni »

There was no change, that affect playing strength between RC1 to RC3 with ponder off! So each should score exactly same. But now in official site there are faster compiles - have You tried or only abrok ones?
Jouni
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Jouni wrote:There was no change, that affect playing strength between RC1 to RC3 with ponder off! So each should score exactly same. But now in official site there are faster compiles - have You tried or only abrok ones?
Hi, Jouni.

Abrok is an convenient place to find and test the latest SF. Anyway I will follow your sugestion and try the faster compiles you mentioned in the official site. Thanks!.

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Jouni wrote:There was no change, that affect playing strength between RC1 to RC3 with ponder off! So each should score exactly same. But now in official site there are faster compiles - have You tried or only abrok ones?
Hallo, Jouni.

I have not been able to find in the Official Site the faster SF compiles you mentioned. Could you -or any other member of the TalkChess community- help me, please?. Thanks in advance.

Tom.
Jouni
Posts: 3677
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Jouni »

Simply http://stockfishchess.org/download/ :) . These have been for some computers over 10% faster, but not for all.
Jouni
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Jouni wrote:Simply http://stockfishchess.org/download/ :) . These have been for some computers over 10% faster, but not for all.
Wooops! I feel a bit stupid. I already was into this page, but when I go to Development Builds ... I get the abrok site. :oops: I don't see where are the files you mentioned.

Thanks again, Jouni!

Tom-
Ron Langeveld
Posts: 140
Joined: Tue Jan 05, 2010 8:02 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Ron Langeveld »

Don't pick the development builds.
Pick one of the download links under 'Engine binaries'
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by beram »

Ron Langeveld wrote:Don't pick the development builds.
Pick one of the download links under 'Engine binaries'
Thx Ron, now I will rerun my matches with that 'official build'

and btw. what is your impression or do you have testresults of SF 6 ?

grts Bram
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Ron Langeveld wrote:Don't pick the development builds.
Pick one of the download links under 'Engine binaries'
I will. Thank you very much, Ron.

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH MZ 050215: 480 Games

6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF050215MZ 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +10/=27/-3 58.75%
SF050215MZ 64 POPCNT_6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +12/=24/-4 60.26%
SF050215MZ 64 POPCNT_6 - Gull 3 x64 XP 23.5 - 16.5 +10/=27/-3 58.75%

Time Control 2+2

SF050215MZ 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
SF050215MZ 64 POPCNT_6 - Komodo 8 64-bit_6_NOB 22.5 - 17.5 +9/=27/-4 56.25%
SF050215MZ 64 POPCNT_6 - Gull 3 x64 XP 27.5 - 12.5 +19/=17/-4 68.75%

Score using 6 cores: 144.5 – 95.5= 60.21%

240 Games:
http://www.mediafire.com/download/f4afm ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control = 4+0
SF050215MZ 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +9/=27/-4 56.25%
SF050215MZ 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +12/=24/-4 60.00%
SF050215MZ 64 POPCNTx4 - Gull 3 x64 XP 28.5 - 11.5 +18/=21/-1 71.25%

Time Control 2+2

SF050215MZ 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 23.5 - 16.5 +9/=29/-2 58.75%
SF050215MZ 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 22.5 - 17.5 +13/=19/-8 56.25%
SF050215MZ 64 POPCNTx4 - Gull 3 x64 XP 27.0 - 13.0 +14/=26/-0 67.50%

Score using 4 cores: 148.0 – 92.0= 61.67%

http://www.mediafire.com/download/z765j ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 146.0 – 94.0= 60.83%
Incremental TC = 146.5 – 93.5= 61.04%

Against : Houdini 4.0 St. Ct0 (3136) = 58.12% ; Komodo 8 (3153) = 58.18%, Gull 3 XP (3103) = 66.56%

GLOBAL SCORE: 292.5 – 187.5 = 60.94%

Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3208


Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH BULLET 070215: 480 Games

6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177


Time Control = 4+0

Stockfish 070215b 64 SSE42x - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
Stockfish 070215b 64 SSE42x - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +9/=26/-5 55.00%
Stockfish 070215b 64 SSE42x - Gull 3 x64 XP 28.0 - 12.0 +18/=20/-2 70.00%

Time Control 2+2

Stockfish 070215b 64 SSE42x - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 070215b 64 SSE42x - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +8/=26/-6 52.50%
Stockfish 070215b 64 SSE42x - Gull 3 x64 XP 23.5 - 16.5 +14/=19/-7 58.75%

Score using 6 cores: 144.0 – 96.0= 60.00%

240 Games:
http://www.mediafire.com/download/lrou4 ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control = 4+0

Stockfish 070215b 64 SSE42x - Houdini 4 Pro x64-A_OK 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 070215b 64 SSE42x - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 070215b 64 SSE42x - Gull 3 x64 XP 28.5 - 11.5 +19/=19/-2 71.25%

Time Control 2+2

Stockfish 070215b 64 SSE42x - Houdini 4 Pro x64-A_OK 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 070215b 64 SSE42x - Komodo 8 64-bit_4_NOB 25.0 - 15.0 +12/=26/-2 62.50%
Stockfish 070215b 64 SSE42x - Gull 3 x64 XP 28.0 - 12.0 +19/=18/-3 70.00%

Score using 4 cores: 155.0 – 85.0= 64.58%

http://www.mediafire.com/download/pmarl ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 151.5 – 88.5= 63.12%
Incremental TC = 147.5 – 92.5 = 61.49%

Against : Houdini 4.0 St. Ct0 (3136) = 62.19% ; Komodo 8 (3153) = 57.19%, Gull 3 XP (3103) = 67.50%

GLOBAL SCORE: 299.0 – 181.0 = 62.29%

Average Estimated Elo Opponents = 3131
Estimated Elo Performance= 3217


Error bars: +/- 23

Only 1 Elo Point below the higest score in my tests so far. Stockfish 6 (3218).

Regards,

Tom.