Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH IPMAN COMPILE 150514 = 480 GAMES.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control = 4+0

SF 150514IPx 64 SSE4.2_ - Houdini 4 x64_st_X6_CT0 19.0 - 21.0 +7/=24/-9 47.50%
SF 150514IPx 64 SSE4.2_ - Komodo TCECr 64-bitNOB 24.5 - 15.5 +12/=25/-3 61.25%
SF 150514IPx 64 SSE4.2_ - Gull 3 x64 XP 27.0 - 13.0 +15/=24/-1 67.50%

Time Control= 2+2

SF 150514IPx 64 SSE4.2_ - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +8/=28/-4 55.00%
SF 150514IPx 64 SSE4.2_ - Komodo TCECr 64-bitNOB 25.5 - 14.5 +15/=21/-4 63.75%
SF 150514IPx 64 SSE4.2_ - Gull 3 x64 XP 21.5 - 18.5 +8/=27/-5 53.75%

Score using 6 cores: 139.5– 100.5 = 58.15%
240 Games = http://www.mediafire.com/view/r8stxfjim ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0


SF 150514IPx 64 SSE4.2_ - Houdini 4 Pro x64_Ct0_OK 22.0 - 18.0 +10/=24/-6 55.00%
SF 150514IPx 64 SSE4.2_ - Komodo TCECr 64-bit_NOBx4 25.0 - 15.0 +15/=20/-5 62.50%
SF 150514IPx 64 SSE4.2_ - Gull 3 x64 XP 22.0 - 18.0 +10/=24/-6 55.00%

Time Control: 2+2

SF 150514IPx 64 SSE4.2_ - Houdini 4 Pro x64_Ct0_OK 18.5 - 21.5 +8/=21/-11 46.25%
SF 150514IPx 64 SSE4.2_ - Komodo TCECr 64-bit_NOBx4 23.0 - 17.0 +12/=22/-6 57.50%
SF 150514IPx 64 SSE4.2_ - Gull 3 x64 XP 23.5 - 16.5 +14/=19/-7 58.75%

Score using 4 Cores= 134.0 – 106.0 = 55.83%
240 Games:
http://www.mediafire.com/view/rcu7pvk69 ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 139.5 – 100.5 = 58.15%
Incremental TC = 134.0 – 106.0 = 55.83%

Global Score= 273.5 – 206.5 = 56.98%

Against : Houdini 4.0 St. Ct0 (3227) = 50.94% ; Komodo TCECr (3181) = 61.25% Gull 3 XP (3199) = 58.75%

Average Estimated Elo Opponents = 3202
Estimated Elo Performance= 3251

Error bars= +/- 23 EEP

Not a good test for this compile. It is 30 Elo Points below the other Ipman’s compile that leads my tests: 270414.

Regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 170514 = 480 GAMES

Bench: 8732553 Timestamp: 1400360347

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

Stockfish 170514 64 SSE4.2D - Houdini 4 x64_st_X6 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 170514 64 SSE4.2D - Komodo TCECr 64-bit 27.0 - 13.0 +19/=16/-5 67.50%
Stockfish 170514 64 SSE4.2D - Gull 3 x64 XP 23.0 - 17.0 +10/=26/-4 57.50%

Time Control= 2+2

Stockfish 170514 64 SSE4.2D - Houdini 4 x64_st_X6 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 170514 64 SSE4.2D - Komodo TCECr 64-bit 26.0 - 14.0 +13/=26/-1 65.00%
Stockfish 170514 64 SSE4.2D - Gull 3 x64 XP 22.5 - 17.5 +12/=21/-7 56.25%

Score using 6 cores: 144.5 – 95.5 = 60.21%
240 Games:
http://www.mediafire.com/view/ffbw5a3nj ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 170514 64 SSE4.2D - Houdini 4 Pro x64_Ct0 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 170514 64 SSE4.2D - Komodo TCECr 64-bit 27.0 - 13.0 +18/=18/-4 67.50%
Stockfish 170514 64 SSE4.2D - Gull 3 x64 XP 27.5 - 12.5 +17/=21/-2 68.75%

Time Control: 2+2

Stockfish 170514 64 SSE4.2D - Houdini 4 Pro x64_Ct0 19.5 - 20.5 +5/=29/-6 48.75%
Stockfish 170514 64 SSE4.2D - Komodo TCECr 64-bit 27.0 - 13.0 +18/=18/-4 67.50%
Stockfish 170514 64 SSE4.2D - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 4 Cores= 147.5 – 92.5 = 61.46%
240 Games:
http://www.mediafire.com/view/g6bse2d0u ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 148.5 – 91.5 = 61.87%
Incremental TC = 143.0 – 97.0 = 59.58%

Global Score= 291.5 – 178.5 = 60.73%

Against : Houdini 4.0 St. Ct0 (3227) = 53.44% ; Komodo TCECr (3181) = 66.87% , Gull 3 XP (3199) = 61.87%

Average Estimated Elo Opponents = 3202
Estimated Elo Performance= 3277

Error bars= +/- 23 EEP

This is the second best register ever in my tests. Only 4 Elo points below the top scorer. It seems that, under my testing conditions, the latest SF are consolidating around 45 Elo Points above Houdini 4.

Regards,

Tom.
Top
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by JJJ »

That's mean H5 need to get at least 80 ELO to be the king next time.
Top
Vinvin
Posts: 5300
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Vinvin »

JJJ wrote:That's mean H5 need to get at least 80 ELO to be the king next time.
We have no news from Robert Houdart and that's a really bad news. Remember SMK, Vasik, ... ? No news from some months and then no news for some years ...
Top
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by JJJ »

Yeah... But I don't want a bad ending for Houdini =(
Top
User avatar
Ozymandias
Posts: 1537
Joined: Sun Oct 25, 2009 2:30 am

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Ozymandias »

I don't see how H4 could ever be a bad ending for the Houdini line. It's the strongest and more feature rich version to date. The only one I ever cared to buy, really.
Top
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Dr.Wael Deeb »

JJJ wrote:That's mean H5 need to get at least 80 ELO to be the king next time.
Won't happen....

He's not that talanted....
Dr.D
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH ROCKWOOD COMPILE 190514 = 480 GAMES.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat –Limit 5 moves-
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 30.42
Knodes per second: 14602

Time Control= 4+0

StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 25.5 - 14.5 +15/=21/-4 63.75%
StockfishRW 190514 SSE4.2_ - Komodo TCECr 64-bitNOB 25.5 - 14.5 +15/=21/-4 63.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 23.0 - 17.0 +9/=28/-3 57.50%

Time Control= 2+2

StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 24.0 - 16.0 +15/=18/-7 60.00%
StockfishRW 190514 SSE4.2_ - Komodo TCECr 64-bitNOB 27.0 - 13.0 +16/=22/-2 67.50%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 24.0 - 16.0 +13/=22/-5 60.00%

240 Games =
http://www.mediafire.com/view/z9mib79vb ... 0Games.pgn
Score using 6 Cores= 149.0 – 91.0= 62.08%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat – Limit 5 moves -
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control = 4+0

StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64_Ct0 25.5 - 14.5 +15/=21/-4 63.75%
StockfishRW 190514 SSE4.2_ - Komodo TCECr 64-bit_NOB 25.5 - 14.5 +17/=17/-6 63.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 24.5 - 15.5 +13/=23/-4 61.25%

Time Control= 2+2

StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64_Ct0 25.5 - 14.5 +14/=23/-3 63.75%
StockfishRW 190514 SSE4.2_ - Komodo TCECr 64-bit_NOB 23.5 - 16.5 +11/=25/-4 58.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 26.5 - 13.5 +16/=21/-3 66.25%

240 Games=
http://www.mediafire.com/view/rm93lm69p ... 0games.pgn
Score using 4 Cores= 151.0 - 89.0= 62.92%

Segmenting by Time Control:

Fixed TC = 149.5 – 90.5 = 62.29%
Incremental TC = 150.5 – 89.5= 62.71%

Global Score= 300.0 – 180.0= 62.50%

Against : Houdini 4.0 St. Ct0 (3227)= 62.81%; Komodo TCECr (3181) = 63.44% ; Gull 3.0 XP (3199)= 61.25%

Average Estimated Elo Opponents = 3202
Estimated Elo Performance= 3289

Error bars= +/- 23 EEP

THIS IS THE NEW BEST SCORE EVER IN MY TESTS, 8 EEP above the previous leader SF Ipman’s 270414.

Please note that according to my tests, something substantial has happened with Stockfish in the last four weeks, from SF 210414 -Bench: 7384368 Timestamp: 1398083427- to SF 170514 Bench: 8732553 Timestamp: 1400360347.

Both the SF Development and the fast RW and Ipman’s compiles have improved on average around 25 EEP in this short period of time. Amazing!!.

My congratulations again to the SF Team for this impressive performance. And to the compilers of RW and Ipman's for providing this useful benchmark that allows to evaluate SF progression with a narrow margin of error.

Regards,

Tom.
Top
User avatar
Ozymandias
Posts: 1537
Joined: Sun Oct 25, 2009 2:30 am

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Ozymandias »

Yes, it had stopped since the end of January, but it looks like it's gaining pace again. Damn!
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 250514 = 480 GAMES

Bench: 8321835 Timestamp: 1400970106

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

Stockfish 250514 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 250514 64 SSE4.2D - Komodo 7 64-bitx6_NOB 22.5 - 17.5 +14/=17/-9 56.25%
Stockfish 250514 64 SSE4.2D - Gull 3 x64 XP 23.5 - 16.5 +14/=19/-7 58.75%

Time Control= 2+2

Stockfish 250514 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 250514 64 SSE4.2D - Komodo 7 64-bitx6_NOB 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 250514 64 SSE4.2D - Gull 3 x64 XP 24.0 - 16.0 +14/=20/-6 60.00%

Score using 6 cores: 140.5 – 99.5 = 58.54%
240 Games: http://www.mediafire.com/view/a7ugm3gfd ... 0Games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 250514 64 SSE4.2D - Houdini 4 Pro x64_Ct0_OK 19.5 - 20.5 +9/=21/-10 48.75%
Stockfish 250514 64 SSE4.2D - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +18/=14/-8 62.50%
Stockfish 250514 64 SSE4.2D - Gull 3 x64 XP 23.0 - 17.0 +15/=16/-9 57.50%

Time Control: 2+2

Stockfish 250514 64 SSE4.2D - Houdini 4 Pro x64_Ct0_OK 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 250514 64 SSE4.2D - Komodo 7 64-bitx4_NOB 26.5 - 13.5 +18/=17/-5 66.25%
Stockfish 250514 64 SSE4.2D - Gull 3 x64 XP 22.5 - 17.5 +12/=21/-7 56.25%

Score using 4 Cores= 140.0 – 100.0 = 58.33%
240 Games:
http://www.mediafire.com/view/2puu6kaiv ... 0games.pgn

Segmenting by Time Control:

Fixed TC = 139.5 – 100.5 = 58.12%
Incremental TC = 141.0 – 99.0 = 58.75%

Global Score= 58.44%

Against : Houdini 4.0 St. Ct0 (3227) = 56.87% ; Komodo 7 (3206) = 60.31%, Gull 3 XP (3199) = 58.12%

Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3270

Error bars= +/- 23 EEP

19 Elo points below the top scorer Stockfish Rockwood 190514, within error bars.

Regards,

Tom.
Top

Return to “Computer Chess Club: Tournaments and Matches”