Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH IPMAN COMPILE 040214 IP = 480 GAMES.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

Stockfish 040214IP 64 SSE4.2L - Houdini 4 x64_st_X6 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 040214IP 64 SSE4.2L - Komodo TCECr 64-bitx6 22.5 - 17.5 +12/=21/-7 56.25%
Stockfish 040214IP 64 SSE4.2L - Critter 1.6a 64-bitX6 24.5 - 15.5 +13/=23/-4 61.25%

Time Control= 2+2

Stockfish 040214IP 64 SSE4.2L - Houdini 4 x64_st_X6 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 040214IP 64 SSE4.2L - Komodo TCECr 64-bitx6 21.5 - 18.5 +11/=21/-8 53.75%
Stockfish 040214IP 64 SSE4.2L - Critter 1.6a 64-bitX6 27.0 - 13.0 +17/=20/-3 67.50%

240 Games = http://www.mediafire.com/view/4bj46bgz4 ... 0games.pgn
Score using 6 Cores= 140.5 – 99.5 = 58.54%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control = 4+0

Stockfish 040214IP 64 SSE4.2L - Houdini 4 x64xCT0 20.5 - 19.5 +6/=29/-5 51.25%
Stockfish 040214IP 64 SSE4.2L - Komodo TCECr 64-bitx4 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 040214IP 64 SSE4.2L - Critter 1.6a 64-bitnob 28.5 - 11.5 +19/=19/-2 71.25%

Time Control= 2+2

Stockfish 040214IP 64 SSE4.2L - Houdini 4 x64xCT0 20.5 - 19.5 +10/=21/-9 51.25%
Stockfish 040214IP 64 SSE4.2L - Komodo TCECr 64-bitx4 26.5 - 13.5 +14/=25/-1 66.25%
Stockfish 040214IP 64 SSE4.2L - Critter 1.6a 64-bitnob 27.5 - 12.5 +18/=19/-3 68.75%
240 Games=
http://www.mediafire.com/view/rz6bhub76 ... amesx4.pgn
Score using 4 Cores= 146.5 – 93.5 = 61.04%

Segmenting by Time Control:

Fixed TC = 142.5 – 97.5 = 59.37%
Incremental TC = 144.5 – 95.5 = 60.21%

Global Score= 287.0 – 193.0 = 59.79%

Against : Houdini 4.0 St. Ct0 (3227) = 53.75% ; Komodo TCECr (3181) = 58.44% ; Critter 1.6a (3104) = 67.19%

Average Estimated Elo Opponents = 3171
Estimated Elo Performance= 3240

This is a good performance, 13 EEP better than the strongest Houdini 4.0 in my computers, but still 21 Elo points below the best compile I have tested so far (SF Ipman’s compile 290114 = 3261).

Regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH IPMAN COMPILE 080214 IPS = 480 GAMES.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

SF 080214IPS 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +14/=18/-8 57.50%
SF 080214IPS 64 SSE4.2L - Komodo TCECr 64-bitx6 25.5 - 14.5 +15/=21/-4 63.75%
SF 080214IPS 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 29.5 - 10.5 +21/=17/-2 73.75%

Time Control= 2+2

SF 080214IPS 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +9/=26/-5 55.00%
SF 080214IPS 64 SSE4.2L - Komodo TCECr 64-bitx6B 23.0 - 17.0 +8/=30/-2 57.50%
SF 080214IPS 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 29.0 - 11.0 +19/=20/-1 72.50%

240 Games = http://www.mediafire.com/view/gdnqk5d82 ... 0games.pgn

Score using 6 Cores= 152.0 – 88.0 = 63.33%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control = 4+0

SF 080214IPS 64 SSE4.2L - Houdini 4 x64xCT0 17.5 - 22.5 +8/=19/-13 43.75%
SF 080214IPS 64 SSE4.2L - Komodo TCECr 64-bitx4 25.0 - 15.0 +15/=20/-5 62.50%
SF 080214IPS 64 SSE4.2L - Critter 1.6a 64-bitnob 28.0 - 12.0 +19/=18/-3 70.00%

Time Control= 2+2

SF 080214IPS 64 SSE4.2L - Houdini 4 x64xCT0 20.5 - 19.5 +6/=29/-5 51.25%
SF 080214IPS 64 SSE4.2L - Komodo TCECr 64-bitx4 22.5 - 17.5 +10/=25/-5 56.25%
SF 080214IPS 64 SSE4.2L - Critter 1.6a 64-bitnob_4 26.5 - 13.5 +15/=23/-2 66.25%

240 Games= http://www.mediafire.com/view/lcna64z3w ... amesx4.pgn

Score using 4 Cores= 140.0 – 100.0 = 58.33%

Segmenting by Time Control:

Fixed TC = 148.5 -91.5 = 61.87%
Incremental TC = 143.5 – 96.5 = 59.79%

Global Score= 292.0 – 188.0 = 60.83%
Against : Houdini 4.0 St. Ct0 (3227) =51.87% ; Komodo TCECr (3181) = 60.00 % ; Critter 1.6a (3104) = 70.62%

Average Estimated Elo Opponents = 3171
Estimated Elo Performance= 3247

Regards,

Tom.
Top
Kohflote
Posts: 219
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Kohflote »

Hi Tom,

How are you? Is been about 2 weeks, miss your excellent tests.

Best Regards,
Koh, Kah Huat
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Hallo, my friend!

I am working in Latin America for three weeks. I will start testing again from March 3rd. Thanks for your interest!.

Best regards from Montevideo.

Tom.
Top
duncan
Posts: 12038
Joined: Mon Jul 07, 2008 10:50 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by duncan »

Tomcass wrote:Hallo, my friend!

I am working in Latin America for three weeks. I will start testing again from March 3rd. Thanks for your interest!.

Best regards from Montevideo.

Tom.
not easy waiting. if you can arrange a 3280 in march it will have been worth it. :)

duncan
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

duncan wrote:
Tomcass wrote:Hallo, my friend!

I am working in Latin America for three weeks. I will start testing again from March 3rd. Thanks for your interest!.

Best regards from Montevideo.

Tom.
not easy waiting. if you can arrange a 3280 in march it will have been worth it. :)

duncan
Thanks for your comment Duncan! :wink:

Not a 3280 by now, but an excellent 3261 EEP for the development version I tested. This is the score:

TESTING STOCKFISH DEVELOPMENT 010314 = 480 GAMES

Bench: 7990513 Timestamp: 1393712534

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

Stockfish 010314 64 SSE4.2x - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +8/=25/-7 51.25%
Stockfish 010314 64 SSE4.2x - Komodo TCECr 64-bitx6_NOB 25.0 - 15.0 +16/=18/-6 62.50%
Stockfish 010314 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 28.0 - 12.0 +16/=24/-0 70.00%

Time Control= 2+2

Stockfish 010314 64 SSE4.2x - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +11/=19/-10 51.25%
Stockfish 010314 64 SSE4.2x - Komodo TCECr 64-bitx6 27.0 - 13.0 +15/=24/-1 67.50%
Stockfish 010314 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 30.0 - 10.0 +22/=16/-2 75.00%


Score using 6 cores: 151.0 – 89.0 = 62.92%
240 Games:
http://www.mediafire.com/view/on3349d59 ... 0games.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 010314 64 SSE4.2x - Houdini 4 x64xCT0 20.5 - 19.5 +8/=25/-7 51.25%
Stockfish 010314 64 SSE4.2x - Komodo TCECr 64-bitx4 27.5 - 12.5 +19/=17/-4 68.75%
Stockfish 010314 64 SSE4.2x - Critter 1.6a 64-bitnob_4 26.5 - 13.5 +19/=15/-6 66.25%

Time Control: 2+2

Stockfish 010314 64 SSE4.2x - Houdini 4 x64xCT0 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 010314 64 SSE4.2x - Komodo TCECr 64-bitx4 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 010314 64 SSE4.2x - Critter 1.6a 64-bitnob_4 28.0 - 12.0 +19/=18/-3 70.00%

Score using 4 Cores= 151.0 – 89.0 = 62.92%
240 Games:
http://www.mediafire.com/view/u9ska2zo7 ... amesx4.pgn


Segmenting by Time Control:

Fixed TC = 148.0 – 92.0 = 61.67%
Incremental TC = 154.0 – 86.0 = 64.17%

Global Score= 302.0 – 178.0 = 62.92%

Against : Houdini 4.0 St. Ct0 (3227) = 53.12% ; Komodo TCECr (3181) = 65.31% , Critter 1.6a (3104) = 70.31%

Average Estimated Elo Opponents = 3171
Estimated Elo Performance= 3261

This is the second best score ever in my tests. The best one so far is: STOCKFISH IPMAN COMPILE 290114 IP with the same EEP but with a Global Score of 302.5 – 177.5. Of course within error bars.

Regards,

Tom.
Top
ouachita
Posts: 454
Joined: Tue Jan 15, 2013 4:33 pm
Location: Ritz-Carlton, NYC
Full name: Bobby Johnson

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ouachita »

Good to see you back in action Tom
SIM, PhD, MBA, PE
Top
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Sedat Canbaz »

ouachita wrote:Good to see you back in action Tom
+1
Top
Kohflote
Posts: 219
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Kohflote »

+1
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Thanks for your kind 'welcome back', Bobby, Sedat and Kah Huat. :D

Here you have a new test:

TESTING STOCKFISH DEVELOPMENT 050314= 480 GAMES

Bench: 8430785 Timestamp: 1394006112

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0

Stockfish 050314 64 SSE4.2x - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +15/=22/-3 65.00%
Stockfish 050314 64 SSE4.2x - Komodo TCECr 64-bitx6 25.0 - 15.0 +18/=14/-8 62.50%
Stockfish 050314 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 27.0 - 13.0 +17/=20/-3 67.50%

Time Control= 2+2

201403Stockfish_050314_2+2 2014

Stockfish 050314 64 SSE4.2x - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 050314 64 SSE4.2x - Komodo TCECr 64-bitx6 23.5 - 16.5 +14/=19/-7 58.75%
Stockfish 050314 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 29.5 - 10.5 +20/=19/-1 73.75%

Score using 6 cores: 153.0 – 87.0 = 63.75%
240 Games: http://www.mediafire.com/view/8oi3beohm ... 0games.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control: 4+0

Stockfish 050314 64 SSE4.2x - Houdini 4 x64xCT0 21.0 - 19.0 +8/=26/-6 52.50%
Stockfish 050314 64 SSE4.2x - Komodo TCECr 64-bitx4 26.0 - 14.0 +15/=22/-3 65.00%
Stockfish 050314 64 SSE4.2x - Critter 1.6a 64-bitnob_4 28.0 - 12.0 +19/=18/-3 70.00%


Time Control: 2+2

Stockfish 050314 64 SSE4.2x - Houdini 4 x64xCT0 19.0 - 21.0 +5/=28/-7 47.50%
Stockfish 050314 64 SSE4.2x - Komodo TCECr 64-bitx4 25.0 - 15.0 +16/=18/-6 62.50%
Stockfish 050314 64 SSE4.2x - Critter 1.6a 64-bitnob_4 24.5 - 15.5 +14/=21/-5 61.25%

Score using 4 Cores= 143.5 – 96.5 = 59.79%
240 Games:
http://www.mediafire.com/view/vv21rfbdf ... amesx4.pgn

Segmenting by Time Control:

Fixed TC = 153.0 – 87.0 =63.75%
Incremental TC = 143.5 – 96.5 = 59.79%

Global Score= 296.5 – 183.5 = 61.77%

Against : Houdini 4.0 St. Ct0 (3227) = 55.00% ; Komodo TCECr (3181) = 62.19%, Critter 1.6a (3104) = 68.12%

Average Estimated Elo Opponents = 3171
Estimated Elo Performance= 3253

Error bars: +/- 23 EEP

Regards,

Tom.
Top

Return to “Computer Chess Club: Tournaments and Matches”