TESTING STOCKFISH 5 = 960 GAMES.
The release of Stockfish 5 well deserved that I double test it: 960 games instead of my usual 480 games test.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat –Limit 5 moves-
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 30.42
Knodes per second: 14602
Time control= 4+0
Stockfish 5 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 5 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 22.5 - 17.5 +13/=19/-8 56.25%
Stockfish 5 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 5 64 SSE4.2x6 - Critter 1.6a 64-bitX6_NOB_ok 27.5 - 12.5 +15/=25/-0 68.75%
Stockfish 5 64 SSE4.2x6 - SF 270414IPx 64 SSE4.2x6 20.0 - 20.0 +4/=32/-4 50.00%
Stockfish 5 64 SSE4.2x6 - StockfishRW 190514 SSE4.2_ 21.0 - 19.0 +4/=34/-2 52.50%
Time Control= 2+2
Stockfish 5 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
Stockfish 5 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 5 64 SSE4.2x6 - Gull 3 x64 XP 24.5 - 15.5 +15/=19/-6 61.25%
Stockfish 5 64 SSE4.2x6 - Critter 1.6a 64-bitX6_NOB_ok 27.0 - 13.0 +18/=18/-4 67.50%
Stockfish 5 64 SSE4.2x6 - SF 270414IPx 64 SSE4.2x6 21.0 - 19.0 +7/=28/-5 52.50%
Stockfish 5 64 SSE4.2x6 - StockfishRW 190514 SSE4.2_ 20.0 - 20.0 +3/=34/-3 50.00%
Score using 6 Cores= 276.0 – 204.0 = 57.50%
480 Games =
http://www.mediafire.com/view/7fzrej419 ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat – Limit 5 moves -
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 5 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 20.0 - 20.0 +9/=22/-9 50.00%
Stockfish 5 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB_OK 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 5 64 SSE4.2x4 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 5 64 SSE4.2x4 - Critter 1.6a 64-bit_NOB 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 5 64 SSE4.2x4 - SF 270414IPx 64 SSE4.2_ 20.5 - 19.5 +3/=35/-2 51.25%
Stockfish 5 64 SSE4.2x4 - StockfishRW 190514 SSE4.2_ 20.0 - 20.0 +5/=30/-5 50.00%
Time Control= 2+2
Stockfish 5 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 5 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB_OK 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 5 64 SSE4.2x4 - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 5 64 SSE4.2x4 - Critter 1.6a 64-bit_NOB 28.0 - 12.0 +18/=20/-2 70.00%
Stockfish 5 64 SSE4.2x4 - SF 270414IPx 64LP 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 5 64 SSE4.2x4 - StockfishRW 190514 SSE4.2_ 21.0 - 19.0 +6/=30/-4 52.50%
Score using 4 Cores= 278.0 – 202.0= 57.92%
480 games=
http://www.mediafire.com/view/bayw2wjf1 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 273.5 – 206.5 = 56.98%
Incremental TC= 280.5 – 199.5 = 58.44%
Global Score= 554.0 – 406.0 = 57.71%
Against : Houdini 4.0 St. Ct0 (3227)= 53.12% Komodo 7 (3206)= 59.37% Gull 3.0 XP (3199)= 61.87% Critter 1.6a (3104) = 67.50% SF 270414IPx 64 SSE4.2 (3281)= 53.12% StockfishRW 190514 SSE4.2 (3289)= 51.25%
Average Estimated Elo Opponents = 3218
Estimated Elo Performance = 3272
Error bars: +/- 16
Stockfish 5 has performed in this test 17 Elo below the Top Scorer Stockfish RW 190514, although it has won their one to one match.
In relation to other engines, Stockfish 5 has performed:
- 45 Elo points better than Houdini 4
- 66 Elo points better than Komodo 7
- 73 Elo points better than Gull 3.0 XP and
- 168 Elo points better than Critter
This is an extremely strong engine. Well done, Stockfish Team!.
Regards from Barcelona.
Tom.
Testing Stockfish 11-03-13. 480 Games.
Moderator: Ras
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH IPMAN SF5 COMPILE 030614 = 480 GAMES.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF5 030614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +5/=33/-2 53.75%
SF5 030614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
SF5 030614IPx 64 SSE4.2x6 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
Time Control= 2+2
SF5 030614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +16/=20/-4 65.00%
SF5 030614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +16/=19/-5 63.75%
SF5 030614IPx 64 SSE4.2x6 - Gull 3 x64 XP 19.5 - 20.5 +8/=23/-9 48.75%
Score using 6 cores: 142.5 – 97.5 = 59.37%
240 Games =
http://www.mediafire.com/view/eb41f6yd0 ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF5 030614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 22.5 - 17.5 +10/=25/-5 56.25%
SF5 030614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 23.5 - 16.5 +11/=25/-4 58.75%
SF5 030614IPx 64 SSE4.2x4 - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Time Control: 2+2
SF5 030614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 24.5 - 15.5 +12/=25/-3 61.25%
SF5 030614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 24.5 - 15.5 +14/=21/-5 61.25%
SF5 030614IPx 64 SSE4.2x4 - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
Score using 4 Cores= 143.5 – 96.5 = 59.79%
240 Games:
http://www.mediafire.com/view/wnmkdi74i ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 141.0 -99.0 = 58.75%
Incremental TC = 145.0 – 95.0 = 60.42%
Global Score= 286.0 – 194.0 = 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 59.06%; Komodo 7 (3206) = 60.62%, Gull 3 XP (3199) = 59.06%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3278
Error bars= +/- 23 EEP
This is a good compile. 6 Elo points above SF 5, 51 Elo above Houdini 4 and only 11 Elo points below the top scorer so far in my tests Stockfish RW 190514. Within error bars.
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF5 030614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +5/=33/-2 53.75%
SF5 030614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
SF5 030614IPx 64 SSE4.2x6 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
Time Control= 2+2
SF5 030614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +16/=20/-4 65.00%
SF5 030614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +16/=19/-5 63.75%
SF5 030614IPx 64 SSE4.2x6 - Gull 3 x64 XP 19.5 - 20.5 +8/=23/-9 48.75%
Score using 6 cores: 142.5 – 97.5 = 59.37%
240 Games =
http://www.mediafire.com/view/eb41f6yd0 ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF5 030614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 22.5 - 17.5 +10/=25/-5 56.25%
SF5 030614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 23.5 - 16.5 +11/=25/-4 58.75%
SF5 030614IPx 64 SSE4.2x4 - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Time Control: 2+2
SF5 030614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 24.5 - 15.5 +12/=25/-3 61.25%
SF5 030614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 24.5 - 15.5 +14/=21/-5 61.25%
SF5 030614IPx 64 SSE4.2x4 - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
Score using 4 Cores= 143.5 – 96.5 = 59.79%
240 Games:
http://www.mediafire.com/view/wnmkdi74i ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 141.0 -99.0 = 58.75%
Incremental TC = 145.0 – 95.0 = 60.42%
Global Score= 286.0 – 194.0 = 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 59.06%; Komodo 7 (3206) = 60.62%, Gull 3 XP (3199) = 59.06%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3278
Error bars= +/- 23 EEP
This is a good compile. 6 Elo points above SF 5, 51 Elo above Houdini 4 and only 11 Elo points below the top scorer so far in my tests Stockfish RW 190514. Within error bars.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 190614 = 480 GAMES
Bench : 7710548 Timestamp: 1403185482
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 190614 64 SSE4.2xD - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 25.0 - 15.0 +16/=18/-6 62.50%
Time Control= 2+2
Stockfish 190614 64 SSE4.2xD - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +6/=30/-4 52.50%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx6_NOB 21.0 - 19.0 +11/=20/-9 52.50%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Score using 6 cores: 138.0 – 102.0 = 57.50%
240 Games:
http://www.mediafire.com/view/48ccv81at ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 190614 64 SSE4.2xD - Houdini 4 Pro x64_Ct0_OK 23.5 - 16.5 +8/=31/-1 58.75%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +16/=18/-6 62.50%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 25.5 - 14.5 +13/=25/-2 63.75%
Time Control: 2+2
Stockfish 190614 64 SSE4.2xD - Houdini 4 Pro x64_Ct0_OK 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx4_NOB 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 20.5 - 19.5 +8/=25/-7 51.25%
Score using 4 Cores= 141.5 – 96.5= 58.96%
240 Games:
http://www.mediafire.com/view/2b1l1wm9r ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 146.5 – 93.5 = 61.04%
Incremental TC = 133.0 – 107.0 = 55.42%
Global Score= 279.5 – 200.5 = 58.23%
Against : Houdini 4.0 St. Ct0 (3227) = 55.00% ; Komodo 7 (3206) = 58.12%, Gull 3 XP (3199) = 59.06%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3269
Error bars= +/- 23 EEP
The score of this compile is almost the same than the latest development compile I tested: 250514 (3270).
Regards from Barcelona,
Tom.
Bench : 7710548 Timestamp: 1403185482
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 190614 64 SSE4.2xD - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 25.0 - 15.0 +16/=18/-6 62.50%
Time Control= 2+2
Stockfish 190614 64 SSE4.2xD - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +6/=30/-4 52.50%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx6_NOB 21.0 - 19.0 +11/=20/-9 52.50%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Score using 6 cores: 138.0 – 102.0 = 57.50%
240 Games:
http://www.mediafire.com/view/48ccv81at ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 190614 64 SSE4.2xD - Houdini 4 Pro x64_Ct0_OK 23.5 - 16.5 +8/=31/-1 58.75%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +16/=18/-6 62.50%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 25.5 - 14.5 +13/=25/-2 63.75%
Time Control: 2+2
Stockfish 190614 64 SSE4.2xD - Houdini 4 Pro x64_Ct0_OK 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 190614 64 SSE4.2xD - Komodo 7 64-bitx4_NOB 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 190614 64 SSE4.2xD - Gull 3 x64 XP 20.5 - 19.5 +8/=25/-7 51.25%
Score using 4 Cores= 141.5 – 96.5= 58.96%
240 Games:
http://www.mediafire.com/view/2b1l1wm9r ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 146.5 – 93.5 = 61.04%
Incremental TC = 133.0 – 107.0 = 55.42%
Global Score= 279.5 – 200.5 = 58.23%
Against : Houdini 4.0 St. Ct0 (3227) = 55.00% ; Komodo 7 (3206) = 58.12%, Gull 3 XP (3199) = 59.06%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3269
Error bars= +/- 23 EEP
The score of this compile is almost the same than the latest development compile I tested: 250514 (3270).
Regards from Barcelona,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH IPMAN 090614IPx = 480 GAMES.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +15/=22/-3 65.00%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +15/=18/-7 60.00%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
Time Control= 2+2
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +12/=22/-6 57.50%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 20.0 - 20.0 +9/=22/-9 50.00%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +13/=25/-2 63.75%
Score using 6 cores: 145.5 – 94.5 = 60.62%
240 Games =
http://www.mediafire.com/view/50mymhspe ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +12/=24/-4 60.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 26.0 - 14.0 +20/=12/-8 65.00%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 31.0 - 9.0 +22/=18/-0 77.50%
Time Control: 2+2
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +12/=24/-4 60.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +15/=20/-5 62.50%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 21.5 - 18.5 +9/=25/-6 53.75%
Score using 4 Cores= 151.5 – 88.5 = 63.12%
240 Games:
http://www.mediafire.com/view/fpkp6wrpw ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 158.0 -82.0 = 65.83%
Incremental TC = 139.0 – 101.0 = 57.92%
Global Score= 297.0 – 183.0 = 61.87%
Against : Houdini 4.0 St. Ct0 (3227) = 60.62%; Komodo 7 (3206) = 59.37%, Gull 3 XP (3199) = 65.62%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3294
Error bars= +/- 23 EEP
SF Ipman 090614IPx has got a new best score ever in my tests, 5 Elo points above the previous best scorer SF Rockwood 190514.
I will repeat this 480 games test in order to confirm this excellent score –or otherwise- and to reduce the error bars from 23 to 16 Elo points.
Smiling regards from Barcelona.
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +15/=22/-3 65.00%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +15/=18/-7 60.00%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
Time Control= 2+2
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +12/=22/-6 57.50%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 20.0 - 20.0 +9/=22/-9 50.00%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +13/=25/-2 63.75%
Score using 6 cores: 145.5 – 94.5 = 60.62%
240 Games =
http://www.mediafire.com/view/50mymhspe ... 0games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +12/=24/-4 60.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 26.0 - 14.0 +20/=12/-8 65.00%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 31.0 - 9.0 +22/=18/-0 77.50%
Time Control: 2+2
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +12/=24/-4 60.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +15/=20/-5 62.50%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 21.5 - 18.5 +9/=25/-6 53.75%
Score using 4 Cores= 151.5 – 88.5 = 63.12%
240 Games:
http://www.mediafire.com/view/fpkp6wrpw ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 158.0 -82.0 = 65.83%
Incremental TC = 139.0 – 101.0 = 57.92%
Global Score= 297.0 – 183.0 = 61.87%
Against : Houdini 4.0 St. Ct0 (3227) = 60.62%; Komodo 7 (3206) = 59.37%, Gull 3 XP (3199) = 65.62%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3294
Error bars= +/- 23 EEP
SF Ipman 090614IPx has got a new best score ever in my tests, 5 Elo points above the previous best scorer SF Rockwood 190514.
I will repeat this 480 games test in order to confirm this excellent score –or otherwise- and to reduce the error bars from 23 to 16 Elo points.
Smiling regards from Barcelona.
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH IPMAN 090614IPx = GAMES 481 to 960
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +14/=22/-4 62.50%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 23.5 - 16.5 +10/=27/-3 58.75%
Time Control= 2+2
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +9/=25/-6 53.75%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +13/=25/-2 63.75%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Score using 6 cores: 146.0 – 94.0= 60.83%
240 Games =
http://www.mediafire.com/view/lfu7yyexz ... mesbis.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 21.0 - 19.0 +9/=24/-7 52.50%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 22.0 - 18.0 +10/=24/-6 55.00%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 26.0 - 14.0 +17/=18/-5 65.00%
Time Control: 2+2
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_OK 20.0 - 20.0 +7/=26/-7 50.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 21.0 - 19.0 +8/=26/-6 52.50%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Score using 4 Cores= 135.5 – 105.5 = 56.46%
240 Games:
http://www.mediafire.com/view/r1tv2xzde ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 142.5 -98.5 = 59.37%
Incremental TC = 139.0 – 101.0 = 57.92%
Global Score= 281.5 – 198.5 = 58.65%
Against : Houdini 4.0 St. Ct0 (3227) = 54.69%; Komodo 7 (3206) = 58.44%, Gull 3 XP (3199) = 62.81%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3272
Error bars= +/- 23 EEP
TOTAL SCORE FOR STOCKFISH IPMAN 090614IPx AFTER 960 GAMES:
Global Score= 578.5 – 381.5 = 60.26%
Against : Houdini 4.0 St. Ct0 (3227) = 57.66%; Komodo 7 (3206) =58.91% Gull 3 XP (3199) = 64.21%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3283
Error bars= +/- 16 EEP
The second leg of this test has not confirmed the exceptional score of SF090614Ipx in the first 480 games. Anyway this is an extremely strong compile.
Regards from Barcelona.
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +13/=24/-3 62.50%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +14/=22/-4 62.50%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 23.5 - 16.5 +10/=27/-3 58.75%
Time Control= 2+2
SF 090614IPx 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +9/=25/-6 53.75%
SF 090614IPx 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 25.5 - 14.5 +13/=25/-2 63.75%
SF 090614IPx 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Score using 6 cores: 146.0 – 94.0= 60.83%
240 Games =
http://www.mediafire.com/view/lfu7yyexz ... mesbis.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 21.0 - 19.0 +9/=24/-7 52.50%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 22.0 - 18.0 +10/=24/-6 55.00%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 26.0 - 14.0 +17/=18/-5 65.00%
Time Control: 2+2
SF 090614IPx 64 SSE4.2x4 - Houdini 4 Pro x64_OK 20.0 - 20.0 +7/=26/-7 50.00%
SF 090614IPx 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB 21.0 - 19.0 +8/=26/-6 52.50%
SF 090614IPx 64 SSE4.2x4 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Score using 4 Cores= 135.5 – 105.5 = 56.46%
240 Games:
http://www.mediafire.com/view/r1tv2xzde ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 142.5 -98.5 = 59.37%
Incremental TC = 139.0 – 101.0 = 57.92%
Global Score= 281.5 – 198.5 = 58.65%
Against : Houdini 4.0 St. Ct0 (3227) = 54.69%; Komodo 7 (3206) = 58.44%, Gull 3 XP (3199) = 62.81%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3272
Error bars= +/- 23 EEP
TOTAL SCORE FOR STOCKFISH IPMAN 090614IPx AFTER 960 GAMES:
Global Score= 578.5 – 381.5 = 60.26%
Against : Houdini 4.0 St. Ct0 (3227) = 57.66%; Komodo 7 (3206) =58.91% Gull 3 XP (3199) = 64.21%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3283
Error bars= +/- 16 EEP
The second leg of this test has not confirmed the exceptional score of SF090614Ipx in the first 480 games. Anyway this is an extremely strong compile.
Regards from Barcelona.
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH ROCKWOOD COMPILE 190514 = GAMES 481 to 960.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat –Limit 5 moves-
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 30.42
Knodes per second: 14602
Time Control= 4+0
StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx6_NOB 27.0 - 13.0 +19/=16/-5 67.50%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 26.0 - 14.0 +16/=20/-4 65.00%
Time Control= 2+2
StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +10/=25/-5 56.25%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +14/=22/-4 62.50%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
240 Games =
http://www.mediafire.com/view/943qhzhqz ... es_bis.pgn
Score using 6 Cores= 146.5 – 93.5= 61.04%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat – Limit 5 moves -
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64-A_OK 19.5 - 20.5 +7/=25/-8 48.75%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx4_NOB 25.5 - 14.5 +15/=21/-4 63.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 25.5 - 14.5 +17/=17/-6 63.75%
Time Control= 2+2
StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +12/=21/-7 56.25%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx4_NOB 19.5 - 20.5 +8/=23/-9 48.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
240 Games=
http://www.mediafire.com/view/wtj1v8dp2 ... 0games.pgn
Score using 4 Cores= 139.5 – 100.5= 58.12%
Segmenting by Time Control:
Fixed TC = 144.5 – 95.5 = 60.21%
Incremental TC = 141.5 - 98.5 = 58.96%
Games 481 to 960
Global Score= 286.0 – 194.0= 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 53.44%; Komodo 7 (3206) = 60.62% Gull 3 XP (3199) = 64.69%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3278
Error bars= +/- 23 EEP
------------------------------------
Games 1 to 480
Global Score= 300.0 – 180.0= 62.50%
Against : Houdini 4.0 St. Ct0 (3227)= 62.81%; Komodo TCECr (3181) = 63.44% ; Gull 3.0 XP (3199)= 61.25%
Average Estimated Elo Opponents = 3202
Estimated Elo Performance= 3289
Estimated Elo performance after 960 games= 3283
Error bars= +/- 16
--------------------------------------
After refining the result for Ipman's 090614 compile, I decided to do the same for my best scorer SF Rockwood 190514. After the second 480 games test, its score decreased till 3283. This is exactly the same score than the mentioned Ipman's compile. There are therefore two co-leaders in my tests so far.
Let's test now the genuine SF Development version.
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat –Limit 5 moves-
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 30.42
Knodes per second: 14602
Time Control= 4+0
StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx6_NOB 27.0 - 13.0 +19/=16/-5 67.50%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 26.0 - 14.0 +16/=20/-4 65.00%
Time Control= 2+2
StockfishRW 190514 SSE4.2_ - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +10/=25/-5 56.25%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +14/=22/-4 62.50%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
240 Games =
http://www.mediafire.com/view/943qhzhqz ... es_bis.pgn
Score using 6 Cores= 146.5 – 93.5= 61.04%
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat – Limit 5 moves -
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64-A_OK 19.5 - 20.5 +7/=25/-8 48.75%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx4_NOB 25.5 - 14.5 +15/=21/-4 63.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 25.5 - 14.5 +17/=17/-6 63.75%
Time Control= 2+2
StockfishRW 190514 SSE4.2_ - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +12/=21/-7 56.25%
StockfishRW 190514 SSE4.2_ - Komodo 7 64-bitx4_NOB 19.5 - 20.5 +8/=23/-9 48.75%
StockfishRW 190514 SSE4.2_ - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
240 Games=
http://www.mediafire.com/view/wtj1v8dp2 ... 0games.pgn
Score using 4 Cores= 139.5 – 100.5= 58.12%
Segmenting by Time Control:
Fixed TC = 144.5 – 95.5 = 60.21%
Incremental TC = 141.5 - 98.5 = 58.96%
Games 481 to 960
Global Score= 286.0 – 194.0= 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 53.44%; Komodo 7 (3206) = 60.62% Gull 3 XP (3199) = 64.69%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3278
Error bars= +/- 23 EEP
------------------------------------
Games 1 to 480
Global Score= 300.0 – 180.0= 62.50%
Against : Houdini 4.0 St. Ct0 (3227)= 62.81%; Komodo TCECr (3181) = 63.44% ; Gull 3.0 XP (3199)= 61.25%
Average Estimated Elo Opponents = 3202
Estimated Elo Performance= 3289
Estimated Elo performance after 960 games= 3283
Error bars= +/- 16
--------------------------------------
After refining the result for Ipman's 090614 compile, I decided to do the same for my best scorer SF Rockwood 190514. After the second 480 games test, its score decreased till 3283. This is exactly the same score than the mentioned Ipman's compile. There are therefore two co-leaders in my tests so far.
Let's test now the genuine SF Development version.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 280614 = GAMES 1 to 480
Do you believe in coincidences? In my last post I mentioned that I had two co-leaders with a best Estimated Elo of 3283. So, please look at the Estimated Elo of SF Development 280614 at the end of this post.
Bench : 8095369 Timestamp: 1403978792
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
201406Stockfish_Dev_ 280614_4+0 2014
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 25.5 - 14.5 +17/=17/-6 63.75%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Time Control= 2+2
201406Stockfish_Dev_ 280614_2+2 2014
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +7/=30/-3 55.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Score using 6 cores: 147.0 – 93.0 = 61.25%
240 Games:
http://www.mediafire.com/view/0em4874hf ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +10/=26/-4 57.50%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 22.0 - 18.0 +10/=24/-6 55.00%
Time Control: 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 26.5 - 13.5 +15/=23/-2 66.25%
Score using 4 Cores= 142.5 – 97.5 = 59.27%
240 Games:
http://www.mediafire.com/view/px9bm868m ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 142.5 – 97.5 = 59.27%
Incremental TC = 147.0 – 93.0= 61.25%
Global Score= 289.5 – 190.5 = 60.31%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 7 (3206) =60.62%, Gull 3 XP (3199) = 62.19%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3283
Error bars= +/- 23 EEP
This is clearly the best SF Development version I have tested so far. I am testing now the second leg of this SF Development. Games 481 to 960. Let's wait the results.
Regards,
Tom.
Do you believe in coincidences? In my last post I mentioned that I had two co-leaders with a best Estimated Elo of 3283. So, please look at the Estimated Elo of SF Development 280614 at the end of this post.
Bench : 8095369 Timestamp: 1403978792
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
201406Stockfish_Dev_ 280614_4+0 2014
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 25.5 - 14.5 +17/=17/-6 63.75%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Time Control= 2+2
201406Stockfish_Dev_ 280614_2+2 2014
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +7/=30/-3 55.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Score using 6 cores: 147.0 – 93.0 = 61.25%
240 Games:
http://www.mediafire.com/view/0em4874hf ... 0Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +10/=26/-4 57.50%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 22.0 - 18.0 +10/=24/-6 55.00%
Time Control: 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 26.5 - 13.5 +15/=23/-2 66.25%
Score using 4 Cores= 142.5 – 97.5 = 59.27%
240 Games:
http://www.mediafire.com/view/px9bm868m ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 142.5 – 97.5 = 59.27%
Incremental TC = 147.0 – 93.0= 61.25%
Global Score= 289.5 – 190.5 = 60.31%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 7 (3206) =60.62%, Gull 3 XP (3199) = 62.19%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3283
Error bars= +/- 23 EEP
This is clearly the best SF Development version I have tested so far. I am testing now the second leg of this SF Development. Games 481 to 960. Let's wait the results.
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 280614 = GAMES 481 to 960
Bench : 8095369 Timestamp: 1403978792
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 24.5 - 15.5 +12/=25/-3 61.25%
Time Control= 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 27.0 - 13.0 +15/=24/-1 67.50%
Score using 6 cores: 148.5 – 91.5 = 61.87%
240 Games:
http://www.mediafire.com/view/wn8gwwph2 ... es_bis.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 21.5 - 18.5 +11/=21/-8 53.75%
Time Control: 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 26.0 - 14.0 +16/=20/-4 65.00%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 25.5 - 14.5 +16/=19/-5 63.75%
Score using 4 Cores= 146.0 – 94.0 = 60.83%
240 Games:
http://www.mediafire.com/view/i283nqv1l ... es_bis.pgn
Segmenting by Time Control:
Fixed TC = 143.5 – 96.5 = 59.79%
Incremental TC = 151.0 – 89.0 = 62.92%
Global Score= 294.5 – 185.5 = 61.35%
Against : Houdini 4.0 St. Ct0 (3227) = 59.69% ; Komodo 7 (3206) =62.81%, Gull 3 XP (3199) = 61.56%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3290
----------------------------------------------
Results of the first leg of this test:
Global Score= 289.5 – 190.5 = 60.31%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 7 (3206) =60.62%, Gull 3 XP (3199) = 62.19%
Global score after 960 games - Error bars= +/- 16 EEP
Global Score: 584.0 – 376.0 = 60.83%
Average Elo Opponents = 3211
Estimated Elo Performance = 3287
This is a new best score ever in my tests.
For the first time in many months a Stockfish Development engine leads my tests. 60 Elo points above the great Houdini 4.0. Not so long ago the leader was Deep Rybka 4.1. This SF Development is about 272 Elo points above this very strong engine. Amazing!. The first places in my tests right now -only main engines- are:
Stockfish 280614 Development = 3287
Stockfish 090614 IPMAN = 3283
Stockfish RockWood 190514 = 3283
Stockfish 5 = 3272
Houdini 4.0 = 3227
Komodo 7 = 3206
Gull 3 XP = 3199
Critter 1.6a = 3104
Deep Rybka 4.1 = 3015
My congratulations again and again to Marco and the Stockfish team. Great work, guys!. Best regards,
Tom.
Bench : 8095369 Timestamp: 1403978792
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 26.0 - 14.0 +14/=24/-2 65.00%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 24.5 - 15.5 +12/=25/-3 61.25%
Time Control= 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 x64_st_X6_CT0 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 27.0 - 13.0 +15/=24/-1 67.50%
Score using 6 cores: 148.5 – 91.5 = 61.87%
240 Games:
http://www.mediafire.com/view/wn8gwwph2 ... es_bis.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 21.5 - 18.5 +11/=21/-8 53.75%
Time Control: 2+2
Stockfish 280614 64 SSE4.2_D - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 280614 64 SSE4.2_D - Komodo 7 64-bitx4_NOB 26.0 - 14.0 +16/=20/-4 65.00%
Stockfish 280614 64 SSE4.2_D - Gull 3 x64 XP 25.5 - 14.5 +16/=19/-5 63.75%
Score using 4 Cores= 146.0 – 94.0 = 60.83%
240 Games:
http://www.mediafire.com/view/i283nqv1l ... es_bis.pgn
Segmenting by Time Control:
Fixed TC = 143.5 – 96.5 = 59.79%
Incremental TC = 151.0 – 89.0 = 62.92%
Global Score= 294.5 – 185.5 = 61.35%
Against : Houdini 4.0 St. Ct0 (3227) = 59.69% ; Komodo 7 (3206) =62.81%, Gull 3 XP (3199) = 61.56%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3290
----------------------------------------------
Results of the first leg of this test:
Global Score= 289.5 – 190.5 = 60.31%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 7 (3206) =60.62%, Gull 3 XP (3199) = 62.19%
Global score after 960 games - Error bars= +/- 16 EEP
Global Score: 584.0 – 376.0 = 60.83%
Average Elo Opponents = 3211
Estimated Elo Performance = 3287
This is a new best score ever in my tests.
For the first time in many months a Stockfish Development engine leads my tests. 60 Elo points above the great Houdini 4.0. Not so long ago the leader was Deep Rybka 4.1. This SF Development is about 272 Elo points above this very strong engine. Amazing!. The first places in my tests right now -only main engines- are:
Stockfish 280614 Development = 3287
Stockfish 090614 IPMAN = 3283
Stockfish RockWood 190514 = 3283
Stockfish 5 = 3272
Houdini 4.0 = 3227
Komodo 7 = 3206
Gull 3 XP = 3199
Critter 1.6a = 3104
Deep Rybka 4.1 = 3015
My congratulations again and again to Marco and the Stockfish team. Great work, guys!. Best regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 100814
Bench : 7461881 Timestamp: 1407627382
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 100814 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 19.0 - 21.0 +5/=28/-7 47.50%
Stockfish 100814 64 SSE4.2D - Komodo 7 64-bitx6_NOB 26.0 - 14.0 +17/=18/-5 65.00%
Stockfish 100814 64 SSE4.2D - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
Time Control= 2+2
Stockfish 100814 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 100814 64 SSE4.2D - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 100814 64 SSE4.2D - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 6 cores: 145.5 – 94.5 = 60.62%
240 Games:
http://www.mediafire.com/view/ge2775...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 100814 64 SSE4.2D4 - Houdini 4 Pro x64-A_OK 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 100814 64 SSE4.2D4 - Komodo 7 64-bitx4_NOB 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 100814 64 SSE4.2D4 - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Time Control: 2+2
Stockfish 100814 64 SSE4.2D4 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 100814 64 SSE4.2D4 - Komodo 7 64-bitx4_NOB 22.5 - 17.5 +13/=19/-8 56.25%
Stockfish 100814 64 SSE4.2D4 - Gull 3 x64 XP 27.5 - 12.5 +16/=23/-1 68.75%
Score using 4 Cores= 140.0 – 100.0 = 58.33%
240 Games:
http://www.mediafire.com/view/6bz9hi...4_240games.pgn
Segmenting by Time Control:
Fixed TC = 139.0 – 101.0 = 57.92%
Incremental TC = 146.5 – 93.5= 61.04%
Global Score= 285.5 – 194.5 = 59.48%
Against : Houdini 4.0 St. Ct0 (3227) = 53.75% ; Komodo 7 (3206) = 58.75%%, Gull 3 XP (3199) = 65.94%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3277
Error bars= +/- 23 EEP
Regards,
Tom.
Bench : 7461881 Timestamp: 1407627382
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759
Time Control= 4+0
Stockfish 100814 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 19.0 - 21.0 +5/=28/-7 47.50%
Stockfish 100814 64 SSE4.2D - Komodo 7 64-bitx6_NOB 26.0 - 14.0 +17/=18/-5 65.00%
Stockfish 100814 64 SSE4.2D - Gull 3 x64 XP 27.0 - 13.0 +17/=20/-3 67.50%
Time Control= 2+2
Stockfish 100814 64 SSE4.2D - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 100814 64 SSE4.2D - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 100814 64 SSE4.2D - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 6 cores: 145.5 – 94.5 = 60.62%
240 Games:
http://www.mediafire.com/view/ge2775...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 100814 64 SSE4.2D4 - Houdini 4 Pro x64-A_OK 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 100814 64 SSE4.2D4 - Komodo 7 64-bitx4_NOB 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 100814 64 SSE4.2D4 - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Time Control: 2+2
Stockfish 100814 64 SSE4.2D4 - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 100814 64 SSE4.2D4 - Komodo 7 64-bitx4_NOB 22.5 - 17.5 +13/=19/-8 56.25%
Stockfish 100814 64 SSE4.2D4 - Gull 3 x64 XP 27.5 - 12.5 +16/=23/-1 68.75%
Score using 4 Cores= 140.0 – 100.0 = 58.33%
240 Games:
http://www.mediafire.com/view/6bz9hi...4_240games.pgn
Segmenting by Time Control:
Fixed TC = 139.0 – 101.0 = 57.92%
Incremental TC = 146.5 – 93.5= 61.04%
Global Score= 285.5 – 194.5 = 59.48%
Against : Houdini 4.0 St. Ct0 (3227) = 53.75% ; Komodo 7 (3206) = 58.75%%, Gull 3 XP (3199) = 65.94%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3277
Error bars= +/- 23 EEP
Regards,
Tom.
-
Tomcass
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH IPMAN 270714= 480 GAMES
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 270714IP 64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
SF 270714IP 64 SSE4.2_6 - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +14/=19/-7 58.75%
SF 270714IP 64 SSE4.2_6 - Gull 3 x64 XP 27.5 - 12.5 +15/=25/-0 68.75%
Time Control= 2+2
SF 270714IP 64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
SF 270714IP 64 SSE4.2_6 - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +12/=26/-2 62.50%
SF 270714IP 64 SSE4.2_6 - Gull 3 x64 XP 24.5 - 15.5 +11/=27/-2 61.25%
Score using 6 cores: 147.5 – 92.5= 61.46%
240 Games =
http://www.mediafire.com/view/p6j46f...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 270714IP 64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 19.0 - 21.0 +3/=32/-5 47.50%
SF 270714IP 64 SSE4.2_4 - Komodo 7 64-bitx4_NOB_OK 23.5 - 16.5 +12/=23/-5 58.75%
SF 270714IP 64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control: 2+2
SF 270714IP 64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +9/=27/-4 56.25%
SF 270714IP 64 SSE4.2_4 - Komodo 7 64-bitx4_NOB_OK 25.5 - 14.5 +13/=25/-2 63.75%
SF 270714IP 64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +16/=20/-4 65.00%
Score using 4 Cores= 142.5 – 97.5 = 59.37%
240 Games:
http://www.mediafire.com/view/sw6ddk...N_240games.pgn
Segmenting by Time Control:
Fixed TC = 142.0 -98.0 = 59.17%
Incremental TC = 148.0 – 92.0 = 61.67%
Global Score= 290.0 – 190.0 = 60.42%
Against : Houdini 4.0 St. Ct0 (3227) = 55.31%; Komodo 7 (3206) = 60.94%, Gull 3 XP (3199) = 65.00%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3284
Error bars= +/- 23 EEP
The best IPMAN compile in my tests so far. With a tiny margin over Stockfish 090614 IPMAN (3283). Obviously within error bars. Well done, Ipman!.
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c – Sedat – Limit 5 moves
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF 270714IP 64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
SF 270714IP 64 SSE4.2_6 - Komodo 7 64-bitx6_NOB 23.5 - 16.5 +14/=19/-7 58.75%
SF 270714IP 64 SSE4.2_6 - Gull 3 x64 XP 27.5 - 12.5 +15/=25/-0 68.75%
Time Control= 2+2
SF 270714IP 64 SSE4.2_6 - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
SF 270714IP 64 SSE4.2_6 - Komodo 7 64-bitx6_NOB 25.0 - 15.0 +12/=26/-2 62.50%
SF 270714IP 64 SSE4.2_6 - Gull 3 x64 XP 24.5 - 15.5 +11/=27/-2 61.25%
Score using 6 cores: 147.5 – 92.5= 61.46%
240 Games =
http://www.mediafire.com/view/p6j46f...6_240Games.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF 270714IP 64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 19.0 - 21.0 +3/=32/-5 47.50%
SF 270714IP 64 SSE4.2_4 - Komodo 7 64-bitx4_NOB_OK 23.5 - 16.5 +12/=23/-5 58.75%
SF 270714IP 64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control: 2+2
SF 270714IP 64 SSE4.2_4 - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +9/=27/-4 56.25%
SF 270714IP 64 SSE4.2_4 - Komodo 7 64-bitx4_NOB_OK 25.5 - 14.5 +13/=25/-2 63.75%
SF 270714IP 64 SSE4.2_4 - Gull 3 x64 XP 26.0 - 14.0 +16/=20/-4 65.00%
Score using 4 Cores= 142.5 – 97.5 = 59.37%
240 Games:
http://www.mediafire.com/view/sw6ddk...N_240games.pgn
Segmenting by Time Control:
Fixed TC = 142.0 -98.0 = 59.17%
Incremental TC = 148.0 – 92.0 = 61.67%
Global Score= 290.0 – 190.0 = 60.42%
Against : Houdini 4.0 St. Ct0 (3227) = 55.31%; Komodo 7 (3206) = 60.94%, Gull 3 XP (3199) = 65.00%
Average Estimated Elo Opponents = 3211
Estimated Elo Performance= 3284
Error bars= +/- 23 EEP
The best IPMAN compile in my tests so far. With a tiny margin over Stockfish 090614 IPMAN (3283). Obviously within error bars. Well done, Ipman!.
Regards,
Tom.