TESTING STOCKFISH DEVELOPMENT 021114 (First test: Games 1 to 480)
Timestamp: 1414911832 bench: 6564212
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 20.0 - 20.0 +6/=28/-6 50.00%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.5 - 16.5 +11/=25/-4 58.75%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 25.5 - 14.5 +16/=19/-5 63.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Score using 6 cores: 140.0 – 100.0= 58.33%
240 Games =
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 20.5 - 19.5 +8/=25/-7 51.25%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 25.0 - 15.0 +12/=26/-2 62.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.5 - 16.5 +13/=21/-6 58.75%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 22.5 - 17.5 +10/=25/-5 56.25%
Score using 4 cores: 138.5 – 101.5= 57.71%
240 Games:
http://www.mediafire.com/view/p65ex6...4_240games.pgn
Segmenting by Time Control:
Fixed TC = 136.0 – 104.0= 56.67%
Incremental TC = 142.5 – 97.5= 59.37%
GLOBAL SCORE: 278.5 – 201.5 = 58.02%
Against : Houdini 4.0 St. Ct0 (3227) = 57.81% ; Komodo 8 (3266) = 57.81%, Gull 3 XP (3199) = 58.44%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3287
Error bars= +/- 23 EEP
Let’s start the second test of this interesting SF POPCNT Development.
Kind regards from Barcelona,
Tom.
Testing Stockfish 11-03-13. 480 Games.
Moderator: Ras
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 021114 (Second Test: Games 481 to 960)
Timestamp: 1414911832 bench: 6564212
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 20.5 - 19.5 +6/=29/-5 51.25%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 22.5 - 17.5 +9/=27/-4 56.25%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
Score using 6 cores: 136.5 – 103.5 = 56.87%
240 Games =
http://www.mediafire.com/view/uktk1hsc7 ... ndTest.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +11/=27/-2 61.25%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.0 - 17.0 +9/=28/-3 57.50%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +11/=28/-1 62.50%
Score using 4 cores: 142.5 – 97.5= 57.71%
240 Games:
http://www.mediafire.com/view/pnwepzegc ... ndTest.pgn
Segmenting by Time Control:
Fixed TC = 137.0 – 103.0= 57.08%
Incremental TC = 142.0 – 98.0= 59.17%
GLOBAL SCORE: 279.0 – 201.0 = 58.12%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 8 (3266) = 56.56%, Gull 3 XP (3199) = 59.69%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3288
Error bars= +/- 23 EEP
Let’s start the third and last test of this strong SF Development.
Kind regards from Barcelona,
Tom.
Timestamp: 1414911832 bench: 6564212
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 20.5 - 19.5 +6/=29/-5 51.25%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 22.5 - 17.5 +9/=27/-4 56.25%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +13/=24/-3 62.50%
Score using 6 cores: 136.5 – 103.5 = 56.87%
240 Games =
http://www.mediafire.com/view/uktk1hsc7 ... ndTest.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +11/=27/-2 61.25%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.0 - 17.0 +9/=28/-3 57.50%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 25.0 - 15.0 +11/=28/-1 62.50%
Score using 4 cores: 142.5 – 97.5= 57.71%
240 Games:
http://www.mediafire.com/view/pnwepzegc ... ndTest.pgn
Segmenting by Time Control:
Fixed TC = 137.0 – 103.0= 57.08%
Incremental TC = 142.0 – 98.0= 59.17%
GLOBAL SCORE: 279.0 – 201.0 = 58.12%
Against : Houdini 4.0 St. Ct0 (3227) = 58.12% ; Komodo 8 (3266) = 56.56%, Gull 3 XP (3199) = 59.69%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3288
Error bars= +/- 23 EEP
Let’s start the third and last test of this strong SF Development.
Kind regards from Barcelona,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 021114 (Third Test: Games 961 to 1440)
Timestamp: 1414911832 bench: 6564212
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 24.5 - 15.5 +13/=23/-4 61.25%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +8/=26/-6 52.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.0 - 17.0 +10/=26/-4 57.50%
Score using 6 cores: 132.0 – 108.0 = 55.00%
240 Games =
http://www.mediafire.com/view/7d4huap47 ... rdTest.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 20.0 - 20.0 +7/=26/-7 50.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 24.0 - 16.0 +10/=28/-2 60.00%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 21.5 - 18.5 +8/=27/-5 53.75%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 4 cores: 139.0 – 101.0= 57.92%
240 Games:
http://www.mediafire.com/view/cp8bp2lc3 ... rdTest.pgn
Segmenting by Time Control:
Fixed TC = 134.0 – 106.0= 55.83%
Incremental TC = 137.0 – 103.0= 57.08%
GLOBAL SCORE: 271.0 – 209.0 = 56.46%
Against : Houdini 4.0 St. Ct0 (3227) = 54.06% ; Komodo 8 (3266) = 54.37%, Gull 3 XP (3199) = 60.94%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3276
Error bars= +/- 23 EEP
Not a brilliant performance for SF DEVELOPMENT 021114 in this third test. I will post later the summary of the three tests with 1440 games.
Regards from Barcelona,
Tom.
Timestamp: 1414911832 bench: 6564212
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 24.5 - 15.5 +13/=23/-4 61.25%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 x64_st_X6_CT0 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_6_NOB 21.0 - 19.0 +8/=26/-6 52.50%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 23.0 - 17.0 +10/=26/-4 57.50%
Score using 6 cores: 132.0 – 108.0 = 55.00%
240 Games =
http://www.mediafire.com/view/7d4huap47 ... rdTest.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 20.0 - 20.0 +7/=26/-7 50.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 24.0 - 16.0 +10/=28/-2 60.00%
Time Control= 2+2
Stockfish 021114 64 POPCNT_ - Houdini 4 Pro x64-A_OK 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 021114 64 POPCNT_ - Komodo 8 64-bit_4_NOB 21.5 - 18.5 +8/=27/-5 53.75%
Stockfish 021114 64 POPCNT_ - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 4 cores: 139.0 – 101.0= 57.92%
240 Games:
http://www.mediafire.com/view/cp8bp2lc3 ... rdTest.pgn
Segmenting by Time Control:
Fixed TC = 134.0 – 106.0= 55.83%
Incremental TC = 137.0 – 103.0= 57.08%
GLOBAL SCORE: 271.0 – 209.0 = 56.46%
Against : Houdini 4.0 St. Ct0 (3227) = 54.06% ; Komodo 8 (3266) = 54.37%, Gull 3 XP (3199) = 60.94%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3276
Error bars= +/- 23 EEP
Not a brilliant performance for SF DEVELOPMENT 021114 in this third test. I will post later the summary of the three tests with 1440 games.
Regards from Barcelona,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 021114 SUMMARY OF THREE TESTS 1440 GAMES
GLOBAL SCORE= 828.5 – 611.5 = 57.53%
Against : Houdini 4.0 St. Ct0 (3227) = 56.66% ; Komodo 8 (3266) = 56.25%, Gull 3 XP (3199) = 59.69%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3284
Error bars= +/- 13 EEP
Exactly the same performance than STOCKFISH DEVELOPMENT 271014 (960 GAMES).
Best regards from Barcelona.
Tom.
GLOBAL SCORE= 828.5 – 611.5 = 57.53%
Against : Houdini 4.0 St. Ct0 (3227) = 56.66% ; Komodo 8 (3266) = 56.25%, Gull 3 XP (3199) = 59.69%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3284
Error bars= +/- 13 EEP
Exactly the same performance than STOCKFISH DEVELOPMENT 271014 (960 GAMES).
Best regards from Barcelona.
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH 061114MZ: 480 Games
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF061114MZ 64x6 - Houdini 4 x64_st_X6_CT0 19.5 - 20.5 +5/=29/-6 48.75%
SF061114MZ 64x6 - Komodo 8 64-bit_6_NOB 21.5 - 18.5 +10/=23/-7 53.75%
SF061114MZ 64x6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control= 2+2
SF061114MZ 64x6 - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +9/=23/-8 51.25%
SF061114MZ 64x6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +12/=20/-8 55.00%
SF061114MZ 64x6 - Gull 3 x64 XP 20.5 - 19.5 +7/=27/-6 51.25%
Score using 6 cores: 130.0 – 110.0 = 54.17%
240 Games =
http://www.mediafire.com/view/zh1w3yq1m ... X6_pgn.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF061114MZ 64x4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +9/=26/-5 55.00%
SF061114MZ 64x4 - Komodo 8 64-bit_4_NOB 19.0 - 21.0 +9/=20/-11 47.50%
SF061114MZ 64x4 - Gull 3 x64 XP 24.5 - 15.5 +10/=29/-1 61.25%
Time Control= 2+2
SF061114MZ 64x4 - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +8/=29/-3 56.25%
SF061114MZ 64x4 - Komodo 8 64-bit_4_NOB 21.0 - 19.0 +10/=22/-8 52.50%
SF061114MZ 64x4 - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Score using 4 cores: 135.0 – 105.0= 56.25%
240 Games:
http://www.mediafire.com/view/cep9cqt4l ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 132.5 – 107.5 = 55.21%
Incremental TC = 132.5 – 107.5 = 55.21%
GLOBAL SCORE: 265.0 – 215.0 = 55.21%
Against : Houdini 4.0 St. Ct0 (3227) = 52.81% ; Komodo 8 (3266) = 52.19%, Gull 3 XP (3199) = 60.62%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3267
Error bars= +/- 23 EEP
Not a good performance this time.
Regards,
Tom.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
SF061114MZ 64x6 - Houdini 4 x64_st_X6_CT0 19.5 - 20.5 +5/=29/-6 48.75%
SF061114MZ 64x6 - Komodo 8 64-bit_6_NOB 21.5 - 18.5 +10/=23/-7 53.75%
SF061114MZ 64x6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control= 2+2
SF061114MZ 64x6 - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +9/=23/-8 51.25%
SF061114MZ 64x6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +12/=20/-8 55.00%
SF061114MZ 64x6 - Gull 3 x64 XP 20.5 - 19.5 +7/=27/-6 51.25%
Score using 6 cores: 130.0 – 110.0 = 54.17%
240 Games =
http://www.mediafire.com/view/zh1w3yq1m ... X6_pgn.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
SF061114MZ 64x4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +9/=26/-5 55.00%
SF061114MZ 64x4 - Komodo 8 64-bit_4_NOB 19.0 - 21.0 +9/=20/-11 47.50%
SF061114MZ 64x4 - Gull 3 x64 XP 24.5 - 15.5 +10/=29/-1 61.25%
Time Control= 2+2
SF061114MZ 64x4 - Houdini 4 Pro x64-A_OK 22.5 - 17.5 +8/=29/-3 56.25%
SF061114MZ 64x4 - Komodo 8 64-bit_4_NOB 21.0 - 19.0 +10/=22/-8 52.50%
SF061114MZ 64x4 - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Score using 4 cores: 135.0 – 105.0= 56.25%
240 Games:
http://www.mediafire.com/view/cep9cqt4l ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 132.5 – 107.5 = 55.21%
Incremental TC = 132.5 – 107.5 = 55.21%
GLOBAL SCORE: 265.0 – 215.0 = 55.21%
Against : Houdini 4.0 St. Ct0 (3227) = 52.81% ; Komodo 8 (3266) = 52.19%, Gull 3 XP (3199) = 60.62%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3267
Error bars= +/- 23 EEP
Not a good performance this time.
Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 091114 (First test: Games 1 to 480)
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 23.5 - 16.5 +14/=19/-7 58.75%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
Score using 6 cores: 145.0 – 95.0 = 60.42%
240 Games =
http://www.mediafire.com/view/i1d20vo9j ... DEV_X6.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 24.5 - 15.5 +10/=29/-1 61.25%
Score using 4 cores: 148.0 – 92.0= 61.67%
240 Games:
http://www.mediafire.com/view/09bfy3637 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 148.5 – 91.5= 61.87%
Incremental TC = 144.5 – 95.5= 60.21%
GLOBAL SCORE: 293.0 – 187.0 = 61.04%
Against : Houdini 4.0 St. Ct0 (3227) = 61.25% ; Komodo 8 (3266) = 58.75%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3308
Error bars= +/- 23 EEP
This is, with a substantial difference, the best engine/version I have tested ever in my 480 games tests. A big “CONGRATULATIONS” to the Stockfish team. Let’s test again this monster to confirm -hopefully!- this amazing result.
Kind and smiling regards from Barcelona,
Tom.
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 24.5 - 15.5 +12/=25/-3 61.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 23.5 - 16.5 +14/=19/-7 58.75%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.5 - 13.5 +14/=25/-1 66.25%
Score using 6 cores: 145.0 – 95.0 = 60.42%
240 Games =
http://www.mediafire.com/view/i1d20vo9j ... DEV_X6.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.0 - 14.0 +15/=22/-3 65.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 25.5 - 14.5 +14/=23/-3 63.75%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 24.5 - 15.5 +10/=29/-1 61.25%
Score using 4 cores: 148.0 – 92.0= 61.67%
240 Games:
http://www.mediafire.com/view/09bfy3637 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 148.5 – 91.5= 61.87%
Incremental TC = 144.5 – 95.5= 60.21%
GLOBAL SCORE: 293.0 – 187.0 = 61.04%
Against : Houdini 4.0 St. Ct0 (3227) = 61.25% ; Komodo 8 (3266) = 58.75%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3308
Error bars= +/- 23 EEP
This is, with a substantial difference, the best engine/version I have tested ever in my 480 games tests. A big “CONGRATULATIONS” to the Stockfish team. Let’s test again this monster to confirm -hopefully!- this amazing result.

Kind and smiling regards from Barcelona,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 091114 (Second Test: Games 481 to 960)
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 6 cores: 143.0 – 97.0 = 59.58%
240 Games =
http://www.mediafire.com/view/q6uf7uw8b ... Test_a.pgn
and
http://www.mediafire.com/view/k4gtjmi83 ... Test_b.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 27.0 - 13.0 +16/=22/-2 67.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 21.0 - 19.0 +5/=32/-3 52.50%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Score using 4 cores: 143.0 – 97.0= 59.58%
240 Games:
http://www.mediafire.com/view/50xufcsst ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 147.0 – 91.0 = 61.25%
Incremental TC = 139.0 – 101.0= 57.92%
GLOBAL SCORE: 286 – 194 = 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 61.25% ; Komodo 8 (3266) = 58.75%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3298
Error bars= +/- 23 EEP
Regards,
Tom.
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 26.0 - 14.0 +14/=24/-2 65.00%
Score using 6 cores: 143.0 – 97.0 = 59.58%
240 Games =
http://www.mediafire.com/view/q6uf7uw8b ... Test_a.pgn
and
http://www.mediafire.com/view/k4gtjmi83 ... Test_b.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 27.0 - 13.0 +16/=22/-2 67.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 21.0 - 19.0 +5/=32/-3 52.50%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 23.5 - 16.5 +9/=29/-2 58.75%
Score using 4 cores: 143.0 – 97.0= 59.58%
240 Games:
http://www.mediafire.com/view/50xufcsst ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 147.0 – 91.0 = 61.25%
Incremental TC = 139.0 – 101.0= 57.92%
GLOBAL SCORE: 286 – 194 = 59.58%
Against : Houdini 4.0 St. Ct0 (3227) = 61.25% ; Komodo 8 (3266) = 58.75%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3298
Error bars= +/- 23 EEP
Regards,
Tom.
-
- Posts: 786
- Joined: Sun Apr 16, 2006 9:09 pm
Re: Testing Stockfish 11-03-13. 480 Games.
TESTING STOCKFISH DEVELOPMENT 091114 (Third and last Test: Games 961 to 1440)
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
201411Stockfish_Dev_ 091114_4+0_X6_3rdT 2014
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 24.5 - 15.5 +11/=27/-2 61.25%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 23.5 - 16.5 +11/=25/-4 58.75%
Score using 6 cores: 140.5 – 99.5 = 58.54%
240 Games =
http://www.mediafire.com/view/da5ckpca9 ... rdTest.pgn
and
http://www.mediafire.com/view/d3u4vedgf ... Test_b.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +13/=18/-9 55.00%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.5 - 13.5 +16/=21/-3 66.25%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +9/=26/-5 55.00%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.5 - 13.5 +16/=21/-3 66.25%
Score using 4 cores: 144.5 – 99.5= 60.21%
240 Games:
http://www.mediafire.com/view/wgqkv3d03 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 143.5 – 96.0 = 59.79%
Incremental TC = 141.5 – 98.5= 58.96%
GLOBAL SCORE: 285 – 195 = 59.37%
Against : Houdini 4.0 St. Ct0 (3227) = 55.94% ; Komodo 8 (3266) = 59.06%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3297
Error bars= +/- 23 EEP
SUMMARY OF THREE TESTS FOR SF DEVELOPMENT 091114 AFTER 1440 GAMES
GLOBAL SCORE: 864.0 – 576 = 60.00%
Against : Houdini 4.0 St. Ct0 (3227) = 58.33% ; Komodo 8 (3266) = 58.85%, Gull 3 XP (3199) = 62.81%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3301
Error bars= +/- 13 EEP
This is, with a substantial difference, the best SF Development I have ever tested. As a reference:
17 Elo points better than SF 021114 DEV.
29 Elo points better than Stockfish 5
35 Elo points better than Komodo 8
74 points better than Houdini 4.
Simply GREAT! Regards,
Tom.
Timestamp: 1415525224 Bench: 6807896
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014t – Limit 8 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177
Time Control = 4+0
201411Stockfish_Dev_ 091114_4+0_X6_3rdT 2014
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 23.0 - 17.0 +11/=24/-5 57.50%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 24.5 - 15.5 +11/=27/-2 61.25%
Time Control= 2+2
Stockfish 091114 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 091114 64 POPCNTx6 - Komodo 8 64-bit_6_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 091114 64 POPCNTx6 - Gull 3 x64 XP 23.5 - 16.5 +11/=25/-4 58.75%
Score using 6 cores: 140.5 – 99.5 = 58.54%
240 Games =
http://www.mediafire.com/view/da5ckpca9 ... rdTest.pgn
and
http://www.mediafire.com/view/d3u4vedgf ... Test_b.pgn
i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012t –Limit 8 moves. Sedat-
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control: 4+0
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +13/=18/-9 55.00%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 24.5 - 15.5 +13/=23/-4 61.25%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.5 - 13.5 +16/=21/-3 66.25%
Time Control= 2+2
Stockfish 091114 64 POPCNTx4 - Houdini 4 Pro x64-A_OK 22.0 - 18.0 +9/=26/-5 55.00%
Stockfish 091114 64 POPCNTx4 - Komodo 8 64-bit_4_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 091114 64 POPCNTx4 - Gull 3 x64 XP 26.5 - 13.5 +16/=21/-3 66.25%
Score using 4 cores: 144.5 – 99.5= 60.21%
240 Games:
http://www.mediafire.com/view/wgqkv3d03 ... 0games.pgn
Segmenting by Time Control:
Fixed TC = 143.5 – 96.0 = 59.79%
Incremental TC = 141.5 – 98.5= 58.96%
GLOBAL SCORE: 285 – 195 = 59.37%
Against : Houdini 4.0 St. Ct0 (3227) = 55.94% ; Komodo 8 (3266) = 59.06%, Gull 3 XP (3199) = 63.12%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3297
Error bars= +/- 23 EEP
SUMMARY OF THREE TESTS FOR SF DEVELOPMENT 091114 AFTER 1440 GAMES
GLOBAL SCORE: 864.0 – 576 = 60.00%
Against : Houdini 4.0 St. Ct0 (3227) = 58.33% ; Komodo 8 (3266) = 58.85%, Gull 3 XP (3199) = 62.81%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3301
Error bars= +/- 13 EEP
This is, with a substantial difference, the best SF Development I have ever tested. As a reference:
17 Elo points better than SF 021114 DEV.
29 Elo points better than Stockfish 5
35 Elo points better than Komodo 8
74 points better than Houdini 4.
Simply GREAT! Regards,
Tom.
-
- Posts: 2129
- Joined: Thu May 29, 2008 10:43 am
Re: Testing Stockfish 11-03-13. 480 Games.
Ok Tom, I give up...Tomcass wrote:TESTING STOCKFISH DEVELOPMENT 091114 (Third and last Test: Games 961 to 1440)
SUMMARY OF THREE TESTS FOR SF DEVELOPMENT 091114 AFTER 1440 GAMES
GLOBAL SCORE: 864.0 – 576 = 60.00%
Against : Houdini 4.0 St. Ct0 (3227) = 58.33% ; Komodo 8 (3266) = 58.85%, Gull 3 XP (3199) = 62.81%
Average Estimated Elo Opponents = 3231
Estimated Elo Performance= 3301
Error bars= +/- 13 EEP
This is, with a substantial difference, the best SF Development I have ever tested. As a reference:
17 Elo points better than SF 021114 DEV.
29 Elo points better than Stockfish 5
35 Elo points better than Komodo 8
74 points better than Houdini 4.
Simply GREAT! Regards,
Tom.

Honestly:

The CCC community needs to ban Stockfish now, so that other efforts might have at least a small chance of being competitive!
Sheesh...it's almost becoming absurd

PS congrats to all those working on fishtest!
-
- Posts: 1346
- Joined: Sat Apr 19, 2014 1:47 pm
Re: Testing Stockfish 11-03-13. 480 Games.
Stockfish is really strong now. Just look how he is already leading in TCEC in round 3.