Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by JJJ »

Thanks you Tom to le me know :)
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 150915 = 1.440 GAMES

Timestamp: 1442321709 Bench 7298564

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control 4+0

Stockfish 150915 64 POPCNTx6 - Komodo 9.2 64-bit_x6 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 150915 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 26.0 - 14.0 +15/=22/-3 65.00%
Stockfish 150915 64 POPCNTx6 - Gull 3 x64 XP 27.5 - 12.5 +17/=21/-2 68.75%
Stockfish 150915 64 POPCNTx6 - Komodo 9.2 64-bit_x6 43.5 - 36.5 +17/=53/-10 54.38%
Stockfish 150915 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 50.5 - 29.5 +29/=43/-8 63.13%
Stockfish 150915 64 POPCNTx6 - Gull 3 x64 XP 53.0 - 27.0 +32/=42/-6 66.25%

Time Control 2+2

Stockfish 150915 64 POPCNTx6 - Komodo 9.2 64-bit_x6 18.5 - 21.5 +5/=27/-8 46.25%
Stockfish 150915 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 28.0 - 12.0 +17/=22/-1 70.00%
Stockfish 150915 64 POPCNTx6 - Gull 3 x64 XP 26.0 - 14.0 +12/=28/-0 65.00%
Stockfish 150915 64 POPCNTx6 - Komodo 9.2 64-bit_x6 41.0 - 39.0 +14/=54/-12 51.25%
Stockfish 150915 64 POPCNTx6 - Houdini 4 x64_st_X6_CT0 51.0 - 29.0 +28/=46/-6 63.75%
Stockfish 150915 64 POPCNTx6 - Gull 3 x64 XP 50.0 - 30.0 +28/=44/-8 62.50%

Score using 6 cores: 439.0 – 281.0 = 60.97%
Games:
http://www.mediafire.com/download/t90ejke260llzk0/
http://www.mediafire.com/download/n4i665dip4487x3


8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 44.92
Knodes per Second: 21.562

Time control: 4+0

Stockfish 150915 64 BMI2x8 - Komodo 9.2 64-bit_x8 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 150915 64 BMI2x8 - Houdini 4 Pro x64_Ct0_8 27.5 - 12.5 +16/=23/-1 68.75%
Stockfish 150915 64 BMI2x8 - Gull 3 x64 XPx8 31.0 - 9.0 +22/=18/-0 77.50%
Stockfish 150915 64 BMI2x8 - Komodo 9.2 64-bit_x8 38.5 - 41.5 +12/=53/-15 48.13%
Stockfish 150915 64 BMI2x8 - Houdini 4 Pro x64_Ct0_8 54.0 - 26.0 +32/=44/-4 67.50%
Stockfish 150915 64 BMI2x8 - Gull 3 x64 XPx8 55.5 - 24.5 +32/=47/-1 69.38%

Time control 2+2

Stockfish 150915 64 BMI2x8 - Komodo 9.2 64-bit_x8 19.0 - 21.0 +6/=26/-8 47.50%
Stockfish 150915 64 BMI2x8 - Houdini 4 Pro x64_Ct0_8 27.5 - 12.5 +18/=19/-3 68.75%
Stockfish 150915 64 BMI2x8 - Gull 3 x64 XPx8 25.5 - 14.5 +12/=27/-1 63.75%
Stockfish 150915 64 BMI2x8 - Komodo 9.2 64-bit_x8 43.0 - 37.0 +18/=50/-12 53.75%
Stockfish 150915 64 BMI2x8 - Houdini 4 Pro x64_Ct0_8 57.0 - 23.0 +35/=44/-1 71.25%
Stockfish 150915 64 BMI2x8 - Gull 3 x64 XPx8 56.0 - 24.0 +35/=42/-3 70.00%

Games:
http://www.mediafire.com/download/90d26xcv6f8yikb
http://www.mediafire.com/download/937xms73do803jl

Score using 8 cores: 457.0 – 263.0= 63.47%

Segmenting by Time Control:
Fixed Time Control: 453.5 – 259.5 = 62.99%
Incremental Time Control: 442.5 – 248.5 = 61.46%

GLOBAL SCORE AFTER 1440 GAMES= 896.0 – 544.0 = 62.22%

Against : Komodo 9.2 (3251) = 52.08% Houdini 4 (3136) = 66.98%, Gull 3 XP (3103) = 67.60%

Average Elo of Oponents= 3.163

Estimated Elo Performance for Stockfish Development 150915 = 3249


Error bars = +/- 13

This is the highest score for a Stockfish Development ever in my tests, only 2 Elo Points below Komodo 9.2, and 8 Elo Points better than Stockfish Dev. 200815 (3.241).

Kind regards from Barcelona.

Tom
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 190915 = 1.920 GAMES

Timestamp: 1442679275 Bench: 7658406

FIRST LEG : 960 GAMES.

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control 4 + 0
Stockfish 190915 64 POPCNT_6 - Komodo 9.2 64-bit_x6 43.5 - 36.5 +20/=47/-13 54.38%
Stockfish 190915 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 48.0 - 32.0 +28/=40/-12 60.00%
Stockfish 190915 64 POPCNT_6 - Gull 3 x64 XP 57.5 - 22.5 +41/=33/-6 71.88%

Time Control 2 + 2
Stockfish 190915 64 POPCNT_6 - Komodo 9.2 64-bit_x6 42.5 - 37.5 +18/=49/-13 53.13%
Stockfish 190915 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 59.0 - 21.0 +40/=38/-2 73.75%
Stockfish 190915 64 POPCNT_6 - Gull 3 x64 XP 53.5 - 26.5 +29/=49/-2 66.88%

Score using 6 cores: 304.0 – 176.0 = 63.33%
480 Games: http://www.mediafire.com/download/fll7jol1hlan7jo

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 4 + 0

Stockfish 190915 64 BMI2_8 - Komodo 9.2 64-bit_x8 43.5 - 36.5 +17/=53/-10 54.38%
Stockfish 190915 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 54.0 - 26.0 +30/=48/-2 67.50%
Stockfish 190915 64 BMI2_8 - Gull 3 x64 XPx8 56.0 - 24.0 +39/=34/-7 70.00%

Time Control= 2 + 2

Stockfish 190915 64 BMI2_8 - Komodo 9.2 64-bit_x8 42.5 - 37.5 +17/=51/-12 53.13%
Stockfish 190915 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 61.0 - 19.0 +43/=36/-1 76.25%
Stockfish 190915 64 BMI2_8 - Gull 3 x64 XPx8 58.5 - 21.5 +39/=39/-2 73.13%

Score using 8 real cores: 315.5 – 164.5 = 65,73% (!!!)
480 Games=
http://www.mediafire.com/download/1cifi35sg244ld2

GLOBAL SCORE AFTER 960 GAMES= 619.5 – 340.5 = 64.53%

Against : Komodo 9.2 (3251) = 53.75% Houdini 4 (3136) = 69.37%, Gull 3 XP (3103) = 70.47%

Average Elo of Oponents= 3.163

Estimated Elo Performance for Stockfish Development 190915 after the first half of my test= 3.265


Stockfish Development 190915 has scored 14 Elo points above Komodo 9.2!. Let’s check if it keeps this incredible performance in the second bunch of 960 games.

Regards,
Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 190915 = 1.920 GAMES

Timestamp: 1442679275 Bench: 7658406

SECOND LEG : 960 GAMES.

6 real cores

Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control 4 + 0

Stockfish 190915 64 POPCNT_6 - Komodo 9.2 64-bit_x6 41.5 - 38.5 +15/=53/-12 51.88%
Stockfish 190915 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 57.0 - 23.0 +37/=40/-3 71.25%
Stockfish 190915 64 POPCNT_6 - Gull 3 x64 XP 55.5 - 24.5 +36/=39/-5 69.38%

Time Control 2 + 2

Stockfish 190915 64 POPCNT_6 - Komodo 9.2 64-bit_x6 41.5 - 38.5 +16/=51/-13 51.88%
Stockfish 190915 64 POPCNT_6 - Houdini 4 x64_st_X6_CT0 53.5 - 26.5 +32/=43/-5 66.88%
Stockfish 190915 64 POPCNT_6 - Gull 3 x64 XP 56.5 - 23.5 +38/=37/-5 70.63%

Score using 6 cores: 305.5 – 174.5 = 63.65%
480 Games: http://www.mediafire.com/download/v9p0e9k31330dw1

8 real cores

Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 4 + 0

Stockfish 190915 64 BMI2_8 - Komodo 9.2 64-bit_x8 40.5 - 39.5 +13/=55/-12 50.63%
Stockfish 190915 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 54.5 - 25.5 +31/=47/-2 68.13%
Stockfish 190915 64 BMI2_8 - Gull 3 x64 XPx8 56.5 - 23.5 +38/=37/-5 70.63%

Time Control= 2 + 2

Stockfish 190915 64 BMI2_8 - Komodo 9.2 64-bit_x8 41.0 - 39.0 +12/=58/-10 51.25%
Stockfish 190915 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 54.5 - 25.5 +33/=43/-4 68.13%
Stockfish 190915 64 BMI2_8 - Gull 3 x64 XPx8 60.5 - 19.5 +43/=35/-2 75.63%

Score using 8 real cores: 307.5 – 172.5 = 64.06%
480 Games= http://www.mediafire.com/download/00sh6aav8stt6ru

GLOBAL SCORE AFTER 960 GAMES SECOND LEG = 613.0 – 347.0 = 63.85%

Against : Komodo 9.2 (3251) = 51.41% Houdini 4 (3136) = 68.60%, Gull 3 XP (3103) = 71.57%
Average Elo of Oponents= 3.163
Estimated Elo in the Second 960 Leg= 3.260

--------------------------------------

Segmenting 1920 games by Time Control=

Fixed Time Control= 608.0 – 352.0= 63.33%
Incremental Time Control= 624.5 – 335.5 = 65.05%

GLOBAL SCORE AFTER TWO LEGS WITH 1.920 GAMES = 1232.5 – 687.5= 64.19%
Average Elo of Oponents= 3.163

ESTIMATED ELO PERFORMANCE FOR STOCKFISH DEV 190915 AFTER 1920 GAMES= 3.262


Stockfish Development 190915 is the new leader in my tests, 11 Elo points ahead of Komodo 9.2. The improvement over SF.DEV. 200815 has been substantial: 21 Elo points in only one month.

1.- Stockfish Development 190915= 3.262
2.- Komodo 9.2 = 3.251.
3.- Komodo 9.1= 3.247
4.- Sugar Pro V.1= 3.246
5.- Stockfish Dev. 200815= 3.241
6.- Stockfish 6= 3.219
7.- Komodo 9= 3.209
8.- Houdini 4= 3.136
9.- Gull= 3.103

Congratulations to the Stockfish Team!! Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH BULLET 280915 = 1920 GAMES

FIRST LEG. FIXED TIME CONTROL. 960 GAMES


6 real cores

Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control 4 + 0

Stockfish 280915b 64 SSE42_X6 - Komodo 9.2 64-bit_x6 61.0 - 59.0 +25/=72/-23 50.83%
Stockfish 280915b 64 SSE42_X6 - Stockfish 190915 64 POP_6 65.5 - 54.5 +14/=103/-3 54.58%
Stockfish 280915b 64 SSE42_X6 - Houdini 4 x64_st_X6_CT0 82.5 - 37.5 +51/=63/-6 68.75%
Stockfish 280915b 64 SSE42_X6 - Gull 3 x64 XP 83.0 - 37.0 +48/=70/-2 69.17%

Score using 6 cores: 292.0 – 188.0 = 60.83%
480 Games: http://www.mediafire.com/download/ilulzvr1bx4t34c

8 real cores

Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 4 + 0
Stockfish 280915b 64 BMI2_X8 - Komodo 9.2 64-bit_x8 63.0 - 57.0 +25/=76/-19 52.50%
Stockfish 280915b 64 BMI2_X8 - Stockfish 190915 64 BMI2_8 60.0 - 60.0 +9/=102/-9 50.00%
Stockfish 280915b 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 88.5 - 31.5 +58/=61/-1 73.75%
Stockfish 280915b 64 BMI2_X8 - Gull 3 x64 XPx8 80.5 - 39.5 +48/=65/-7 67.08%

Score using 8 real cores: 292.0 – 188.0 = 60.83%
480 Games= http://www.mediafire.com/download/rd2y802u8q97a13

Against : Komodo 9.2 (3251) = 51.66% Stockfish 190915 (3262) = 52.29% Houdini 4 (3136) = 71.25%, Gull 3 XP (3103) = 68.13%

Average Elo of Oponents= 3.188

GLOBAL SCORE AFTER 960 GAMES AT FIXED TIME CONTROL = 584.0 – 376.0 = 60.83%
ESTIMATED ELO PERFORMANCE FOR STOCKFISH BULLET 281915 AFTER 960 GAMES= 3.264


Error Bars = +/- 16.

At Fixed Time Control this fast Bullet’s compile has performed 8 Elo Point better than the current leader in my tests Stockfish Development 190915 (3.156 at Fixed Time Control). Let’s see if it can maintain this advantadge in the second leg of this test, at Incremental Time Control.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH BULLET 280915 = 1920 GAMES

SECOND LEG. INCREMENTAL TIME CONTROL. 960 GAMES


6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time contro=l 2+2
Stockfish 280915b 64 SSE42_X6 - Komodo 9.2 64-bit_x6 61.0 - 59.0 +17/=88/-15 50.83%
Stockfish 280915b 64 SSE42_X6 - Stockfish 190915 64 POP_6 62.5 - 57.5 +8/=109/-3 52.08%
Stockfish 280915b 64 SSE42_X6 - Houdini 4 x64_st_X6_CT0 83.0 - 37.0 +49/=68/-3 69.17%
Stockfish 280915b 64 SSE42_X6 - Gull 3 x64 XP 85.0 - 35.0 +56/=58/-6 70.83%

Score using 6 cores: 291.5 – 188.5 = 60.73%
480 Games: http://www.mediafire.com/download/8yyvznk1wkj0qw1

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 2+2

Stockfish 280915b 64 BMI2_X8 - Komodo 9.2 64-bit_x8 58.0 - 62.0 +21/=74/-25 48.33%
Stockfish 280915b 64 BMI2_X8 - Stockfish 190915 64 BMI2_8 62.0 - 58.0 +11/=102/-7 51.67%
Stockfish 280915b 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 77.0 - 43.0 +44/=66/-10 64.17%
Stockfish 280915b 64 BMI2_X8 - Gull 3 x64 XPx8 83.0 - 37.0 +51/=64/-5 69.17%

Score using 8 real cores: 280.0 – 200.0 = 58.33%
480 Games= http://www.mediafire.com/download/yu4t42m6qg5ibb8
Against : Komodo 9.2 (3251) = 49.58% Stockfish 190915 (3262) = 51.87% Houdini 4 (3136) = 66.67%, Gull 3 XP (3103) = 70.00%
Average Elo of Oponents= 3.188

GLOBAL SCORE AFTER 960 GAMES AT FIXED TIME CONTROL = 571.5 – 388.5 = 59.53%
ESTIMATED ELO PERFORMANCE FOR STOCKFISH BULLET 281915 AFTER 960 GAMES= 3.255
Error Bars = +/- 16.


GLOBAL SCORE FOR STOCKFISH BULLET 280915 AFTER 1.920 GAMES.

Fixed Time Control = 584.0 – 376.0= 60.83%
Incremental Time Control= 571.5 – 388.5 = 59.53%

TOTAL= 1.155.5 – 764.5 = 60.18%
Average Elo of Oponents= 3.188

ESTIMATED ELO PERFORMANCE FOR STOCKFISH BULLET 280915 AFTER 1.920 GAMES= 3.259


Error Bars +/-11

Only three Elo Points below the current leader in my tests SF Development 190915, within Error Bars.

1.- Stockfish Development 190915= 3.262
2.- Stockfish Bullet 280915= 3.259
3.- Komodo 9.2 = 3.251.
4.- Komodo 9.1= 3.247
5.- Sugar Pro V.1= 3.246
6.- Stockfish Dev. 200815= 3.241
7.- Stockfish 6= 3.219
8.- Komodo 9= 3.209
9.- Houdini 4= 3.136
10.- Gull= 3.103

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 031015 = 1920 GAMES

Timestamp: 1443869406 Bench: 8073614

FIRST LEG. FIXED TIME CONTROL. 960 GAMES
,


6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control= 4+0
Stockfish 031015 64 POPCNT_X6 - Komodo 9.2 64-bit_x6 67.5 - 52.5 +35/=65/-20 56.25%
Stockfish 031015 64 POPCNT_X6 - Stockfish 190915 64 POP_6 60.0 - 60.0 +8/=104/-8 50.00%
Stockfish 031015 64 POPCNT_X6 - Houdini 4 x64_st_X6_CT0 78.5 - 41.5 +46/=65/-9 65.42%
Stockfish 031015 64 POPCNT_X6 - Gull 3 x64 XP 87.0 - 33.0 +55/=64/-1 72.50%

Score using 6 cores: 293.0 – 187.0 = 61.04%
480 Games: http://www.mediafire.com/download/pts74u4qlgs6eiu

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 4+0

Stockfish 031015 64 BMI2_X8 - Komodo 9.2 64-bit_x8 60.5 - 59.5 +19/=83/-18 50.42%
Stockfish 031015 64 BMI2_X8 - Stockfish 190915 64 BMI2_8 58.5 - 61.5 +7/=103/-10 48.75%
Stockfish 031015 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 77.5 - 42.5 +41/=73/-6 64.58%
Stockfish 031015 64 BMI2_X8 - Gull 3 x64 XPx8 84.5 - 35.5 +54/=61/-5 70.42%

Score using 8 real cores: 281.0 – 199.0 = 58.54%
480 Games= http://www.mediafire.com/download/8llolzlaf3xvuxc

Against : Komodo 9.2 (3251) = 53.34% Stockfish 190915 (3262) = 49.37% Houdini 4 (3136) = 65.00%, Gull 3 XP (3103) = 71.46%

Average Elo of Oponents= 3.188

GLOBAL SCORE AFTER 960 GAMES AT FIXED TIME CONTROL = 574.0 – 386.0 = 59.79%

ESTIMATED ELO PERFORMANCE FOR STOCKFISH DEVELOPMENT 031015 AFTER 960 GAMES= 3.257


Error Bars = +/- 16.

Regards,

Tom
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 031015 = 1920 GAMES

Timestamp: 1443869406 Bench: 8073614

SECOND LEG. INCREMENTAL TIME CONTROL. 960 GAMES

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control= 2+2
Stockfish 031015 64 POPCNT_X6 - Komodo 9.2 64-bit_x6 70.5 - 49.5 +36/=69/-15 58.75%
Stockfish 031015 64 POPCNT_X6 - Stockfish 190915 64 POP 56.0 - 64.0 +6/=100/-14 46.67%
Stockfish 031015 64 POPCNT_X6 - Houdini 4 x64_st_X6_CT0 78.0 - 42.0 +43/=70/-7 65.00%
Stockfish 031015 64 POPCNT_X6 - Gull 3 x64 XP 81.5 - 38.5 +53/=57/-10 67.92%

Score using 6 cores: 286.0 – 194.0 = 59.58%
480 Games: http://www.mediafire.com/download/d605nnrkb7cekdd

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 2+2
Stockfish 031015 64 BMI2_X8 - Komodo 9.2 64-bit_x8 60.5 - 59.5 +20/=81/-19 50.42%
Stockfish 031015 64 BMI2_X8 - Stockfish 190915 64 BMI2_8 60.0 - 60.0 +9/=102/-9 50.00%
Stockfish 031015 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 76.0 - 44.0 +39/=74/-7 63.33%
Stockfish 031015 64 BMI2_X8 - Gull 3 x64 BMI2_X8 79.0 - 41.0 +44/=70/-6 65.83%

Score using 8 real cores: 275.5 – 204.5 = 57.40%
480 Games= http://www.mediafire.com/download/fsbtx7y5ljb4q9j

Against : Komodo 9.2 (3251) = 54.59% Stockfish 190915 (3262) = 48.33% Houdini 4 (3136) = 64.16%, Gull 3 XP (3103) = 66.87%
Average Elo of Oponents= 3.188

GLOBAL SCORE AFTER 960 GAMES AT INCREMENTAL TIME CONTROL = 561.5 – 398.5 = 58.49%

ESTIMATED ELO PERFORMANCE FOR STOCKFISH DEVELOPMENT 031015 AFTER 960 GAMES INCREMENTAL TIME CONTROL= 3.247

------------------------------

GLOBAL SCORE FOR STOCKFISH DEV 031015 AFTER 1920 GAMES= 1.135.5 – 784.5= 59.14%

ESTIMATED ELO PERFORMANCE FOR STOCKFISH DEV 031015 AFTER 1920 GAMES= 3.252


This development version has scored 10 points below the current leader in my tests Stockfish Development 190915 (3.262 ELO).

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

Testing STOCKFISH 061015 Vokavor (Ming Compile) = 480 Games.

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control 4 + 0

Stockfish 061015 64 POPCNTvv - Komodo 9.2 64-bit_x6 17.5 - 12.5 +9/=17/-4 58.33%
Stockfish 061015 64 POPCNTvv - Stockfish 190915 64 POPCNT_6 15.0 - 15.0 +1/=28/-1 50.00%
Stockfish 061015 64 POPCNTvv - Houdini 4 x64_st_X6_CT0 19.0 - 11.0 +12/=14/-4 63.33%
Stockfish 061015 64 POPCNTvv - Gull 3 x64 XP 22.0 - 8.0 +14/=16/-0 73.33%

Time Control 2 + 2

Stockfish 061015 64 POPCNTvv - Komodo 9.2 64-bit_x6 17.5 - 12.5 +7/=21/-2 58.33%
Stockfish 061015 64 POPCNTvv - Stockfish 190915 64 POPCNT_6 13.5 - 16.5 +2/=23/-5 45.00%
Stockfish 061015 64 POPCNTvv - Houdini 4 x64_st_X6_CT0 21.0 - 9.0 +13/=16/-1 70.00%
Stockfish 061015 64 POPCNTvv - Gull 3 x64 XP 22.0 - 8.0 +14/=16/-0 73.33%

Global Score using 6 real cores= 147.5 – 92.5= 61.46%

240 Games= http://www.mediafire.com/download/gpqgycbtvknib0v

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control 4+0

Stockfish 061015 64 POPCNTvv - Komodo 9.2 64-bit_x8 12.5 - 17.5 +2/=21/-7 41.67%
Stockfish 061015 64 POPCNTvv - Stockfish 190915 64 BMI2_8 14.5 - 15.5 +2/=25/-3 48.33%
Stockfish 061015 64 POPCNTvv - Houdini 4 Pro x64_Ct0_8 21.0 - 9.0 +14/=14/-2 70.00%
Stockfish 061015 64 POPCNTvv - Gull 3 x64 XPx8 21.5 - 8.5 +13/=17/-0 71.67%

Time Control 2+2

Stockfish 061015 64 POPCNTvv - Komodo 9.2 64-bit_x8 14.5 - 15.5 +6/=17/-7 48.33%
Stockfish 061015 64 POPCNTvv - Stockfish 190915 64 BMI2 16.0 - 14.0 +3/=26/-1 53.33%
Stockfish 061015 64 POPCNTvv - Houdini 4 Pro x64_Ct0_8 19.5 - 10.5 +10/=19/-1 65.00%
Stockfish 061015 64 POPCNTvv - Gull 3 x64 XPx8 19.5 - 10.5 +10/=19/-1 65.00%

Score using 8 real cores: 139.0 – 101.0 = 57.92%

240 Games= http://www.mediafire.com/download/u552lut2lvzsh57

Against : Komodo 9.2 (3251) = 51.64% Stockfish 190915 (3262) = 49.16% Houdini 4 (3136) = 67.08%, Gull 3 XP (3103) = 70.83%%
Average Elo of Oponents= 3.188

GLOBAL SCORE FOR STOCKFISH 061015 VOKAVOR (Ming Compile) = 286.5 – 193.5= 59.69%

ESTIMATED ELO PERFORMANCE FOR STOCKFISH 061015 VOKAVOR AFTER 480 GAMES = 3.256


Only 6 Elo points below the Top Scorer so far in my tests Stockfish Development 190915 (3262).

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 121015 = 1920 GAMES

Timestamp: 1444683654 Bench: 7677367

FIRST LEG. FIXED TIME CONTROL. 960 GAMES,

6 real cores

Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time control= 4+0
Stockfish 121015 64 POPCNT_X6 - Komodo 9.2 64-bit_x6 65.0 - 55.0 +28/=74/-18 54.17%
Stockfish 121015 64 POPCNT_X6 - Stockfish 190915 64 POP_6 60.0 - 60.0 +11/=98/-11 50.00%
Stockfish 121015 64 POPCNT_X6 - Houdini 4 x64_st_X6_CT0 79.5 - 40.5 +46/=67/-7 66.25%
Stockfish 121015 64 POPCNT_X6 - Gull 3 x64 XP 85.5 - 34.5 +60/=51/-9 71.25%

Score using 6 cores: = 290.0 – 190.0= 60.42%
480 Games: http://www.mediafire.com/download/ozb320vr6bf2g4v

8 real cores

Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control= 4+0
Stockfish 121015 64 BMI2_X8 - Komodo 9.2 64-bit_x8 60.0 - 60.0 +20/=80/-20 50.00%
Stockfish 121015 64 BMI2_X8 - Stockfish 190915 64 BMI2_8 61.5 - 58.5 +13/=97/-10 51.25%
Stockfish 121015 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 85.5 - 34.5 +55/=61/-4 71.25%
Stockfish 121015 64 BMI2_X8 - Gull 3 x64 XPx8 79.0 - 41.0 +45/=68/-7 65.83%

Score using 8 real cores: = 286.0 – 194.0= 59.58%
480 Games: http://www.mediafire.com/download/ta6pn2wj53bjgt5

Against : Komodo 9.2 (3251) = 52.08% Stockfish 190915 (3262) = 50.62% Houdini 4 (3136) = 68.75%, Gull 3 XP (3103) = 68.54%
Average Elo of Oponents= 3.188

GLOBAL SCORE AFTER 960 GAMES AT FIXED TIME CONTROL = 576.0 – 384.0= 60.00%

ESTIMATED ELO PERFORMANCE FOR STOCKFISH DEVELOPMENT 121015 AFTER 960 GAMES= 3258

Error Bars = +/- 16.

Only as a reference, te Top Scorer in my tests so far, SF Development 190915, performed at 3265 ELO level after 960 Games at Fixed Time Control. Let's wait for the second leg of this test at Incremental Time Control.

Regards,

Tom