Testing Deep Shredder 13

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Testing Deep Shredder 13

Post by Tomcass »

TESTING DEEP SHREDDER 13 – 960 GAMES

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Fixed Time Control= 4+0
Deep Shredder 13 x64_X6 - Komodo 10.2 64-bit_X6_NOB 19.0 - 41.0 +4/=30/-26 31.67%
Deep Shredder 13 x64_X6 - SugaR 2.6 64 POPCNT_X6 23.0 - 37.0 +5/=36/-19 38.33%
Deep Shredder 13 x64_X6 - Houdini 5.01 Pro x64-popc_X6 17.0 - 43.0 +2/=30/-28 28.33%
Deep Shredder 13 x64_X6 - Gull 3 x64 XP_X6 39.5 - 20.5 +23/=33/-4 65.83%

Incremental Time Control 2+2
Deep Shredder 13 x64_X6 - Komodo 10.2 64-bit_X6_NOB 21.0 - 39.0 +5/=32/-23 35.00%
Deep Shredder 13 x64_X6 - SugaR 2.6 64 POPCNT_X6 18.0 - 42.0 +1/=34/-25 30.00%
Deep Shredder 13 x64_X6 - Houdini 5.01 Pro x64-popc_X6 14.5 - 45.5 +0/=29/-31 24.17%
Deep Shredder 13 x64_X6 - Gull 3 x64 XP_X6 34.5 - 25.5 +16/=37/-7 57.50%

480 Games= http://www.mediafire.com/file/a8fea80leqqf1e6/
Score using 6 cores= 186.5 – 293.5 = 38.85%

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Fixed Time Control= 4+0
Deep Shredder 13 x64_X8 - Komodo 10.2 64-bit_X8_NOB 21.0 - 39.0 +1/=40/-19 35.00%
Deep Shredder 13 x64_X8 - SugaR 2.6 64 BMI2_X8 21.5 - 38.5 +4/=35/-21 35.83%
Deep Shredder 13 x64_X8 - Houdini 5 Pro x64-pext_X8 17.0 - 43.0 +2/=30/-28 28.33%
Deep Shredder 13 x64_X8 - Gull 3 x64 BMI2_X8 36.5 - 23.5 +19/=35/-6 60.83%

Incremental Time Control 2+2
Deep Shredder 13 x64_X8 - Komodo 10.2 64-bit_X8_NOB 17.5 - 42.5 +3/=29/-28 29.17%
Deep Shredder 13 x64_X8 - SugaR 2.6 64 BMI2_X8 18.5 - 41.5 +3/=31/-26 30.83%
Deep Shredder 13 x64_X8 - Houdini 5 Pro x64-pext_X8 15.0 - 45.0 +1/=28/-31 25.00%
Deep Shredder 13 x64_X8 - Gull 3 x64 BMI2_X8 36.5 - 23.5 +18/=37/-5 60.83%

480 Games= http://www.mediafire.com/file/g013ssoq1jd402b
Score using 8 cores = 183.5 - 296.5= 38.23%

GLOBAL SCORE AFTER 960 GAMES: 370.0 – 590.0 = 38.54%
Average Elo of rivals= 3.247
Estimated ELO for Deep Shredder 13 = 3.167

Deep Shredder 13 against:
Komodo 10.2 (3277) = 32.71%
Sugar2.6 (3291) = 33.75%
Houdini 5 Pro (3316) = 26.46%
Gull 3 (3103) = 61.25%

Unfortunately I have not been able to find my previous tests with Deep Shredder 12, so that I can not compare the evolution of Shredder's.

Although still 168 Elo points below the top leading engine Stockfish 8, the evolution of Deep Shredder 13 is excellent. According to this test, it has performed 31 Elo points better than Houdini 4 Pro and 64 better than Gull 3.

Well done!

Regards,

Tom.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: Testing Deep Shredder 13

Post by Ozymandias »

Tomcats wrote:64 better than Gull 3
Have you considered LazyGull? I noticed a 50 ELO points improvement, at very fast time controls, over Gull 3.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Deep Shredder 13

Post by Tomcass »

I was not aware of this LazzyGull, Juan. I will try to find it. 50 Elo improvement sounds quite impressive to me.

Thanks for your advice. :wink:

Regards,

Tom.
User avatar
Ozymandias
Posts: 1532
Joined: Sun Oct 25, 2009 2:30 am

Re: Testing Deep Shredder 13

Post by Ozymandias »

Look no further: LazyGull alpha 0.3 (latest one).
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Deep Shredder 13

Post by Tomcass »

Ozymandias wrote:Look no further: LazyGull alpha 0.3 (latest one).
Thanks, Juan!

Tom. :D
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Testing Deep Shredder 13

Post by Dann Corbit »

Tomcass wrote:
Ozymandias wrote:Look no further: LazyGull alpha 0.3 (latest one).
Thanks, Juan!

Tom. :D
I instantly get a segfault on starting up.

Same thing happens when I build it myself with pgo.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.