Shredder 12 - OA On and OA Off

[Graham Banks]

It would seem that OA On has about a 15 elo advantage based on CCRL 40/40 and 40/4 testing.

[Spock]

I think it is inconclusive. 15 ELO is within the statistical margin of error.

Bayes ELO however does give an 84% LOS number (likelihood of superiority) so interpret that how you will.

Code: Select all

Rank                 Engine                   ELO   +    -   Score  AvOp  Games
1 Deep Shredder 12 64-bit OA On 4CPU      3145  +21  -21  64.0%  -99.0   810
  Deep Shredder 12 64-bit OA Off 4CPU     3132  +16  -16  62.5%  -86.2  1399

[Vinvin]

Thanks to test this new feature, very interesting Graham !

BTW, do you know how does "Opening advisor" works ?
Do you use the same book for the 2 versions ?

It would seem that OA On has about a 15 elo advantage based on CCRL 40/40 and 40/4 testing.

[Aser Huerga]

Do you use the same book for the 2 versions ?

I used two books, same number of games for each book with and without OA, so answer is Yes in my games.

Regards.

[Spock]

BTW, do you know how does "Opening advisor" works ?

Stefan would have to tell us, we could only speculate based on observations. That is assuming he would want to reveal any more detail.

[Kirill Kryukov]

From today's "Live" update of CCRL 40/40, comparison of Shredder versions:

64-bit 4-CPU: OA is worth 29 points, likelihood of superiority is 87.5%.

32-bit 1-CPU: OA is worth 12 points, likelihood of superiority is 70.2%.

Code: Select all

Rank                Engine                 ELO   +    -   Score  AvOp  Games
1 Deep Shredder 12 64-bit OA On 4CPU   3145  +33  -32  63.2%  -84.4   299
  Deep Shredder 12 64-bit OA Off 4CPU  3116  +33  -33  59.1%  -56.5   268
  Shredder 12 32-bit OA On             3042  +25  -25  64.5%  -92.4   522
  Shredder 12 32-bit OA Off            3030  +35  -35  60.8%  -67.9   250

Basically still inconclusive, but roughly about 20 points advantage from OA.

More interesting to me is the fact that Shredder 12 32-bit (either with or without OA) is rated higher than Deep Shredder 11 64-bit 4CPU. Impressive.

[Spock]

The blitz list has more games, so should be a more reliable comparison. Still inconclusive.

Code: Select all

Rank                 Engine                   ELO   +    -   Score  AvOp  Games 
1 Deep Shredder 12 64-bit OA On 4CPU      3145  +21  -21  64.0%  -99.0   810 
  Deep Shredder 12 64-bit OA Off 4CPU     3132  +16  -16  62.5%  -86.2  1399

http://tinyurl.com/yfpdlg9

[Aser Huerga]

Do you use the same book for the 2 versions ?

I used two books, same number of games for each book with and without OA, so answer is Yes in my games.

Regards.

And the same engine matches, of course.

[Vinvin]

Thanks !

I wonder why "OA off" exists

[IWB]

Hi,

Isn't that what you expect of an "opening advisior"?

I wam fine with that result!

Bye
Ingo