For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean

Moderator: Ras
Sedat has lots of tournaments designed just to find out what opening book is best.Sean Evans wrote:Hi, when you have your tournaments what opening book do you use for each program?
For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean
Actually, that one was a more general tournament. Here is one of his book analysis tournaments:Dann Corbit wrote:Sedat has lots of tournaments designed just to find out what opening book is best.Sean Evans wrote:Hi, when you have your tournaments what opening book do you use for each program?
For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean
See, for example:
http://www.sedatchess.com/scct2010.html
Opening book is not the best way to test engines because it fails on many aspects, one of which you've mentioned.Sean Evans wrote:Hi, when you have your tournaments what opening book do you use for each program?
For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean
Allowing each engine to play as both White and Black from a given starting position should help minimise that concern.govert wrote:So what's the alternative?
I guess you need a bunch of different starting positions, but how do you determine the lack of bias towards a particular engine?
When both plays the same position it can't really be called bias especially if there are more than a handful positions. There are some test suites you can download. Nunn, Silver Suite (Albert Silver), and ECO Variations (mine).Graham Banks wrote:Allowing each engine to play as both White and Black from a given starting position should help minimise that concern.govert wrote:So what's the alternative?
I guess you need a bunch of different starting positions, but how do you determine the lack of bias towards a particular engine?
I would think a "bookless" engine tournament would be very interestingSean Evans wrote:Hi, when you have your tournaments what opening book do you use for each program?
For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean
Bookless and no set positions lead to limited variations. Some engines love Ruy Lopez and that's all you will get.Kirk wrote:I would think a "bookless" engine tournament would be very interestingSean Evans wrote:Hi, when you have your tournaments what opening book do you use for each program?
For instance, if the out of the box opening book is stronger for Program A over Program B, then A would have a better chance of winning even though B's engine might be stronger.
Cordially,
Sean
Code: Select all
I would think a "bookless" engine tournament would be very interesting