Simply have the engines play short books and make sure to play each openings (exact position out of book) and play enough games for the results to be statistically relevant.
The opening books chosen does not matter.
I disagree, choice of opening book is important. An opening book with unequal lines will give an advantage to the weaker engine.
What if the games are played such that each engine plays both sides of every opening? I think that would equalize the effect of any bad lines in the book -- am I wrong about that?
Simply have the engines play short books and make sure to play each openings (exact position out of book) and play enough games for the results to be statistically relevant.
The opening books chosen does not matter.
I disagree, choice of opening book is important. An opening book with unequal lines will give an advantage to the weaker engine.
What if the games are played such that each engine plays both sides of every opening? I think that would equalize the effect of any bad lines in the book -- am I wrong about that?
Roy
It is not going to change the fact that weak engines may score better relative to the case that you do not have bad lines.
Simply have the engines play short books and make sure to play each openings (exact position out of book) and play enough games for the results to be statistically relevant.
The opening books chosen does not matter.
I disagree, choice of opening book is important. An opening book with unequal lines will give an advantage to the weaker engine.
What if the games are played such that each engine plays both sides of every opening? I think that would equalize the effect of any bad lines in the book -- am I wrong about that?
Roy
Yes, i think you are wrong. Unequal lines will allow a weaker engine to win or draw games that it would otherwise lose against a stronger engine if the line was equal.
Simply have the engines play short books and make sure to play each openings (exact position out of book) and play enough games for the results to be statistically relevant.
The opening books chosen does not matter.
I disagree, choice of opening book is important. An opening book with unequal lines will give an advantage to the weaker engine.
What if the games are played such that each engine plays both sides of every opening? I think that would equalize the effect of any bad lines in the book -- am I wrong about that?
Roy
Yes, i think you are wrong. Unequal lines will allow a weaker engine to win or draw games that it would otherwise lose against a stronger engine if the line was equal.
Dave
I stand corrected. I was assuming that the books would be very short with equal lines.
Actually it would also be interesting to let an engine in a winning position that is technically difficult to win, and see if it can win it. Or a very difficult draw to hold in what looks like a winning position for the opponent. Although that would have be a totally different type of test.
