I think your test is meaningless, because you haven't found any reliable difference at all in flipping the bonuses. But you should have found a difference.mcostalba wrote:I have used HS-Book.ctg with FritzGUIRalph Stoesser wrote:
It's also possible that 1000 games are not enough, because you could have not tested enough positions with opposide side castling. Maybe in this case it would make sense to only test positions from openings with opposite side castling.
What opening book and book depth did you test with?
Yes, it is possible that 1000 games are not enough, but I won't dedicate any more time-CPU resources to this patch.
This is my resource allocation policy: if a given patch fails to show good results after 1000 games at reasonable time control then it is discarded. If instead it shows good result it is committed.
Of course we all agree this rule is not 100% reliable, you could discard good patches or commit bad ones, but I think this is an efficent resource allocation policy that guarantees an ELO increase in the long term on a big number of patches.
I could opt to test less patches to a deeper extent, or I could opt to test more patches to a lighter extent: what I have choosen is the above rule and it proved to pay off.
So I won't change it
After we have castled queen side and the opponent has castled king side, either it is good to open files on front of our king instead of opening files on enemy side, or it is the other way round (every chess player knows what's right here).
But for sure it is not meaningless how you would do it. Otherwise, if you trust your result, a good patch would be to remove the bonus completely.
I think this is a good example where a test with much more games at unreasonable fast time control is more reliable than test with few games at reasonable time control.