Testing: More Opponents Or More Positions

Discussion of chess software programming and technical issues.

Moderator: Ras

brianr
Posts: 540
Joined: Thu Mar 09, 2006 3:01 pm
Full name: Brian Richardson

Re: Testing: More Opponents Or More Positions

Post by brianr »

krazyken wrote:
brianr wrote:When I run bayeselo on a combined pgn with 1,600 games from each of two Tinker versions (3,200 total),
the ratings shows an elo difference of about 26 +/- 1,
I'm not understanding how you come to this number, but +/- 1 seems a bit small for the number of games you are talking about. Perhaps you want to post the original data?
brianr wrote: but the LOS (with the mm 1 option?) shows LOS of 98.

Is this saying there is a 98% chance that the version that is 26 elo higher is better?
Yes
brianr wrote: Exactly what does the mm 1 option do?
I recall an earlier post mentioning it, but I tried it without the mm 1 option and the results are the same.
the 1 tells it to calculate the advantage of going first. use the advantage command to to see what that comes out to.
Typing error should have said +/- 16
Did not mean to mislead things by claiming +/- just 1!