Search found 16819 matches

by bob
Mon Jun 04, 2007 6:58 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Observator bias or...
Replies: 51
Views: 53652

Re: Observator bias or...

I don't see how this observation in anyway can be interpreted as a drawback of the fixed-nr-of-nodes testing method. IMO you would get exactly the same variability if you would compare testing at 20 sec per move vs 20.01 sec per move. This observation is simply based on the central limit theorem of...
by bob
Sun Jun 03, 2007 8:40 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Technical question about the Core 2 Duo and Mac OS X
Replies: 45
Views: 19528

Re: Technical question about the Core 2 Duo and Mac OS X

This estimate is for the same (32-bit) binary. For 64-bit you get an extra acceleration, which of course strongly depends on how much 64-bit arithmetic you do compared to 32-bit stuff. For the 64-bit stuff itself it could be more than a factor 2. Thanks, that sounds a lot better! Apparently my prog...
by bob
Sun Jun 03, 2007 8:38 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Comparison data of Crafty vs Rybka that I promised 2 days ag
Replies: 27
Views: 15180

Re: Movei added to Crafty vs Rybka comaprison data

yes. In fact, crafty has commands "flip" and "flop" to do that to the current position. "evtest" takes a FEN suite and does the sanity test using those commands. I ran all 4. all four reported a mate in 6. the scores were +2.18 and -2.18, + when it was black to move, - when it was white to move. So...
by bob
Sun Jun 03, 2007 8:34 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Observator bias or...
Replies: 51
Views: 53652

Re: Observator bias or...

Yes, for this reason testing at a fixed number of nodes and recording the ime, rather than fixing the time, seems preferable. But of course you cannot get rid of the randomness induced by SMP that way. For this reason I still want to implement the tree comparison idea I proposed here lately. This w...
by bob
Sun Jun 03, 2007 12:54 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Observator bias or...
Replies: 51
Views: 53652

Re: Observator bias or...

Yes, for this reason testing at a fixed number of nodes and recording the ime, rather than fixing the time, seems preferable. But of course you cannot get rid of the randomness induced by SMP that way. For this reason I still want to implement the tree comparison idea I proposed here lately. This w...
by bob
Sat Jun 02, 2007 6:41 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Observator bias or...
Replies: 51
Views: 53652

Re: Observator bias or...

I am working on an ICGA paper hitting on this very topic. I'll make it electronically available once it has made it thru the review process. There are lots of places where randomness can creep in, but the main one is timing. Timing is just not that accurate, and at today's NPS rates, a few milliseco...
by bob
Sat Jun 02, 2007 6:37 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Observator bias or...
Replies: 51
Views: 53652

Re: Observator bias or...

I remember since testing with Kiwi that results with 100 games are very unreliable. It sometimes happen that a version gets a bad start but gets better at the end of the long test. On the other hand, I had a version reach 64% after 100 games and finish with a disappointing 50% after 720 games... I ...
by bob
Sat Jun 02, 2007 6:07 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Technical question about the Core 2 Duo and Mac OS X
Replies: 45
Views: 19528

Re: Technical question about the Core 2 Duo and Mac OS X

There are plenty of linux distros that run in 64 bit mode as well as the windows 64 bit version. Surely Apple has done this as well... My understanding is that Leopard (Mac OS/X 10.5) will run both 32 bit and 64 bit programs. Of course, the 64 programs will require a Core 2 Duo, Xeon Woodcrest, or ...
by bob
Sat Jun 02, 2007 6:00 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Comparison data of Crafty vs Rybka that I promised 2 days ag
Replies: 27
Views: 15180

Re: Movei added to Crafty vs Rybka comaprison data

yes. In fact, crafty has commands "flip" and "flop" to do that to the current position. "evtest" takes a FEN suite and does the sanity test using those commands. I ran all 4. all four reported a mate in 6. the scores were +2.18 and -2.18, + when it was black to move, - when it was white to move. So ...
by bob
Sat Jun 02, 2007 5:58 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Comparison data of Crafty vs Rybka that I promised 2 days ag
Replies: 27
Views: 15180

Re: Movei added to Crafty vs Rybka comaprison data

The involved both search and evaluation. Each row (we would expect) should have about the same solution time, and none of the rows should be worse than the first. These are the actual positions referenced in the test. For any solutions found, none should be worse than 32756 (though there are closer...