Search found 19592 matches

by hgm
Mon Aug 11, 2008 9:01 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: Correlated data discussion

Using the node count instead of time would mean you're not testing the time management code, right? I guess you'd then have to test that separately, which is really starting to make the testing complex. This would not be true if you use the node-based time-control mode of WinBoard 4.3.14. Then the ...
by hgm
Mon Aug 11, 2008 8:35 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: Correlated data discussion

I might be stuck there, none of my GUI choices seem to allow a time per move mode for engine matches. Except Xboard which doesn't seem to have granularity below one second. You can achieve smaller granularity by specifying a time-odds factor for both engines, and playing with "-timeOddsMode 0", so ...
by hgm
Mon Aug 11, 2008 8:19 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: 4 sets of data

The programs are _hardly_ close together in strength, if you'd just look at the results. A relative rating difference of 300 top to bottom is quite a spread... But there is no difference of 300, as the 4 full round-robins you did clearly show . Glaurung is about +75, Arasan about -50. That is only ...
by hgm
Sun Aug 10, 2008 9:53 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: 4 sets of data

I started the thread, remember? If you want, I can back up a few posts and grab the tit-for-tat points to show where my comment came from. I doubt most would need that guidance, however. Oh, I know where it came from. The point is that you posted that same comment in the other thread, where it was ...
by hgm
Sun Aug 10, 2008 8:16 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: 4 sets of data

First, look at the data. Second, look at what I said changed. The ratings of all programs were squeezed into a narrower band with the round-robin. Aha! So you were posting in the wrong thread, after all! And too thick to notice it even when warned once... So let it be clear to all now who of us is ...
by hgm
Sun Aug 10, 2008 7:35 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: Correlated data discussion

Using the node count instead of time would mean you're not testing the time management code, right? I guess you'd then have to test that separately, which is really starting to make the testing complex. This would not be true if you use the node-based time-control mode of WinBoard 4.3.14. Then the ...
by hgm
Sun Aug 10, 2008 4:55 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: Correlated data discussion

You think that was a conclusion from your partial result? Actually this is fresh-man's teaching material, the basics of every experimental science... Going to try to sell me a bridge next? re-read what you wrote about this suggesting that the first run was bad, and the second was good. All based on...
by hgm
Sun Aug 10, 2008 4:41 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: BTW

bob wrote:You made a duplicate post. Are you having issues with very slow posting times? I've been trying to determine if it is just CCC or something in general on my end as I am seeing the same.
CCC is very slow today, also for me.
by hgm
Sun Aug 10, 2008 4:36 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: 4 sets of data

However, would it be possible for either (a) you _do_ follow a specific discussion and post comments related to it or (b) if you choose to not follow context, then also choose to not make comments that have nothing to do with the discussion? You would have to be more specific. That you perhaps cann...
by hgm
Sun Aug 10, 2008 2:52 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New testing thread
Replies: 243
Views: 45326

Re: Correlated data discussion

Another one: do not draw conclusions from _one_ partial result. The test has not even finished yet and here you go, drawing a conclusion. The way the test is run, the partial results can be highly misleading due to white/black bias. One does best by waiting until _all_ the data is in. You think tha...