ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Fantacising about a testing cluster!
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Robert Hyatt



Joined: 27 Feb 2006
Posts: 15875
Location: Birmingham, AL
PostPost subject: Re: Fantacising about a testing cluster!    Posted: Tue Apr 03, 2007 7:28 pm Reply to topic Reply with quote
mathmoi wrote:
bob wrote:
I like to test at 60/60 time controls. 60 minutes on the clock, 60 seconds per move added. That turns into 4-6 hours per game. or 6-8 games per day. 30 days isn't enough games to determine if version X is better than version X-1 at that speed. It takes more than a hundred games or two with two opponents that are fairly close in rating.


Hi,

At a rate 6-8 games per day you'll get to 210 games in 30 days, so 30 days should be enough to determine wich oponent is better.


If the two versions are close, 200 games is nowhere near enough to say which version is better. I'm working on something for the JICGA right now that shows some interesting results based on this very topic. I can produce some 200+ game matches where version A wins one, version B wins the other. Both versions playing 80 games against each of 3 opponents, using 40 starting positions, each played once with each color. 240 games total. Not always enough. In fact, rarely ever enough unless something is broken to make one version clearly worse.
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
Fantacising about a testing cluster! Michael Sherwin Sun Apr 01, 2007 9:42 pm
      Re: Fantacising about a testing cluster! LarsA Sun Apr 01, 2007 10:43 pm
      Re: Fantacising about a testing cluster! Steven Edwards Mon Apr 02, 2007 1:54 am
            Re: Fantacising about a testing cluster! Michael Sherwin Mon Apr 02, 2007 2:34 am
                  Re: Fantacising about a testing cluster! Steven Edwards Mon Apr 02, 2007 3:06 am
                        Re: Fantacising about a testing cluster! Michael Sherwin Mon Apr 02, 2007 4:10 am
                              Re: Fantacising about a testing cluster! Denis P. Mendoza Mon Apr 02, 2007 8:31 pm
                                    Re: Fantacising about a testing cluster! Michael Sherwin Mon Apr 02, 2007 9:03 pm
                        Re: Fantacising about a testing cluster! abb Sun Apr 08, 2007 7:44 pm
      Re: Fantacising about a testing cluster! Robert Hyatt Mon Apr 02, 2007 1:54 am
            Re: Fantacising about a testing cluster! Michael Sherwin Mon Apr 02, 2007 2:04 am
                  Re: Fantacising about a testing cluster! Robert Hyatt Mon Apr 02, 2007 8:53 pm
                        Re: Fantacising about a testing cluster! Mathieu Pagé Tue Apr 03, 2007 3:01 pm
                              Re: Fantacising about a testing cluster! Robert Hyatt Tue Apr 03, 2007 7:28 pm
                                    Re: Fantacising about a testing cluster! Mathieu Pagé Tue Apr 03, 2007 11:28 pm
                                          Re: Fantacising about a testing cluster! Robert Hyatt Wed Apr 04, 2007 7:44 pm
      Cheap hardware krazyken Wed Apr 04, 2007 2:42 am
            Re: Cheap hardware Michael Sherwin Wed Apr 04, 2007 4:07 am
                  Re: Cheap hardware Steven Edwards Wed Apr 04, 2007 8:49 am
                        Re: Cheap hardware Tony Wed Apr 04, 2007 11:32 am
                  Re: Cheap hardware krazyken Wed Apr 04, 2007 11:25 am
      Re: Fantacising about a testing cluster! Marc Lacrosse Wed Apr 11, 2007 8:57 am
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads