ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

What your opinion about this testing methodology?
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Fermin Serrano



Joined: 08 Feb 2008
Posts: 511
Location: Madrid - Spain

PostPost subject: What your opinion about this testing methodology?    Posted: Tue Apr 17, 2012 5:28 pm Reply to topic Reply with quote

Should it work?

I have been thinking about ways to improve testing time results. People usually use tournaments from startup position, or tournaments with a set of very limited set of position (i.e. 32), or tournaments with a lot of random positions. I asumme all people is doing this with a minimum of 1000 to 4000 games.

.... but ....

what about repeating the same tournament, with the same opponents, with the same positions per opponent?. Assuming a set of positions would be very large....

example:
Game 1, agains Crafty, black, posicion from FEN file 'myfenpositions.epd', number of position 540
Game 2, agains Critter, white, position from FEN file 'myfenpositions.epd', number of position 3251
....
etc

the idea is that the number of position would be always the same and not choosed ramdomly, without repeating any FEN, but enought varied.
The tournament file from the tournament manager would always be the same, without the need to recreate the tournament. The test would always repeat the same.

Would be results between tests more accurate than randomly choose the startup position.?
_________________
Fermin Serrano
Author of 'Rodin' engine
http://sites.google.com/site/clonfsp/
http://clonfsp.wordpress.com
Back to top
View user's profile Send private message Visit poster's website MSN Messenger
Display posts from previous:   
Subject Author Date/Time
What your opinion about this testing methodology? Fermin Serrano Tue Apr 17, 2012 5:28 pm
      Re: What your opinion about this testing methodology? Ferdinand Mosca Wed Apr 18, 2012 6:45 am
            Re: What your opinion about this testing methodology? Fermin Serrano Wed Apr 18, 2012 7:56 am
                  Re: What your opinion about this testing methodology? Sven Schüle Wed Apr 18, 2012 9:40 am
                        Re: What your opinion about this testing methodology? Lucas Braesch Wed Apr 18, 2012 11:41 am
                              Re: What your opinion about this testing methodology? Sven Schüle Wed Apr 18, 2012 11:52 am
                        Re: What your opinion about this testing methodology? Robert Hyatt Wed Apr 18, 2012 7:28 pm
                  Re: What your opinion about this testing methodology? Ferdinand Mosca Wed Apr 18, 2012 10:12 am
                  Re: What your opinion about this testing methodology? Vincent Diepeveen Wed Apr 18, 2012 11:51 am
      Re: What your opinion about this testing methodology? Mincho Georgiev Wed Apr 18, 2012 7:52 am
            Re: What your opinion about this testing methodology? Mincho Georgiev Wed Apr 18, 2012 11:46 am
      Re: What your opinion about this testing methodology? Don Dailey Wed Apr 18, 2012 5:05 pm
      Re: What your opinion about this testing methodology? Robert Hyatt Wed Apr 18, 2012 7:27 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads