TalkChess.com
Hosted by Your Move Chess & Games

Author Message
Robert Hyatt

Joined: 27 Feb 2006
Posts: 20340
Location: Birmingham, AL

Post subject: Re: test results    Posted: Fri Mar 16, 2012 5:20 pm

Rémi Coulom wrote:
 bob wrote: Here is the output from BayesElo first: 2 Crafty-23.5R06-200 2650 4 4 30000 64% 2539 22% 3 Crafty-23.5R06-24 2650 4 4 30000 64% 2539 22% 4 Crafty-23.5R06-100 2649 4 4 30000 63% 2539 22% 5 Crafty-23.5R06-30 2648 4 4 30000 63% 2539 22% 6 Crafty-23.5R06-50 2648 4 4 30000 63% 2539 22% 7 Crafty-23.5R06-300 2648 4 4 30000 63% 2539 22% 8 Crafty-23.5R06-20 2648 4 4 30000 63% 2539 22% 9 Crafty-23.5R06-10 2645 4 4 30000 63% 2539 22% 10 Crafty-23.5-2 2645 4 4 30000 63% 2539 22% 11 Crafty-23.5R06-1 2645 4 4 30000 63% 2539 22% 12 Crafty-23.5R06-8 2644 4 4 30000 63% 2539 22% 13 Crafty-23.5R06-5 2643 4 4 30000 63% 2539 22% 14 Crafty-23.5-1 2641 4 4 30000 63% 2539 22% 15 Crafty-23.5R06-2 2636 4 4 30000 62% 2539 22% version 23.5-1 and 23.5-2 are simply two consecutive runs with the same version to provide a normal result. The rest of the tests are version 23.5R06 and were tested where the -n is the aspiration window (delta value in the code posted yesterday). 23.5R06-1 means the aspiration window was +/- 1 with delta=1. 1 and 2 are a bit low, and by the time it gets to 10, it is pretty optimal. Bigger doesn't seem to hurt at all up to +/- 3.0 pawns... I was expecting a better result in the 20-40 range, the reason I ran the big numbers was to produce some worse results so that there is a recognizable curve with a clear optimal value, and worse results on either side. Didn't get exactly what I expected, as you can see...

You should use CLOP

Rémi

I intend on looking at it. But I can test this so simply at present, I just say "runtest" and it runs the test with each parameter change as needed. Of course it is not optimally tuning a parameter, just using the choices I give...
 Display posts from previous: All Posts1 Day7 Days2 Weeks1 Month3 Months6 Months1 Year Oldest FirstNewest First
Subject Author Date/Time
Uri Blass Mon Mar 12, 2012 11:14 am
Ed Schroder Mon Mar 12, 2012 12:55 pm
Marco Costalba Mon Mar 12, 2012 6:47 pm
Don Dailey Mon Mar 12, 2012 9:41 pm
Robert Hyatt Wed Mar 14, 2012 10:18 pm
Marco Costalba Thu Mar 15, 2012 6:15 am
Robert Hyatt Thu Mar 15, 2012 2:06 pm
Robert Hyatt Thu Mar 15, 2012 5:30 pm
Robert Hyatt Thu Mar 15, 2012 8:11 pm
Robert Hyatt Thu Mar 15, 2012 9:55 pm
Miguel A. Ballicora Thu Mar 15, 2012 10:23 pm
Robert Hyatt Fri Mar 16, 2012 3:29 am
Robert Hyatt Fri Mar 16, 2012 3:41 am
Rémi Coulom Fri Mar 16, 2012 8:38 am
Re: test results Robert Hyatt Fri Mar 16, 2012 5:20 pm
Karlo Bala Jr. Fri Mar 16, 2012 11:30 am
Robert Hyatt Fri Mar 16, 2012 5:26 pm
Ed Schroder Fri Mar 16, 2012 6:31 pm
Robert Hyatt Fri Mar 16, 2012 7:16 pm
Vincent Diepeveen Sat Mar 17, 2012 1:44 pm
Robert Hyatt Sat Mar 17, 2012 4:11 pm
Marco Costalba Sat Mar 17, 2012 5:28 pm
Robert Hyatt Sun Mar 18, 2012 3:28 am
Lucas Braesch Sun Mar 18, 2012 5:55 am
Joona Kiiski Sun Mar 18, 2012 9:02 am
Robert Houdart Mon Mar 12, 2012 10:44 pm
Robert Houdart Tue Mar 13, 2012 9:18 am
Uri Blass Tue Mar 13, 2012 10:12 am
Karlo Bala Jr. Wed Mar 14, 2012 7:46 pm
Robert Hyatt Thu Mar 15, 2012 9:49 pm
Lucas Braesch Wed Mar 14, 2012 4:10 pm
Eelco de Groot Wed Mar 14, 2012 7:30 pm
Lucas Braesch Thu Mar 15, 2012 2:03 am
Marco Costalba Thu Mar 15, 2012 6:13 am
Eelco de Groot Tue Mar 13, 2012 10:20 am
Uri Blass Tue Mar 13, 2012 12:57 pm

 Jump to: Select a forum Computer Chess Club Forums----------------Computer Chess Club: General TopicsComputer Chess Club: Tournaments and MatchesComputer Chess Club: Programming and Technical DiscussionsComputer Chess Club: Engine Origins Other Forums----------------Chess Thinkers ForumChess Players ForumForum Help and Suggestions
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum