TalkChess.com
Hosted by Your Move Chess & Games

Author Message
Ed Schroder

Joined: 18 Aug 2011
Posts: 4077

Post subject: Re: test results    Posted: Fri Mar 16, 2012 6:31 pm

bob wrote:
Karlo Bala wrote:
 bob wrote: Here is the output from BayesElo first: 2 Crafty-23.5R06-200 2650 4 4 30000 64% 2539 22% 3 Crafty-23.5R06-24 2650 4 4 30000 64% 2539 22% 4 Crafty-23.5R06-100 2649 4 4 30000 63% 2539 22% 5 Crafty-23.5R06-30 2648 4 4 30000 63% 2539 22% 6 Crafty-23.5R06-50 2648 4 4 30000 63% 2539 22% 7 Crafty-23.5R06-300 2648 4 4 30000 63% 2539 22% 8 Crafty-23.5R06-20 2648 4 4 30000 63% 2539 22% 9 Crafty-23.5R06-10 2645 4 4 30000 63% 2539 22% 10 Crafty-23.5-2 2645 4 4 30000 63% 2539 22% 11 Crafty-23.5R06-1 2645 4 4 30000 63% 2539 22% 12 Crafty-23.5R06-8 2644 4 4 30000 63% 2539 22% 13 Crafty-23.5R06-5 2643 4 4 30000 63% 2539 22% 14 Crafty-23.5-1 2641 4 4 30000 63% 2539 22% 15 Crafty-23.5R06-2 2636 4 4 30000 62% 2539 22% version 23.5-1 and 23.5-2 are simply two consecutive runs with the same version to provide a normal result. The rest of the tests are version 23.5R06 and were tested where the -n is the aspiration window (delta value in the code posted yesterday). 23.5R06-1 means the aspiration window was +/- 1 with delta=1. 1 and 2 are a bit low, and by the time it gets to 10, it is pretty optimal. Bigger doesn't seem to hurt at all up to +/- 3.0 pawns... I was expecting a better result in the 20-40 range, the reason I ran the big numbers was to produce some worse results so that there is a recognizable curve with a clear optimal value, and worse results on either side. Didn't get exactly what I expected, as you can see...

What is the average depth?

A quick looks says that the average is in the 13-14-15 range. I looked at a few logs and there are plenty of re-searches going on, so it is having a chance to exert influence.

What should not be forgotten is the saturation of the hash table. With an almost full hash table researches will become very expensive and it would make sense to widen the window.
 Display posts from previous: All Posts1 Day7 Days2 Weeks1 Month3 Months6 Months1 Year Oldest FirstNewest First
Subject Author Date/Time
Uri Blass Mon Mar 12, 2012 11:14 am
Ed Schroder Mon Mar 12, 2012 12:55 pm
Marco Costalba Mon Mar 12, 2012 6:47 pm
Don Dailey Mon Mar 12, 2012 9:41 pm
Robert Hyatt Wed Mar 14, 2012 10:18 pm
Marco Costalba Thu Mar 15, 2012 6:15 am
Robert Hyatt Thu Mar 15, 2012 2:06 pm
Robert Hyatt Thu Mar 15, 2012 5:30 pm
Robert Hyatt Thu Mar 15, 2012 8:11 pm
Robert Hyatt Thu Mar 15, 2012 9:55 pm
Miguel A. Ballicora Thu Mar 15, 2012 10:23 pm
Robert Hyatt Fri Mar 16, 2012 3:29 am
Robert Hyatt Fri Mar 16, 2012 3:41 am
Rémi Coulom Fri Mar 16, 2012 8:38 am
Robert Hyatt Fri Mar 16, 2012 5:20 pm
Karlo Bala Jr. Fri Mar 16, 2012 11:30 am
Robert Hyatt Fri Mar 16, 2012 5:26 pm
Re: test results Ed Schroder Fri Mar 16, 2012 6:31 pm
Robert Hyatt Fri Mar 16, 2012 7:16 pm
Vincent Diepeveen Sat Mar 17, 2012 1:44 pm
Robert Hyatt Sat Mar 17, 2012 4:11 pm
Marco Costalba Sat Mar 17, 2012 5:28 pm
Robert Hyatt Sun Mar 18, 2012 3:28 am
Lucas Braesch Sun Mar 18, 2012 5:55 am
Joona Kiiski Sun Mar 18, 2012 9:02 am
Robert Houdart Mon Mar 12, 2012 10:44 pm
Robert Houdart Tue Mar 13, 2012 9:18 am
Uri Blass Tue Mar 13, 2012 10:12 am
Karlo Bala Jr. Wed Mar 14, 2012 7:46 pm
Robert Hyatt Thu Mar 15, 2012 9:49 pm
Lucas Braesch Wed Mar 14, 2012 4:10 pm
Eelco de Groot Wed Mar 14, 2012 7:30 pm
Lucas Braesch Thu Mar 15, 2012 2:03 am
Marco Costalba Thu Mar 15, 2012 6:13 am
Eelco de Groot Tue Mar 13, 2012 10:20 am
Uri Blass Tue Mar 13, 2012 12:57 pm

 Jump to: Select a forum Computer Chess Club Forums----------------Computer Chess Club: General TopicsComputer Chess Club: Tournaments and MatchesComputer Chess Club: Programming and Technical DiscussionsComputer Chess Club: Engine Origins Other Forums----------------Chess Thinkers ForumChess Players ForumForum Help and Suggestions
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum